Jun 03 19:38:22.008634 ip-10-0-129-187 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jun 03 19:38:22.008648 ip-10-0-129-187 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jun 03 19:38:22.008656 ip-10-0-129-187 systemd[1]: kubelet.service: Failed with result 'resources'.
Jun 03 19:38:22.008818 ip-10-0-129-187 systemd[1]: Failed to start Kubernetes Kubelet.
Jun 03 19:38:32.034606 ip-10-0-129-187 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jun 03 19:38:32.034624 ip-10-0-129-187 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 2e9cf7a7c4b541dd86f7301a85e6bd6b --
Jun 03 19:41:13.280344 ip-10-0-129-187 systemd[1]: Starting Kubernetes Kubelet...
Jun 03 19:41:13.712735 ip-10-0-129-187 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 19:41:13.712735 ip-10-0-129-187 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 03 19:41:13.712735 ip-10-0-129-187 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 19:41:13.712735 ip-10-0-129-187 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 03 19:41:13.712735 ip-10-0-129-187 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 19:41:13.713659 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.713561    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 03 19:41:13.720977 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.720941    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 19:41:13.720977 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.720968    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 19:41:13.720977 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.720972    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 19:41:13.720977 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.720975    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 19:41:13.720977 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.720978    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 19:41:13.720977 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.720981    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 19:41:13.720977 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.720984    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 19:41:13.720977 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.720988    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 19:41:13.720977 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.720990    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.720996    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.720999    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721002    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721006    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721011    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721014    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721018    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721020    2563 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721024    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721027    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721030    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721032    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721035    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721038    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721041    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721043    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721046    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721049    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721051    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 19:41:13.721314 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721054    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721056    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721059    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721062    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721065    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721068    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721072    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721076    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721079    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721081    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721084    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721086    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721089    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721092    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721096    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721099    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721102    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721105    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721108    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721112    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 19:41:13.721785 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721116    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721119    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721122    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721125    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721128    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721131    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721133    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721136    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721139    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721143    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721146    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721148    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721151    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721154    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721156    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721159    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721161    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721164    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721166    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721169    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 19:41:13.722289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721171    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721173    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721176    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721178    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721181    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721183    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721187    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721190    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721193    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721196    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721199    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721201    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721204    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721207    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721209    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721213    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721216    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721219    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721221    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 19:41:13.722806 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721224    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721226    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721229    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721231    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721234    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721237    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721239    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721242    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721244    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721247    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.721249    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722076    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722085    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722089    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722093    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722096    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722098    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722101    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722104    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 19:41:13.723372 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722110    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722115    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722118    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722121    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722124    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722126    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722129    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722131    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722134    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722136    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722140    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722142    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722145    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722148    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722150    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722153    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722155    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722158    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722162    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 19:41:13.723832 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722165    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722169    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722172    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722175    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722178    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722181    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722184    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722186    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722189    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722192    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722195    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722198    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722200    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722204    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722207    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722211    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722213    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722216    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722218    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722221    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 19:41:13.724324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722223    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722226    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722228    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722231    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722234    2563 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722237    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722239    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722242    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722244    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722247    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722249    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722252    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722254    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722257    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722259    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722262    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722265    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722268    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722270    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722272    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 19:41:13.724821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722275    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722277    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722280    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722282    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722285    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722288    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722292    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722294    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722297    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722300    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722302    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722305    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722308    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722310    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722313    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722315    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722318    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722321    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722324    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722327    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 19:41:13.725324 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722330    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722333    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722336    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722338    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722343    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722346    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722349    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722352    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722355    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722358    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722360    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722794    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722800    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722803    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722807    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722811    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722815    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722819    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722822    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 19:41:13.725808 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722825    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722828    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722830    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722833    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722836    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722838    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722841    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722843    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722846    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722848    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722852    2563 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722854    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722857    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722859    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722862    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722864    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722886    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722889    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722891    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722894    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 19:41:13.726296 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722897    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722899    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722902    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722904    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722907    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722910    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722913    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722916    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722918    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722921    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722923    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722926    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722929    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722931    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722934    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722936    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722938    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722942    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722944    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722947    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 19:41:13.726796 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722949    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722951    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722954    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722957    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722960    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722962    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722965    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722967    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722969    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722972    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722974    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722976    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722979    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722981    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722983    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722986    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722988    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722990    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722993    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722996    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 19:41:13.727306 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.722998    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723001    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723004    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723007    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723010    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723012    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723015    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723017    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723020    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723022    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723025    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723027    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723030    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723032    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723035    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723037    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723041    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723045    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723049    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 19:41:13.727777 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723053    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723056    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723059    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723063    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723066    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723069    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723071    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723074    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723076    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723079    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723081    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723167    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723174    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723180    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723185    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723190    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723193    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723197    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723202    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723205    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723208    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 03 19:41:13.728267 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723212    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723215    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723218    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723221    2563 flags.go:64] FLAG: --cgroup-root=""
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723224    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723227    2563 flags.go:64] FLAG: --client-ca-file=""
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723230    2563 flags.go:64] FLAG: --cloud-provider="external"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723233    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723238    2563 flags.go:64] FLAG: --cluster-domain=""
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723244    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723247    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723250    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723253    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723257    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723259    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723263    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723266    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723269    2563 flags.go:64] FLAG: --contention-profiling="false"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723271    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723274    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723277    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723280    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723284    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723287    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723289    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 03 19:41:13.728774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723292    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723296    2563 flags.go:64] FLAG: --enable-server="true"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723298    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723303    2563 flags.go:64] FLAG: --event-burst="100"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723306    2563 flags.go:64] FLAG: --event-qps="50"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723308    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723311    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723314    2563 flags.go:64] FLAG: --eviction-hard=""
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723318    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723321    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723324    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723327    2563 flags.go:64] FLAG: --eviction-soft=""
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723329    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723332    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723335    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723338    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723343    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723346    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723349    2563 flags.go:64] FLAG: --feature-gates=""
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723353    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723357    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723360    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723363    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723366    2563 flags.go:64] FLAG: --healthz-port="10248"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723369    2563 flags.go:64] FLAG: --help="false"
Jun 03 19:41:13.729405 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723371    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-129-187.ec2.internal"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723375    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723378    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723380    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723384    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723387    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723390    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723393    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723396    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723399    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723402    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723405    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723408    2563 flags.go:64] FLAG: --kube-reserved=""
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723411    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723414    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723417    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723419    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723422    2563 flags.go:64] FLAG: --lock-file=""
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723425    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723427    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723430    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723435    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723438    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723443    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 03 19:41:13.730093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723446    2563 flags.go:64] FLAG: --logging-format="text"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723449    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723453    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723455    2563 flags.go:64] FLAG: --manifest-url=""
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723458    2563 flags.go:64] FLAG: --manifest-url-header=""
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723463    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723466    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723470    2563 flags.go:64] FLAG: --max-pods="110"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723472    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723475    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723478    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723481    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723483    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723486    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723490    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723499    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723502    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723505    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723508    2563 flags.go:64] FLAG: --pod-cidr=""
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723511    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723516    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723519    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723522    2563 flags.go:64] FLAG: --pods-per-core="0"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723525    2563 flags.go:64] FLAG: --port="10250"
Jun 03 19:41:13.730685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723528    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723530    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02b5813801191ca47"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723533    2563 flags.go:64] FLAG: --qos-reserved=""
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723536    2563 flags.go:64] FLAG: --read-only-port="10255"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723539    2563 flags.go:64] FLAG: --register-node="true"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723542    2563 flags.go:64] FLAG: --register-with-taints=""
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723546    2563 flags.go:64] FLAG: --registry-burst="10"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723549    2563 flags.go:64] FLAG: --registry-qps="5"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723552    2563 flags.go:64] FLAG: --reserved-cpus=""
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723555    2563 flags.go:64] FLAG: --reserved-memory=""
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723559    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723562    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723565    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723568    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723571    2563 flags.go:64] FLAG: --runonce="false"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723574    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723577    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723579    2563 flags.go:64] FLAG: --seccomp-default="false"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723582    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723585    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723588    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723591    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723594    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723598    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723601    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 03 19:41:13.731280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723604    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723606    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723609    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723612    2563 flags.go:64] FLAG: --system-cgroups=""
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723615    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723620    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723623    2563 flags.go:64] FLAG: --tls-cert-file=""
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723626    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723630    2563 flags.go:64] FLAG: --tls-min-version=""
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723633    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723636    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723638    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723641    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723644    2563 flags.go:64] FLAG: --v="2"
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723648    2563 flags.go:64] FLAG: --version="false"
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723654    2563 flags.go:64] FLAG: --vmodule=""
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723657    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.723660    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723790    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723795    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723798    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723801    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723803    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 19:41:13.731933 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723806    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723809    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723811    2563 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723814    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723817    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723819    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723822    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723826    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723829    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723831    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723834    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723837    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723839    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723842    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723845    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723848    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723850    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723853    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723856    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 19:41:13.732505 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723861    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723865    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723894    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723897    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723900    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723904    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723906    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723909    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723911    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723914    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723918    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723920    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723923    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723926    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723928    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723930    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723933    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723936    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723938    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723941    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 19:41:13.733050 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723945    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723947    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723950    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723952    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723955    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723957    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723960    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723962    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723965    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723967    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723970    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723972    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723975    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723977    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723979    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723982    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723984    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723988    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723991    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723994    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 19:41:13.733538 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723996    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.723998    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724002    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724004    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724007    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724009    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724012    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724014    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724016    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724019    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724021    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724024    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724029    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724031    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724034    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724036    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724039    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724041    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724045    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 19:41:13.734051 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724048    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 19:41:13.734512 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724051    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 19:41:13.734512 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724053    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 19:41:13.734512 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724056    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 19:41:13.734512 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724059    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 19:41:13.734512 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724062    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 19:41:13.734512 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724064    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 19:41:13.734512 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724066    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 19:41:13.734512 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724069    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 19:41:13.734512 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724071    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 19:41:13.734512 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724075    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 19:41:13.734512 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724078    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 19:41:13.734512 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724081    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 19:41:13.734512 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724084    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 19:41:13.734512 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.724087    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 19:41:13.734512 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.724092    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.731432    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.731456    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.731479    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.731486    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731546    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731551    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731556    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731560    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731563    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731566    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731569    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731572    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731575    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731577    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731580    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731582    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731585    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 19:41:13.734904 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731588    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731590    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731593    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731595    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731598    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731600    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731603    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731606    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731608    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731611    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731614    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731616    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731619    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731621    2563 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731624    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731627    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731631    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731634    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731636    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731639    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 19:41:13.735348 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731642    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731644    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731647    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731649    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731652    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731654    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731657    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731659    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731662    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731664    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731666    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731669    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731671    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731674    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731676    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731679    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731681    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731684    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731686    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731689    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 19:41:13.735828 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731691    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731693    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731696    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731698    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731701    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731704    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731706    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731709    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731712    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731716    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731718    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731721    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731724    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731726    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731729    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731731    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731734    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731736    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731739    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731742    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 19:41:13.736338 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731746    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731749    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731752    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731754    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731756    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731759    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731761    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731764    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731766    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731769    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731771    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731774    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731776    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731779    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731781    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731783    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731786    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731788    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731790    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731794    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 19:41:13.736827 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731797    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 19:41:13.737376 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731800    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 19:41:13.737376 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731804    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 19:41:13.737376 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731807    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 19:41:13.737376 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731810    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 19:41:13.737376 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.731816    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 03 19:41:13.737376 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731985    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 19:41:13.737376 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731991    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 19:41:13.737376 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731995    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 19:41:13.737376 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.731998    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 19:41:13.737376 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732002    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 19:41:13.737376 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732005    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 19:41:13.737376 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732008    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 19:41:13.737376 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732011    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 19:41:13.737376 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732014    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732017    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732019    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732022    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732025    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732027    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732030    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732032    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732035    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732038    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732040    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732043    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732045    2563 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732047    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732050    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732052    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732055    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732058    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732062    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732064    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 19:41:13.737720 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732067    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732070    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732073    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732075    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732078    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732080    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732083    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732085    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732088    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732090    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732093    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732096    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732098    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732101    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732103    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732106    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732108    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732111    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732113    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732116    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 19:41:13.738232 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732118    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732122    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732125    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732128    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732131    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732134    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732137    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732140    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732142    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732145    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732148    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732151    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732154    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732156    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732159    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732162    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732164    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732167    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732170    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732172    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 19:41:13.738739 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732175    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732177    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732180    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732182    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732186    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732189    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732192    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732195    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732198    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732201    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732203    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732206    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732209    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732211    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732214    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732216    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732219    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732221    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732224    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732227    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 19:41:13.739241 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732229    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 19:41:13.739722 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732232    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 19:41:13.739722 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732236    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 19:41:13.739722 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732238    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 03 19:41:13.739722 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732241    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 03 19:41:13.739722 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732244    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 19:41:13.739722 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732246    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 19:41:13.739722 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732249    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 19:41:13.739722 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732251    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 19:41:13.739722 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:13.732254    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 19:41:13.739722 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.732258    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 03 19:41:13.739722 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.732395    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 03 19:41:13.739722 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.734436    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 03 19:41:13.739722 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.735892    2563 server.go:1019] "Starting client certificate rotation"
Jun 03 19:41:13.739722 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.736001    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 19:41:13.740192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.736037    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 19:41:13.740192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.738723    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 19:41:13.745997 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.745971    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 19:41:13.755821 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.755796    2563 log.go:25] "Validated CRI v1 runtime API"
Jun 03 19:41:13.758887 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.758852    2563 log.go:25] "Validated CRI v1 image API"
Jun 03 19:41:13.759693 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.759677    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 03 19:41:13.762970 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.762946    2563 fs.go:135] Filesystem UUIDs: map[1e80cbf8-5169-449f-8d96-c67e48c14d7e:/dev/nvme0n1p3 6e893cc1-504d-4e92-8a6b-dd794c6484bb:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jun 03 19:41:13.763035 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.762969    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 03 19:41:13.768379 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.768231    2563 manager.go:216] Machine: {Timestamp:2026-06-03 19:41:13.766798335 +0000 UTC m=+0.357281718 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099288 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c5b17ee6b6ec31bde6e60168235f8 SystemUUID:ec2c5b17-ee6b-6ec3-1bde-6e60168235f8 BootID:2e9cf7a7-c4b5-41dd-86f7-301a85e6bd6b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d4:85:76:b1:11 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d4:85:76:b1:11 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:3e:1a:a8:4d:2f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 03 19:41:13.768379 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.768348    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 03 19:41:13.768548 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.768442    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 03 19:41:13.768583 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.768542    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 19:41:13.771344 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.771308    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 03 19:41:13.771536 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.771347    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-187.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 03 19:41:13.772086 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.772075    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jun 03 19:41:13.772134 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.772089    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jun 03 19:41:13.772134 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.772097    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 19:41:13.773541 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.773527    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 19:41:13.774327 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.774316    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 03 19:41:13.777251 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.777234    2563 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 19:41:13.777406 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.777395    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 03 19:41:13.777456 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.777429    2563 kubelet.go:486] "Attempting to sync node with API server"
Jun 03 19:41:13.777456 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.777439    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 03 19:41:13.777456 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.777455    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 03 19:41:13.777570 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.777465    2563 kubelet.go:398] "Adding apiserver pod source"
Jun 03 19:41:13.777570 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.777475    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 03 19:41:13.777920 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.777906    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 19:41:13.778097 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.777933    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 19:41:13.783731 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.783713    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 03 19:41:13.785715 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.785701    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 03 19:41:13.785787 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.785731    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 03 19:41:13.786823 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.786809    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 03 19:41:13.786823 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.786825    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 03 19:41:13.786936 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.786832    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 03 19:41:13.786936 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.786837    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 03 19:41:13.786936 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.786847    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 03 19:41:13.786936 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.786853    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 03 19:41:13.786936 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.786860    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 03 19:41:13.786936 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.786882    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 03 19:41:13.786936 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.786899    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 03 19:41:13.786936 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.786905    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 03 19:41:13.786936 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.786917    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 03 19:41:13.786936 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.786923    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 03 19:41:13.788012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.788000    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 03 19:41:13.788012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.788010    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 03 19:41:13.791401 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:13.791364    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 03 19:41:13.791541 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:13.791526    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 03 19:41:13.791644 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.791633    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-187.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 03 19:41:13.791689 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.791648    2563 server.go:1268] "Started kubelet"
Jun 03 19:41:13.792404 ip-10-0-129-187 systemd[1]: Started Kubernetes Kubelet.
Jun 03 19:41:13.795622 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.795567    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 03 19:41:13.796651 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.796592    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 03 19:41:13.796755 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.796684    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 03 19:41:13.797730 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.797712    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 03 19:41:13.798685 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.798666    2563 server.go:310] "Adding debug handlers to kubelet server"
Jun 03 19:41:13.800285 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.800109    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d6h22"
Jun 03 19:41:13.802911 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:13.802740    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 03 19:41:13.803005 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.802950    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 03 19:41:13.803005 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.802971    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 03 19:41:13.803474 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:13.803452    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-187.ec2.internal\" not found"
Jun 03 19:41:13.803646 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.803631    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 03 19:41:13.803733 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.803723    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 03 19:41:13.803865 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.803640    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 03 19:41:13.804024 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.804007    2563 factory.go:55] Registering systemd factory
Jun 03 19:41:13.804098 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.804031    2563 factory.go:223] Registration of the systemd container factory successfully
Jun 03 19:41:13.804098 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.804020    2563 reconstruct.go:97] "Volume reconstruction finished"
Jun 03 19:41:13.804098 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.804073    2563 reconciler.go:29] "Reconciler: start to sync state"
Jun 03 19:41:13.804308 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.804290    2563 factory.go:153] Registering CRI-O factory
Jun 03 19:41:13.804308 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:13.803227    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-187.ec2.internal.18b5a9925d5d657b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-187.ec2.internal,UID:ip-10-0-129-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-187.ec2.internal,},FirstTimestamp:2026-06-03 19:41:13.791620475 +0000 UTC m=+0.382103911,LastTimestamp:2026-06-03 19:41:13.791620475 +0000 UTC m=+0.382103911,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-187.ec2.internal,}"
Jun 03 19:41:13.804308 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.804309    2563 factory.go:223] Registration of the crio container factory successfully
Jun 03 19:41:13.804468 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.804405    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 03 19:41:13.804468 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.804430    2563 factory.go:103] Registering Raw factory
Jun 03 19:41:13.804468 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.804447    2563 manager.go:1196] Started watching for new ooms in manager
Jun 03 19:41:13.804907 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.804894    2563 manager.go:349] Starting recovery of all containers
Jun 03 19:41:13.809556 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.808351    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d6h22"
Jun 03 19:41:13.810337 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:13.810114    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 03 19:41:13.810337 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:13.810280    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 03 19:41:13.815697 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.815675    2563 manager.go:354] Recovery completed
Jun 03 19:41:13.820221 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.820203    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 19:41:13.822034 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.822013    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 19:41:13.822135 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.822046    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 19:41:13.822135 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.822057    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasSufficientPID"
Jun 03 19:41:13.822630 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.822615    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 03 19:41:13.822670 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.822629    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 19:41:13.822698 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.822629    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 03 19:41:13.822735 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.822699    2563 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 19:41:13.823492 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.823476    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 19:41:13.823583 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.823505    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 19:41:13.823583 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.823517    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasSufficientPID"
Jun 03 19:41:13.824048 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.824037    2563 policy_none.go:49] "None policy: Start"
Jun 03 19:41:13.824083 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.824052    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 03 19:41:13.824083 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.824063    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 03 19:41:13.825294 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.825284    2563 policy_none.go:47] "Start"
Jun 03 19:41:13.866643 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.866605    2563 manager.go:337] "Starting Device Plugin manager"
Jun 03 19:41:13.873510 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:13.866651    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 03 19:41:13.873510 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.866666    2563 server.go:87] "Starting device plugin registration server"
Jun 03 19:41:13.873510 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.867000    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 03 19:41:13.873510 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.867033    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 03 19:41:13.873510 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.867134    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 03 19:41:13.873510 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.867262    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 03 19:41:13.873510 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.867275    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 03 19:41:13.873510 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:13.867855    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 03 19:41:13.873510 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:13.867917    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-187.ec2.internal\" not found"
Jun 03 19:41:13.873510 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.872702    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 03 19:41:13.874713 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.874685    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 03 19:41:13.874787 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.874743    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 03 19:41:13.874787 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.874770    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 03 19:41:13.874848 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:13.874816    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 03 19:41:13.877549 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.877532    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 19:41:13.967530 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.967431    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 19:41:13.968495 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.968473    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 19:41:13.968591 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.968517    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 19:41:13.968591 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.968533    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasSufficientPID"
Jun 03 19:41:13.968591 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.968568    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-187.ec2.internal"
Jun 03 19:41:13.975351 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.975322    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-187.ec2.internal"]
Jun 03 19:41:13.975461 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.975397    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 19:41:13.976391 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.976375    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 19:41:13.976496 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.976405    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 19:41:13.976496 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.976422    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasSufficientPID"
Jun 03 19:41:13.977602 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.977586    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-187.ec2.internal"
Jun 03 19:41:13.977651 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:13.977609    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-187.ec2.internal\": node \"ip-10-0-129-187.ec2.internal\" not found"
Jun 03 19:41:13.977760 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.977748    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 19:41:13.977944 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.977926    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal"
Jun 03 19:41:13.978017 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.977966    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 19:41:13.978552 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.978538    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 19:41:13.978552 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.978548    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 19:41:13.978654 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.978565    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 19:41:13.978654 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.978567    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 19:41:13.978654 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.978574    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasSufficientPID"
Jun 03 19:41:13.978654 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.978578    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasSufficientPID"
Jun 03 19:41:13.979659 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.979644    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-187.ec2.internal"
Jun 03 19:41:13.979721 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.979670    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 03 19:41:13.980426 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.980409    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 19:41:13.980516 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.980440    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 19:41:13.980516 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:13.980449    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeHasSufficientPID"
Jun 03 19:41:13.995003 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:13.994974    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-187.ec2.internal\" not found"
Jun 03 19:41:14.005746 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:14.005722    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-187.ec2.internal\" not found" node="ip-10-0-129-187.ec2.internal"
Jun 03 19:41:14.010526 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:14.010505    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-187.ec2.internal\" not found" node="ip-10-0-129-187.ec2.internal"
Jun 03 19:41:14.095591 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:14.095559    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-187.ec2.internal\" not found"
Jun 03 19:41:14.104971 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.104934    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3479ce4a7d1e982e2ed221c321b93971-config\") pod \"kube-apiserver-proxy-ip-10-0-129-187.ec2.internal\" (UID: \"3479ce4a7d1e982e2ed221c321b93971\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-187.ec2.internal"
Jun 03 19:41:14.105096 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.104986    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2f3d6d9321d2c6ee9b8c22740256d30e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal\" (UID: \"2f3d6d9321d2c6ee9b8c22740256d30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal"
Jun 03 19:41:14.105096 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.105011    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f3d6d9321d2c6ee9b8c22740256d30e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal\" (UID: \"2f3d6d9321d2c6ee9b8c22740256d30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal"
Jun 03 19:41:14.196146 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:14.196102    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-187.ec2.internal\" not found"
Jun 03 19:41:14.205411 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.205380    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3479ce4a7d1e982e2ed221c321b93971-config\") pod \"kube-apiserver-proxy-ip-10-0-129-187.ec2.internal\" (UID: \"3479ce4a7d1e982e2ed221c321b93971\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-187.ec2.internal"
Jun 03 19:41:14.205493 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.205424    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2f3d6d9321d2c6ee9b8c22740256d30e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal\" (UID: \"2f3d6d9321d2c6ee9b8c22740256d30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal"
Jun 03 19:41:14.205493 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.205443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f3d6d9321d2c6ee9b8c22740256d30e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal\" (UID: \"2f3d6d9321d2c6ee9b8c22740256d30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal"
Jun 03 19:41:14.205493 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.205464    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3479ce4a7d1e982e2ed221c321b93971-config\") pod \"kube-apiserver-proxy-ip-10-0-129-187.ec2.internal\" (UID: \"3479ce4a7d1e982e2ed221c321b93971\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-187.ec2.internal"
Jun 03 19:41:14.205493 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.205487    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f3d6d9321d2c6ee9b8c22740256d30e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal\" (UID: \"2f3d6d9321d2c6ee9b8c22740256d30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal"
Jun 03 19:41:14.205619 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.205530    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2f3d6d9321d2c6ee9b8c22740256d30e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal\" (UID: \"2f3d6d9321d2c6ee9b8c22740256d30e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal"
Jun 03 19:41:14.296775 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:14.296719    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-187.ec2.internal\" not found"
Jun 03 19:41:14.308218 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.308189    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal"
Jun 03 19:41:14.314289 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.314268    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-187.ec2.internal"
Jun 03 19:41:14.397390 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:14.397344    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-187.ec2.internal\" not found"
Jun 03 19:41:14.497892 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:14.497840    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-187.ec2.internal\" not found"
Jun 03 19:41:14.598490 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:14.598397    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-187.ec2.internal\" not found"
Jun 03 19:41:14.698982 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:14.698944    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-187.ec2.internal\" not found"
Jun 03 19:41:14.735482 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.735430    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 03 19:41:14.736264 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.735645    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 03 19:41:14.799756 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:14.799716    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-187.ec2.internal\" not found"
Jun 03 19:41:14.811459 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.811416    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 19:36:13 +0000 UTC" deadline="2027-12-13 20:24:57.142228309 +0000 UTC"
Jun 03 19:41:14.811459 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.811454    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13392h43m42.330778634s"
Jun 03 19:41:14.822948 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:14.822905    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f3d6d9321d2c6ee9b8c22740256d30e.slice/crio-76663b0a2ba771d8d419a1cf4ee6c93a099e52ab318061c9897806240319b156 WatchSource:0}: Error finding container 76663b0a2ba771d8d419a1cf4ee6c93a099e52ab318061c9897806240319b156: Status 404 returned error can't find the container with id 76663b0a2ba771d8d419a1cf4ee6c93a099e52ab318061c9897806240319b156
Jun 03 19:41:14.823299 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:14.823280    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3479ce4a7d1e982e2ed221c321b93971.slice/crio-54c3afd37552061b5440d0dbc7685c9aa58970dcaee54e5a722d8d0c61a5e9eb WatchSource:0}: Error finding container 54c3afd37552061b5440d0dbc7685c9aa58970dcaee54e5a722d8d0c61a5e9eb: Status 404 returned error can't find the container with id 54c3afd37552061b5440d0dbc7685c9aa58970dcaee54e5a722d8d0c61a5e9eb
Jun 03 19:41:14.828156 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.828136    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 19:41:14.878989 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.878851    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-187.ec2.internal" event={"ID":"3479ce4a7d1e982e2ed221c321b93971","Type":"ContainerStarted","Data":"54c3afd37552061b5440d0dbc7685c9aa58970dcaee54e5a722d8d0c61a5e9eb"}
Jun 03 19:41:14.879901 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:14.879854    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal" event={"ID":"2f3d6d9321d2c6ee9b8c22740256d30e","Type":"ContainerStarted","Data":"76663b0a2ba771d8d419a1cf4ee6c93a099e52ab318061c9897806240319b156"}
Jun 03 19:41:14.900123 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:14.900088    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-187.ec2.internal\" not found"
Jun 03 19:41:15.000648 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:15.000611    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-187.ec2.internal\" not found"
Jun 03 19:41:15.101242 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:15.101200    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-187.ec2.internal\" not found"
Jun 03 19:41:15.141763 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.141675    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 19:41:15.157238 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.157211    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 19:41:15.201790 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:15.201759    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-187.ec2.internal\" not found"
Jun 03 19:41:15.299634 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.299597    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 19:41:15.304806 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.304780    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal"
Jun 03 19:41:15.319587 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.319556    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 19:41:15.320693 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.320665    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-187.ec2.internal"
Jun 03 19:41:15.330735 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.330712    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 19:41:15.679957 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.679925    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 19:41:15.778095 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.778061    2563 apiserver.go:52] "Watching apiserver"
Jun 03 19:41:15.786784 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.786752    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 03 19:41:15.787198 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.787170    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-s7kdk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh","openshift-cluster-node-tuning-operator/tuned-b4pm7","openshift-multus/multus-xhg77","openshift-multus/network-metrics-daemon-dhn5t","openshift-network-diagnostics/network-check-target-t5xl7","openshift-network-operator/iptables-alerter-6kffg","kube-system/global-pull-secret-syncer-6b7zc","kube-system/konnectivity-agent-rdmnt","kube-system/kube-apiserver-proxy-ip-10-0-129-187.ec2.internal","openshift-dns/node-resolver-j6mcb","openshift-image-registry/node-ca-5rjh2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal","openshift-multus/multus-additional-cni-plugins-xv4qk"]
Jun 03 19:41:15.788790 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.788770    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.789847 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.789823    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:15.789971 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:15.789923    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:15.790997 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.790976    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6kffg"
Jun 03 19:41:15.792150 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.792130    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.793291 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.793268    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.794217 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.794194    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 03 19:41:15.794402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.794381    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:15.794495 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:15.794475    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:15.794583 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.794567    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d9bb9\""
Jun 03 19:41:15.795818 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.795798    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 03 19:41:15.795974 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.795954    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 03 19:41:15.796107 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.796082    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 03 19:41:15.796211 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.796183    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 03 19:41:15.796211 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.796195    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.796318 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.796225    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 03 19:41:15.796318 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.796244    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 03 19:41:15.796318 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.796259    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 03 19:41:15.796318 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.796312    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 03 19:41:15.796527 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.796421    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 03 19:41:15.796820 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.796802    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-g6jrp\""
Jun 03 19:41:15.797051 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.797036    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lspv5\""
Jun 03 19:41:15.797431 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.797193    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 03 19:41:15.797431 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.797427    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nrmjr\""
Jun 03 19:41:15.797652 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.797633    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 03 19:41:15.798324 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.798306    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:15.798415 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:15.798384    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:15.799899 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.799593    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 03 19:41:15.799899 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.799613    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 03 19:41:15.799899 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.799690    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 03 19:41:15.799899 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.799832    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rdmnt"
Jun 03 19:41:15.800222 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.800202    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 03 19:41:15.800606 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.800591    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 03 19:41:15.800757 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.800742    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c94tl\""
Jun 03 19:41:15.800814 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.800776    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 03 19:41:15.802052 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.801079    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j6mcb"
Jun 03 19:41:15.802979 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.802959    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5rjh2"
Jun 03 19:41:15.803639 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.803618    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.804121 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.804100    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 03 19:41:15.805018 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.804999    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 03 19:41:15.806690 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.806671    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 03 19:41:15.806927 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.806910    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 03 19:41:15.807103 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.807091    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 03 19:41:15.807267 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.807254    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 03 19:41:15.808053 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.808034    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mfz5x\""
Jun 03 19:41:15.808378 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.808344    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 03 19:41:15.808592 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.808577    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 03 19:41:15.808751 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.808732    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 03 19:41:15.808902 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.808889    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sv6t2\""
Jun 03 19:41:15.809055 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.809032    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 03 19:41:15.809358 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.809342    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 03 19:41:15.810838 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.810821    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5k8x6\""
Jun 03 19:41:15.811204 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.811170    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bxh5k\""
Jun 03 19:41:15.813939 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.813913    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-multus-socket-dir-parent\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.814053 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.813951    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-var-lib-cni-bin\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.814053 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.813978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e6d2055-8340-4249-985e-a172e9ca31b2-cnibin\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.814053 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814024    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e6d2055-8340-4249-985e-a172e9ca31b2-os-release\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.814215 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s82wk\" (UniqueName: \"kubernetes.io/projected/2e6d2055-8340-4249-985e-a172e9ca31b2-kube-api-access-s82wk\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.814215 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814085    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-sys\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.814215 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-var-lib-cni-multus\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.814215 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-multus-conf-dir\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.814215 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814150    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e42f9663-7a96-4ef0-95f5-a62af5edbee4-multus-daemon-config\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.814215 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814170    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2zmn\" (UniqueName: \"kubernetes.io/projected/b2d54a40-d9b9-4483-aff6-1d4d4ce412a3-kube-api-access-d2zmn\") pod \"node-ca-5rjh2\" (UID: \"b2d54a40-d9b9-4483-aff6-1d4d4ce412a3\") " pod="openshift-image-registry/node-ca-5rjh2"
Jun 03 19:41:15.814215 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814191    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e6d2055-8340-4249-985e-a172e9ca31b2-system-cni-dir\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.814215 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814212    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e6d2055-8340-4249-985e-a172e9ca31b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.814481 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814233    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e6d2055-8340-4249-985e-a172e9ca31b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.814481 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814248    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-kubernetes\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.814481 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814262    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-registration-dir\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.814481 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814283    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-run-ovn\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.814481 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814308    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret\") pod \"global-pull-secret-syncer-6b7zc\" (UID: \"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b\") " pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:15.814481 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814331    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-etc-kubernetes\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.814481 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814354    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abc93e0d-584f-4984-a573-a50352a3ee23-konnectivity-ca\") pod \"konnectivity-agent-rdmnt\" (UID: \"abc93e0d-584f-4984-a573-a50352a3ee23\") " pod="kube-system/konnectivity-agent-rdmnt"
Jun 03 19:41:15.814481 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814376    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-run-openvswitch\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.814481 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.814481 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814421    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2flc\" (UniqueName: \"kubernetes.io/projected/a2642983-5f96-4da4-b20d-f7864ba449e7-kube-api-access-p2flc\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.814481 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-dbus\") pod \"global-pull-secret-syncer-6b7zc\" (UID: \"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b\") " pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:15.814481 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814473    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-multus-cni-dir\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.814890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e42f9663-7a96-4ef0-95f5-a62af5edbee4-cni-binary-copy\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.814890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-modprobe-d\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.814890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6nfd\" (UniqueName: \"kubernetes.io/projected/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-kube-api-access-k6nfd\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.814890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.814890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-run-netns\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.814890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-node-log\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.814890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2642983-5f96-4da4-b20d-f7864ba449e7-ovnkube-config\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.814890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ns44\" (UniqueName: \"kubernetes.io/projected/52b2344c-97b7-4445-86e4-4cc46b5683f5-kube-api-access-9ns44\") pod \"node-resolver-j6mcb\" (UID: \"52b2344c-97b7-4445-86e4-4cc46b5683f5\") " pod="openshift-dns/node-resolver-j6mcb"
Jun 03 19:41:15.814890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-hostroot\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.814890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814655    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-tuned\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.814890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814671    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-etc-selinux\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.814890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7khxn\" (UniqueName: \"kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn\") pod \"network-check-target-t5xl7\" (UID: \"7f60d191-10e3-4ecb-9471-f6c6bfc3db0d\") " pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:15.814890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814700    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-systemd-units\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.814890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.814890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2642983-5f96-4da4-b20d-f7864ba449e7-ovn-node-metrics-cert\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.814890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814799    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-run-k8s-cni-cncf-io\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.815627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-tmp\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.815627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-run-systemd\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.815627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b6vz\" (UniqueName: \"kubernetes.io/projected/e42f9663-7a96-4ef0-95f5-a62af5edbee4-kube-api-access-4b6vz\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.815627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814944    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e6d2055-8340-4249-985e-a172e9ca31b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.815627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814968    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-kubelet\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.815627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.814991    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52b2344c-97b7-4445-86e4-4cc46b5683f5-hosts-file\") pod \"node-resolver-j6mcb\" (UID: \"52b2344c-97b7-4445-86e4-4cc46b5683f5\") " pod="openshift-dns/node-resolver-j6mcb"
Jun 03 19:41:15.815627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abc93e0d-584f-4984-a573-a50352a3ee23-agent-certs\") pod \"konnectivity-agent-rdmnt\" (UID: \"abc93e0d-584f-4984-a573-a50352a3ee23\") " pod="kube-system/konnectivity-agent-rdmnt"
Jun 03 19:41:15.815627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e6d2055-8340-4249-985e-a172e9ca31b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.815627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815068    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-device-dir\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.815627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-slash\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.815627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815126    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-log-socket\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.815627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-kubelet-config\") pod \"global-pull-secret-syncer-6b7zc\" (UID: \"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b\") " pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:15.815627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815183    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-systemd\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.815627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-lib-modules\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.815627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815231    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-var-lib-openvswitch\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.815627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815253    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-etc-openvswitch\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.816451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815274    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-run\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.816451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-var-lib-kubelet\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.816451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815365    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-cni-bin\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.816451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815408    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2642983-5f96-4da4-b20d-f7864ba449e7-env-overrides\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.816451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815432    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-system-cni-dir\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.816451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815460    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-cnibin\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.816451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815483    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-os-release\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.816451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs\") pod \"network-metrics-daemon-dhn5t\" (UID: \"6c557986-2994-4e1c-8425-9475d1281349\") " pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:15.816451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815536    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-socket-dir\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.816451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49704276-ef81-49a0-a090-d8dc1110e5c4-host-slash\") pod \"iptables-alerter-6kffg\" (UID: \"49704276-ef81-49a0-a090-d8dc1110e5c4\") " pod="openshift-network-operator/iptables-alerter-6kffg"
Jun 03 19:41:15.816451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815583    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w4cg\" (UniqueName: \"kubernetes.io/projected/49704276-ef81-49a0-a090-d8dc1110e5c4-kube-api-access-9w4cg\") pod \"iptables-alerter-6kffg\" (UID: \"49704276-ef81-49a0-a090-d8dc1110e5c4\") " pod="openshift-network-operator/iptables-alerter-6kffg"
Jun 03 19:41:15.816451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52b2344c-97b7-4445-86e4-4cc46b5683f5-tmp-dir\") pod \"node-resolver-j6mcb\" (UID: \"52b2344c-97b7-4445-86e4-4cc46b5683f5\") " pod="openshift-dns/node-resolver-j6mcb"
Jun 03 19:41:15.816451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815641    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2d54a40-d9b9-4483-aff6-1d4d4ce412a3-host\") pod \"node-ca-5rjh2\" (UID: \"b2d54a40-d9b9-4483-aff6-1d4d4ce412a3\") " pod="openshift-image-registry/node-ca-5rjh2"
Jun 03 19:41:15.816451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g7jm\" (UniqueName: \"kubernetes.io/projected/6c557986-2994-4e1c-8425-9475d1281349-kube-api-access-4g7jm\") pod \"network-metrics-daemon-dhn5t\" (UID: \"6c557986-2994-4e1c-8425-9475d1281349\") " pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:15.816451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815688    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wdcc\" (UniqueName: \"kubernetes.io/projected/df083e33-c63d-4424-bfa4-80b1646dcce5-kube-api-access-6wdcc\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.816451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815723    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-var-lib-kubelet\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.816451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-run-multus-certs\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.817098 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815756    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-sysconfig\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.817098 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815773    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-sysctl-d\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.817098 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815795    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-cni-netd\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.817098 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815813    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2642983-5f96-4da4-b20d-f7864ba449e7-ovnkube-script-lib\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.817098 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/49704276-ef81-49a0-a090-d8dc1110e5c4-iptables-alerter-script\") pod \"iptables-alerter-6kffg\" (UID: \"49704276-ef81-49a0-a090-d8dc1110e5c4\") " pod="openshift-network-operator/iptables-alerter-6kffg"
Jun 03 19:41:15.817098 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-run-netns\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.817098 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815914    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b2d54a40-d9b9-4483-aff6-1d4d4ce412a3-serviceca\") pod \"node-ca-5rjh2\" (UID: \"b2d54a40-d9b9-4483-aff6-1d4d4ce412a3\") " pod="openshift-image-registry/node-ca-5rjh2"
Jun 03 19:41:15.817098 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815934    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-sysctl-conf\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.817098 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815954    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-host\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.817098 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.815981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-sys-fs\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.827544 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.827515    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 19:41:15.847794 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.847769    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qpfhk"
Jun 03 19:41:15.856117 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.856090    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qpfhk"
Jun 03 19:41:15.916926 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.916893    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49704276-ef81-49a0-a090-d8dc1110e5c4-host-slash\") pod \"iptables-alerter-6kffg\" (UID: \"49704276-ef81-49a0-a090-d8dc1110e5c4\") " pod="openshift-network-operator/iptables-alerter-6kffg"
Jun 03 19:41:15.916926 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.916923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w4cg\" (UniqueName: \"kubernetes.io/projected/49704276-ef81-49a0-a090-d8dc1110e5c4-kube-api-access-9w4cg\") pod \"iptables-alerter-6kffg\" (UID: \"49704276-ef81-49a0-a090-d8dc1110e5c4\") " pod="openshift-network-operator/iptables-alerter-6kffg"
Jun 03 19:41:15.917188 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.916940    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52b2344c-97b7-4445-86e4-4cc46b5683f5-tmp-dir\") pod \"node-resolver-j6mcb\" (UID: \"52b2344c-97b7-4445-86e4-4cc46b5683f5\") " pod="openshift-dns/node-resolver-j6mcb"
Jun 03 19:41:15.917188 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.916961    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2d54a40-d9b9-4483-aff6-1d4d4ce412a3-host\") pod \"node-ca-5rjh2\" (UID: \"b2d54a40-d9b9-4483-aff6-1d4d4ce412a3\") " pod="openshift-image-registry/node-ca-5rjh2"
Jun 03 19:41:15.917188 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.916977    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g7jm\" (UniqueName: \"kubernetes.io/projected/6c557986-2994-4e1c-8425-9475d1281349-kube-api-access-4g7jm\") pod \"network-metrics-daemon-dhn5t\" (UID: \"6c557986-2994-4e1c-8425-9475d1281349\") " pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:15.917188 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917027    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/49704276-ef81-49a0-a090-d8dc1110e5c4-host-slash\") pod \"iptables-alerter-6kffg\" (UID: \"49704276-ef81-49a0-a090-d8dc1110e5c4\") " pod="openshift-network-operator/iptables-alerter-6kffg"
Jun 03 19:41:15.917188 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917055    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2d54a40-d9b9-4483-aff6-1d4d4ce412a3-host\") pod \"node-ca-5rjh2\" (UID: \"b2d54a40-d9b9-4483-aff6-1d4d4ce412a3\") " pod="openshift-image-registry/node-ca-5rjh2"
Jun 03 19:41:15.917188 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917148    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wdcc\" (UniqueName: \"kubernetes.io/projected/df083e33-c63d-4424-bfa4-80b1646dcce5-kube-api-access-6wdcc\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.917188 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917185    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-var-lib-kubelet\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-run-multus-certs\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917243    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-sysconfig\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-sysctl-d\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917262    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-var-lib-kubelet\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917297    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-cni-netd\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917349    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52b2344c-97b7-4445-86e4-4cc46b5683f5-tmp-dir\") pod \"node-resolver-j6mcb\" (UID: \"52b2344c-97b7-4445-86e4-4cc46b5683f5\") " pod="openshift-dns/node-resolver-j6mcb"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917373    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-sysconfig\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917402    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-run-multus-certs\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917352    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2642983-5f96-4da4-b20d-f7864ba449e7-ovnkube-script-lib\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917432    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/49704276-ef81-49a0-a090-d8dc1110e5c4-iptables-alerter-script\") pod \"iptables-alerter-6kffg\" (UID: \"49704276-ef81-49a0-a090-d8dc1110e5c4\") " pod="openshift-network-operator/iptables-alerter-6kffg"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-run-netns\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917467    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b2d54a40-d9b9-4483-aff6-1d4d4ce412a3-serviceca\") pod \"node-ca-5rjh2\" (UID: \"b2d54a40-d9b9-4483-aff6-1d4d4ce412a3\") " pod="openshift-image-registry/node-ca-5rjh2"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-sysctl-conf\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917497    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-host\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917488    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-cni-netd\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917513    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-sys-fs\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917517    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-run-netns\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.917529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917544    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-sys-fs\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917547    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-multus-socket-dir-parent\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917930    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b2d54a40-d9b9-4483-aff6-1d4d4ce412a3-serviceca\") pod \"node-ca-5rjh2\" (UID: \"b2d54a40-d9b9-4483-aff6-1d4d4ce412a3\") " pod="openshift-image-registry/node-ca-5rjh2"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917947    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-multus-socket-dir-parent\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917967    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-host\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917970    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a2642983-5f96-4da4-b20d-f7864ba449e7-ovnkube-script-lib\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917953    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-var-lib-cni-bin\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.917965    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-sysctl-d\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918015    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-var-lib-cni-bin\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e6d2055-8340-4249-985e-a172e9ca31b2-cnibin\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918087    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-sysctl-conf\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918105    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2e6d2055-8340-4249-985e-a172e9ca31b2-cnibin\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e6d2055-8340-4249-985e-a172e9ca31b2-os-release\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918163    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s82wk\" (UniqueName: \"kubernetes.io/projected/2e6d2055-8340-4249-985e-a172e9ca31b2-kube-api-access-s82wk\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-sys\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-var-lib-cni-multus\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918237    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2e6d2055-8340-4249-985e-a172e9ca31b2-os-release\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-multus-conf-dir\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.918356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918289    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e42f9663-7a96-4ef0-95f5-a62af5edbee4-multus-daemon-config\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.919192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918297    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-sys\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.919192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918319    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2zmn\" (UniqueName: \"kubernetes.io/projected/b2d54a40-d9b9-4483-aff6-1d4d4ce412a3-kube-api-access-d2zmn\") pod \"node-ca-5rjh2\" (UID: \"b2d54a40-d9b9-4483-aff6-1d4d4ce412a3\") " pod="openshift-image-registry/node-ca-5rjh2"
Jun 03 19:41:15.919192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918332    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-var-lib-cni-multus\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.919192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918289    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-multus-conf-dir\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.919192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e6d2055-8340-4249-985e-a172e9ca31b2-system-cni-dir\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.919192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918379    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e6d2055-8340-4249-985e-a172e9ca31b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.919192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e6d2055-8340-4249-985e-a172e9ca31b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.919192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918429    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-kubernetes\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.919192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918452    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-registration-dir\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.919192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918485    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-run-ovn\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.919192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret\") pod \"global-pull-secret-syncer-6b7zc\" (UID: \"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b\") " pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:15.919192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-etc-kubernetes\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.919192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abc93e0d-584f-4984-a573-a50352a3ee23-konnectivity-ca\") pod \"konnectivity-agent-rdmnt\" (UID: \"abc93e0d-584f-4984-a573-a50352a3ee23\") " pod="kube-system/konnectivity-agent-rdmnt"
Jun 03 19:41:15.919192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918574    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2e6d2055-8340-4249-985e-a172e9ca31b2-system-cni-dir\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.919192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918579    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-run-openvswitch\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.919192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918621    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-run-openvswitch\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.919192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918624    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2e6d2055-8340-4249-985e-a172e9ca31b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.919952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.919952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918655    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-run-ovn-kubernetes\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.919952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918673    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/49704276-ef81-49a0-a090-d8dc1110e5c4-iptables-alerter-script\") pod \"iptables-alerter-6kffg\" (UID: \"49704276-ef81-49a0-a090-d8dc1110e5c4\") " pod="openshift-network-operator/iptables-alerter-6kffg"
Jun 03 19:41:15.919952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918699    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2flc\" (UniqueName: \"kubernetes.io/projected/a2642983-5f96-4da4-b20d-f7864ba449e7-kube-api-access-p2flc\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.919952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918709    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-run-ovn\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.919952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918722    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-kubernetes\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.919952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-dbus\") pod \"global-pull-secret-syncer-6b7zc\" (UID: \"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b\") " pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:15.919952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918768    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-registration-dir\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.919952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918773    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-multus-cni-dir\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.919952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918799    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e42f9663-7a96-4ef0-95f5-a62af5edbee4-cni-binary-copy\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.919952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918823    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-modprobe-d\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.919952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918847    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6nfd\" (UniqueName: \"kubernetes.io/projected/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-kube-api-access-k6nfd\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.919952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918889    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.919952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918907    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e42f9663-7a96-4ef0-95f5-a62af5edbee4-multus-daemon-config\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.919952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918946    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-run-netns\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.919952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-node-log\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.919952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.918999    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2642983-5f96-4da4-b20d-f7864ba449e7-ovnkube-config\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.920808 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919036    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ns44\" (UniqueName: \"kubernetes.io/projected/52b2344c-97b7-4445-86e4-4cc46b5683f5-kube-api-access-9ns44\") pod \"node-resolver-j6mcb\" (UID: \"52b2344c-97b7-4445-86e4-4cc46b5683f5\") " pod="openshift-dns/node-resolver-j6mcb"
Jun 03 19:41:15.920808 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:15.919061    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 19:41:15.920808 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919099    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-hostroot\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.920808 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:15.919150    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret podName:4aa79bf3-8eb3-4175-8706-2ddf3cfba37b nodeName:}" failed. No retries permitted until 2026-06-03 19:41:16.419108953 +0000 UTC m=+3.009592343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret") pod "global-pull-secret-syncer-6b7zc" (UID: "4aa79bf3-8eb3-4175-8706-2ddf3cfba37b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 19:41:15.920808 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-hostroot\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.920808 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919177    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/abc93e0d-584f-4984-a573-a50352a3ee23-konnectivity-ca\") pod \"konnectivity-agent-rdmnt\" (UID: \"abc93e0d-584f-4984-a573-a50352a3ee23\") " pod="kube-system/konnectivity-agent-rdmnt"
Jun 03 19:41:15.920808 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919186    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-tuned\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.920808 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919208    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-modprobe-d\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.920808 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-etc-selinux\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.920808 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7khxn\" (UniqueName: \"kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn\") pod \"network-check-target-t5xl7\" (UID: \"7f60d191-10e3-4ecb-9471-f6c6bfc3db0d\") " pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:15.920808 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919269    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-systemd-units\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.920808 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919269    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-etc-kubernetes\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.920808 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.920808 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919304    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2e6d2055-8340-4249-985e-a172e9ca31b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.920808 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919321    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2642983-5f96-4da4-b20d-f7864ba449e7-ovn-node-metrics-cert\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.920808 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919349    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-run-k8s-cni-cncf-io\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.920808 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919358    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e42f9663-7a96-4ef0-95f5-a62af5edbee4-cni-binary-copy\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-tmp\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919366    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-dbus\") pod \"global-pull-secret-syncer-6b7zc\" (UID: \"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b\") " pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919408    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-multus-cni-dir\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919412    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-run-systemd\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919393    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-etc-selinux\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919448    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b6vz\" (UniqueName: \"kubernetes.io/projected/e42f9663-7a96-4ef0-95f5-a62af5edbee4-kube-api-access-4b6vz\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919452    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-run-systemd\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919461    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919466    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e6d2055-8340-4249-985e-a172e9ca31b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919513    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-kubelet\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919536    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52b2344c-97b7-4445-86e4-4cc46b5683f5-hosts-file\") pod \"node-resolver-j6mcb\" (UID: \"52b2344c-97b7-4445-86e4-4cc46b5683f5\") " pod="openshift-dns/node-resolver-j6mcb"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919559    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abc93e0d-584f-4984-a573-a50352a3ee23-agent-certs\") pod \"konnectivity-agent-rdmnt\" (UID: \"abc93e0d-584f-4984-a573-a50352a3ee23\") " pod="kube-system/konnectivity-agent-rdmnt"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919586    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e6d2055-8340-4249-985e-a172e9ca31b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-device-dir\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-slash\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919670    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919682    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-kubelet\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.921474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-log-socket\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.922012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919720    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-log-socket\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.922012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919761    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-kubelet-config\") pod \"global-pull-secret-syncer-6b7zc\" (UID: \"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b\") " pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:15.922012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919783    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-node-log\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.922012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919797    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-run-netns\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.922012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919828    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2e6d2055-8340-4249-985e-a172e9ca31b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.922012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920010    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.922012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920102    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-systemd-units\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.922012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920122    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-device-dir\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.922012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920318    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a2642983-5f96-4da4-b20d-f7864ba449e7-ovnkube-config\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.922012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.919720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-kubelet-config\") pod \"global-pull-secret-syncer-6b7zc\" (UID: \"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b\") " pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:15.922012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920388    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-systemd\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.922012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920396    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-slash\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.922012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920393    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2e6d2055-8340-4249-985e-a172e9ca31b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.922012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-lib-modules\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.922012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-var-lib-openvswitch\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.922012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-etc-openvswitch\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.922012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920477    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/52b2344c-97b7-4445-86e4-4cc46b5683f5-hosts-file\") pod \"node-resolver-j6mcb\" (UID: \"52b2344c-97b7-4445-86e4-4cc46b5683f5\") " pod="openshift-dns/node-resolver-j6mcb"
Jun 03 19:41:15.922699 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-run\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.922699 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-var-lib-kubelet\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.922699 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920549    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-cni-bin\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.922699 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920570    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-systemd\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.922699 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2642983-5f96-4da4-b20d-f7864ba449e7-env-overrides\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.922699 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920614    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-system-cni-dir\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.922699 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920681    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-cnibin\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.922699 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920705    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-os-release\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.922699 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920729    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs\") pod \"network-metrics-daemon-dhn5t\" (UID: \"6c557986-2994-4e1c-8425-9475d1281349\") " pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:15.922699 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-socket-dir\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.922699 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920969    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/df083e33-c63d-4424-bfa4-80b1646dcce5-socket-dir\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.923198 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.921160    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a2642983-5f96-4da4-b20d-f7864ba449e7-env-overrides\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.923198 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.922746    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-cnibin\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.923198 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.922929    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-os-release\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.923198 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.922953    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-system-cni-dir\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.923198 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920494    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e42f9663-7a96-4ef0-95f5-a62af5edbee4-host-run-k8s-cni-cncf-io\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.923366 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:15.923227    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:41:15.923366 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.923250    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-run\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.923366 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.923061    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-etc-openvswitch\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.923465 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:15.923393    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs podName:6c557986-2994-4e1c-8425-9475d1281349 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:16.42336562 +0000 UTC m=+3.013849008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs") pod "network-metrics-daemon-dhn5t" (UID: "6c557986-2994-4e1c-8425-9475d1281349") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:41:15.923506 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.923469    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-host-cni-bin\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.923506 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.923477    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-tmp\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.923585 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.923507    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a2642983-5f96-4da4-b20d-f7864ba449e7-ovn-node-metrics-cert\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.923585 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.923536    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-var-lib-kubelet\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.923585 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.920547    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a2642983-5f96-4da4-b20d-f7864ba449e7-var-lib-openvswitch\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:15.923770 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.923748    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-lib-modules\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.924050 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.924028    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-etc-tuned\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.929020 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.928989    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/abc93e0d-584f-4984-a573-a50352a3ee23-agent-certs\") pod \"konnectivity-agent-rdmnt\" (UID: \"abc93e0d-584f-4984-a573-a50352a3ee23\") " pod="kube-system/konnectivity-agent-rdmnt"
Jun 03 19:41:15.930046 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:15.929980    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 19:41:15.930152 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:15.930112    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 19:41:15.930152 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:15.930150    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7khxn for pod openshift-network-diagnostics/network-check-target-t5xl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:41:15.930271 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:15.930256    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn podName:7f60d191-10e3-4ecb-9471-f6c6bfc3db0d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:16.430233541 +0000 UTC m=+3.020716915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7khxn" (UniqueName: "kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn") pod "network-check-target-t5xl7" (UID: "7f60d191-10e3-4ecb-9471-f6c6bfc3db0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:41:15.930608 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.930567    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s82wk\" (UniqueName: \"kubernetes.io/projected/2e6d2055-8340-4249-985e-a172e9ca31b2-kube-api-access-s82wk\") pod \"multus-additional-cni-plugins-xv4qk\" (UID: \"2e6d2055-8340-4249-985e-a172e9ca31b2\") " pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:15.931101 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.931078    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g7jm\" (UniqueName: \"kubernetes.io/projected/6c557986-2994-4e1c-8425-9475d1281349-kube-api-access-4g7jm\") pod \"network-metrics-daemon-dhn5t\" (UID: \"6c557986-2994-4e1c-8425-9475d1281349\") " pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:15.932185 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.932163    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6nfd\" (UniqueName: \"kubernetes.io/projected/b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4-kube-api-access-k6nfd\") pod \"tuned-b4pm7\" (UID: \"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4\") " pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:15.933424 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.932940    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2zmn\" (UniqueName: \"kubernetes.io/projected/b2d54a40-d9b9-4483-aff6-1d4d4ce412a3-kube-api-access-d2zmn\") pod \"node-ca-5rjh2\" (UID: \"b2d54a40-d9b9-4483-aff6-1d4d4ce412a3\") " pod="openshift-image-registry/node-ca-5rjh2"
Jun 03 19:41:15.933424 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.933172    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b6vz\" (UniqueName: \"kubernetes.io/projected/e42f9663-7a96-4ef0-95f5-a62af5edbee4-kube-api-access-4b6vz\") pod \"multus-xhg77\" (UID: \"e42f9663-7a96-4ef0-95f5-a62af5edbee4\") " pod="openshift-multus/multus-xhg77"
Jun 03 19:41:15.933424 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.933247    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w4cg\" (UniqueName: \"kubernetes.io/projected/49704276-ef81-49a0-a090-d8dc1110e5c4-kube-api-access-9w4cg\") pod \"iptables-alerter-6kffg\" (UID: \"49704276-ef81-49a0-a090-d8dc1110e5c4\") " pod="openshift-network-operator/iptables-alerter-6kffg"
Jun 03 19:41:15.933593 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.933566    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ns44\" (UniqueName: \"kubernetes.io/projected/52b2344c-97b7-4445-86e4-4cc46b5683f5-kube-api-access-9ns44\") pod \"node-resolver-j6mcb\" (UID: \"52b2344c-97b7-4445-86e4-4cc46b5683f5\") " pod="openshift-dns/node-resolver-j6mcb"
Jun 03 19:41:15.933768 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.933747    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wdcc\" (UniqueName: \"kubernetes.io/projected/df083e33-c63d-4424-bfa4-80b1646dcce5-kube-api-access-6wdcc\") pod \"aws-ebs-csi-driver-node-bnpwh\" (UID: \"df083e33-c63d-4424-bfa4-80b1646dcce5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:15.934178 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:15.934160    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2flc\" (UniqueName: \"kubernetes.io/projected/a2642983-5f96-4da4-b20d-f7864ba449e7-kube-api-access-p2flc\") pod \"ovnkube-node-s7kdk\" (UID: \"a2642983-5f96-4da4-b20d-f7864ba449e7\") " pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:16.102231 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.102194    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b4pm7"
Jun 03 19:41:16.110963 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.110928    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6kffg"
Jun 03 19:41:16.119960 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.119936    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xhg77"
Jun 03 19:41:16.126752 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.126721    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh"
Jun 03 19:41:16.133665 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.133635    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:16.139411 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.139386    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rdmnt"
Jun 03 19:41:16.146313 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.146290    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j6mcb"
Jun 03 19:41:16.154969 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.154943    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5rjh2"
Jun 03 19:41:16.160699 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.160676    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xv4qk"
Jun 03 19:41:16.423632 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.423601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs\") pod \"network-metrics-daemon-dhn5t\" (UID: \"6c557986-2994-4e1c-8425-9475d1281349\") " pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:16.423815 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.423657    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret\") pod \"global-pull-secret-syncer-6b7zc\" (UID: \"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b\") " pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:16.423815 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:16.423713    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:41:16.423815 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:16.423775    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 19:41:16.423815 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:16.423790    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs podName:6c557986-2994-4e1c-8425-9475d1281349 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:17.42376878 +0000 UTC m=+4.014252155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs") pod "network-metrics-daemon-dhn5t" (UID: "6c557986-2994-4e1c-8425-9475d1281349") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:41:16.424040 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:16.423830    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret podName:4aa79bf3-8eb3-4175-8706-2ddf3cfba37b nodeName:}" failed. No retries permitted until 2026-06-03 19:41:17.423814376 +0000 UTC m=+4.014297748 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret") pod "global-pull-secret-syncer-6b7zc" (UID: "4aa79bf3-8eb3-4175-8706-2ddf3cfba37b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 19:41:16.524921 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.524886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7khxn\" (UniqueName: \"kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn\") pod \"network-check-target-t5xl7\" (UID: \"7f60d191-10e3-4ecb-9471-f6c6bfc3db0d\") " pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:16.525119 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:16.525049    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 19:41:16.525119 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:16.525072    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 19:41:16.525119 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:16.525082    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7khxn for pod openshift-network-diagnostics/network-check-target-t5xl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:41:16.525244 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:16.525141    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn podName:7f60d191-10e3-4ecb-9471-f6c6bfc3db0d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:17.525122893 +0000 UTC m=+4.115606267 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7khxn" (UniqueName: "kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn") pod "network-check-target-t5xl7" (UID: "7f60d191-10e3-4ecb-9471-f6c6bfc3db0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:41:16.662176 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:16.661942    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49704276_ef81_49a0_a090_d8dc1110e5c4.slice/crio-67bd13148fe0760b960f9f4fcf083390d6aa8e6eb798438b6061a76b1b9789d1 WatchSource:0}: Error finding container 67bd13148fe0760b960f9f4fcf083390d6aa8e6eb798438b6061a76b1b9789d1: Status 404 returned error can't find the container with id 67bd13148fe0760b960f9f4fcf083390d6aa8e6eb798438b6061a76b1b9789d1
Jun 03 19:41:16.662974 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:16.662947    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb60890f3_bdb4_4b5d_8fa8_31c15a80a6e4.slice/crio-97191d63425d46989e8361cac37919b3ea41cfe3d6a5dc002299417e3d02097a WatchSource:0}: Error finding container 97191d63425d46989e8361cac37919b3ea41cfe3d6a5dc002299417e3d02097a: Status 404 returned error can't find the container with id 97191d63425d46989e8361cac37919b3ea41cfe3d6a5dc002299417e3d02097a
Jun 03 19:41:16.664213 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:16.664187    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc93e0d_584f_4984_a573_a50352a3ee23.slice/crio-18ea7ffa9d6d88e41df2970d02183d1582fe6c51e2c0a010db600bcbb7ea2f73 WatchSource:0}: Error finding container 18ea7ffa9d6d88e41df2970d02183d1582fe6c51e2c0a010db600bcbb7ea2f73: Status 404 returned error can't find the container with id 18ea7ffa9d6d88e41df2970d02183d1582fe6c51e2c0a010db600bcbb7ea2f73
Jun 03 19:41:16.667451 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:16.667265    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d54a40_d9b9_4483_aff6_1d4d4ce412a3.slice/crio-d4635e4be2b3c0c43e5e6b364455c2811d1742e112182baf6a6fa4758f27f68c WatchSource:0}: Error finding container d4635e4be2b3c0c43e5e6b364455c2811d1742e112182baf6a6fa4758f27f68c: Status 404 returned error can't find the container with id d4635e4be2b3c0c43e5e6b364455c2811d1742e112182baf6a6fa4758f27f68c
Jun 03 19:41:16.669428 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:16.669358    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode42f9663_7a96_4ef0_95f5_a62af5edbee4.slice/crio-5c4693fdaf50103b8a49dc79b57a8128a72dc2595fda4345db41db1f5a9b83d4 WatchSource:0}: Error finding container 5c4693fdaf50103b8a49dc79b57a8128a72dc2595fda4345db41db1f5a9b83d4: Status 404 returned error can't find the container with id 5c4693fdaf50103b8a49dc79b57a8128a72dc2595fda4345db41db1f5a9b83d4
Jun 03 19:41:16.670320 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:16.670295    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6d2055_8340_4249_985e_a172e9ca31b2.slice/crio-500dc9a3b0016bc14a7a014ff906bcbff832367026303d3a30c2616ee7d5c359 WatchSource:0}: Error finding container 500dc9a3b0016bc14a7a014ff906bcbff832367026303d3a30c2616ee7d5c359: Status 404 returned error can't find the container with id 500dc9a3b0016bc14a7a014ff906bcbff832367026303d3a30c2616ee7d5c359
Jun 03 19:41:16.671178 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:16.671112    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf083e33_c63d_4424_bfa4_80b1646dcce5.slice/crio-e0d1071d29f1844eae5307e2bbee542e87e0f4147429ac3802764c2240f7f147 WatchSource:0}: Error finding container e0d1071d29f1844eae5307e2bbee542e87e0f4147429ac3802764c2240f7f147: Status 404 returned error can't find the container with id e0d1071d29f1844eae5307e2bbee542e87e0f4147429ac3802764c2240f7f147
Jun 03 19:41:16.676333 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:16.672856    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b2344c_97b7_4445_86e4_4cc46b5683f5.slice/crio-b950e94ba8def26197b91f0138152be9b3dc335bea447080e9826d77b57295d9 WatchSource:0}: Error finding container b950e94ba8def26197b91f0138152be9b3dc335bea447080e9826d77b57295d9: Status 404 returned error can't find the container with id b950e94ba8def26197b91f0138152be9b3dc335bea447080e9826d77b57295d9
Jun 03 19:41:16.676333 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:16.673541    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2642983_5f96_4da4_b20d_f7864ba449e7.slice/crio-1da9e8d3e04482c50f68a943eee4bfcc44317149d0b8f41a9a6189b64dbfb3a4 WatchSource:0}: Error finding container 1da9e8d3e04482c50f68a943eee4bfcc44317149d0b8f41a9a6189b64dbfb3a4: Status 404 returned error can't find the container with id 1da9e8d3e04482c50f68a943eee4bfcc44317149d0b8f41a9a6189b64dbfb3a4
Jun 03 19:41:16.858973 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.858927    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:36:15 +0000 UTC" deadline="2028-01-10 22:42:06.933442469 +0000 UTC"
Jun 03 19:41:16.858973 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.858969    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14067h0m50.074477838s"
Jun 03 19:41:16.875426 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.875391    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:16.875589 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:16.875557    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:16.883287 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.883249    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5rjh2" event={"ID":"b2d54a40-d9b9-4483-aff6-1d4d4ce412a3","Type":"ContainerStarted","Data":"d4635e4be2b3c0c43e5e6b364455c2811d1742e112182baf6a6fa4758f27f68c"}
Jun 03 19:41:16.884265 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.884234    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b4pm7" event={"ID":"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4","Type":"ContainerStarted","Data":"97191d63425d46989e8361cac37919b3ea41cfe3d6a5dc002299417e3d02097a"}
Jun 03 19:41:16.885969 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.885949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-187.ec2.internal" event={"ID":"3479ce4a7d1e982e2ed221c321b93971","Type":"ContainerStarted","Data":"68fa11c3cd0daff668fe0cf56c614d2600f3930234d95677228a1d378918a7be"}
Jun 03 19:41:16.887081 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.887052    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk" event={"ID":"a2642983-5f96-4da4-b20d-f7864ba449e7","Type":"ContainerStarted","Data":"1da9e8d3e04482c50f68a943eee4bfcc44317149d0b8f41a9a6189b64dbfb3a4"}
Jun 03 19:41:16.890913 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.890884    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh" event={"ID":"df083e33-c63d-4424-bfa4-80b1646dcce5","Type":"ContainerStarted","Data":"e0d1071d29f1844eae5307e2bbee542e87e0f4147429ac3802764c2240f7f147"}
Jun 03 19:41:16.892005 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.891978    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xv4qk" event={"ID":"2e6d2055-8340-4249-985e-a172e9ca31b2","Type":"ContainerStarted","Data":"500dc9a3b0016bc14a7a014ff906bcbff832367026303d3a30c2616ee7d5c359"}
Jun 03 19:41:16.893156 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.893130    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rdmnt" event={"ID":"abc93e0d-584f-4984-a573-a50352a3ee23","Type":"ContainerStarted","Data":"18ea7ffa9d6d88e41df2970d02183d1582fe6c51e2c0a010db600bcbb7ea2f73"}
Jun 03 19:41:16.894151 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.894132    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6kffg" event={"ID":"49704276-ef81-49a0-a090-d8dc1110e5c4","Type":"ContainerStarted","Data":"67bd13148fe0760b960f9f4fcf083390d6aa8e6eb798438b6061a76b1b9789d1"}
Jun 03 19:41:16.895189 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.895166    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j6mcb" event={"ID":"52b2344c-97b7-4445-86e4-4cc46b5683f5","Type":"ContainerStarted","Data":"b950e94ba8def26197b91f0138152be9b3dc335bea447080e9826d77b57295d9"}
Jun 03 19:41:16.896148 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.896128    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xhg77" event={"ID":"e42f9663-7a96-4ef0-95f5-a62af5edbee4","Type":"ContainerStarted","Data":"5c4693fdaf50103b8a49dc79b57a8128a72dc2595fda4345db41db1f5a9b83d4"}
Jun 03 19:41:16.904263 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:16.904212    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-187.ec2.internal" podStartSLOduration=1.904198482 podStartE2EDuration="1.904198482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:41:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:16.904110438 +0000 UTC m=+3.494593852" watchObservedRunningTime="2026-06-03 19:41:16.904198482 +0000 UTC m=+3.494681874"
Jun 03 19:41:17.432068 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:17.432026    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret\") pod \"global-pull-secret-syncer-6b7zc\" (UID: \"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b\") " pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:17.432302 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:17.432115    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs\") pod \"network-metrics-daemon-dhn5t\" (UID: \"6c557986-2994-4e1c-8425-9475d1281349\") " pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:17.432302 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:17.432245    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:41:17.432429 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:17.432312    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs podName:6c557986-2994-4e1c-8425-9475d1281349 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:19.432290941 +0000 UTC m=+6.022774313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs") pod "network-metrics-daemon-dhn5t" (UID: "6c557986-2994-4e1c-8425-9475d1281349") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:41:17.432761 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:17.432740    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 19:41:17.432842 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:17.432801    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret podName:4aa79bf3-8eb3-4175-8706-2ddf3cfba37b nodeName:}" failed. No retries permitted until 2026-06-03 19:41:19.432784657 +0000 UTC m=+6.023268035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret") pod "global-pull-secret-syncer-6b7zc" (UID: "4aa79bf3-8eb3-4175-8706-2ddf3cfba37b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 19:41:17.533062 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:17.533022    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7khxn\" (UniqueName: \"kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn\") pod \"network-check-target-t5xl7\" (UID: \"7f60d191-10e3-4ecb-9471-f6c6bfc3db0d\") " pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:17.533263 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:17.533246    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 19:41:17.533326 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:17.533273    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 19:41:17.533326 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:17.533286    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7khxn for pod openshift-network-diagnostics/network-check-target-t5xl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:41:17.533438 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:17.533346    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn podName:7f60d191-10e3-4ecb-9471-f6c6bfc3db0d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:19.533327404 +0000 UTC m=+6.123810786 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7khxn" (UniqueName: "kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn") pod "network-check-target-t5xl7" (UID: "7f60d191-10e3-4ecb-9471-f6c6bfc3db0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:41:17.860222 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:17.860123    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 19:36:15 +0000 UTC" deadline="2027-11-11 07:21:00.490842777 +0000 UTC"
Jun 03 19:41:17.860222 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:17.860186    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12611h39m42.630660932s"
Jun 03 19:41:17.878587 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:17.877819    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:17.878587 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:17.878018    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:17.878587 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:17.878422    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:17.878587 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:17.878528    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:17.918171 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:17.918130    2563 generic.go:356] "Generic (PLEG): container finished" podID="2f3d6d9321d2c6ee9b8c22740256d30e" containerID="4b69a0e1e14367659fc2d6d6db7d9c5a926912e9cb9abd512ef843b2d14c2104" exitCode=0
Jun 03 19:41:17.918339 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:17.918215    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal" event={"ID":"2f3d6d9321d2c6ee9b8c22740256d30e","Type":"ContainerDied","Data":"4b69a0e1e14367659fc2d6d6db7d9c5a926912e9cb9abd512ef843b2d14c2104"}
Jun 03 19:41:18.875351 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:18.875126    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:18.875351 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:18.875282    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:18.929491 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:18.929451    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal" event={"ID":"2f3d6d9321d2c6ee9b8c22740256d30e","Type":"ContainerStarted","Data":"ec2ff0b73cc3221137a49e725e76730965834159a55b6e4eeedf0d83d2828e9a"}
Jun 03 19:41:18.947145 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:18.947068    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-187.ec2.internal" podStartSLOduration=3.947046521 podStartE2EDuration="3.947046521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:41:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:18.94621166 +0000 UTC m=+5.536695053" watchObservedRunningTime="2026-06-03 19:41:18.947046521 +0000 UTC m=+5.537529915"
Jun 03 19:41:19.450957 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:19.450916    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs\") pod \"network-metrics-daemon-dhn5t\" (UID: \"6c557986-2994-4e1c-8425-9475d1281349\") " pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:19.451156 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:19.451000    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret\") pod \"global-pull-secret-syncer-6b7zc\" (UID: \"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b\") " pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:19.451225 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:19.451175    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 19:41:19.451284 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:19.451241    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret podName:4aa79bf3-8eb3-4175-8706-2ddf3cfba37b nodeName:}" failed. No retries permitted until 2026-06-03 19:41:23.451222949 +0000 UTC m=+10.041706322 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret") pod "global-pull-secret-syncer-6b7zc" (UID: "4aa79bf3-8eb3-4175-8706-2ddf3cfba37b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 19:41:19.451661 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:19.451639    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:41:19.451751 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:19.451698    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs podName:6c557986-2994-4e1c-8425-9475d1281349 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:23.45168236 +0000 UTC m=+10.042165736 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs") pod "network-metrics-daemon-dhn5t" (UID: "6c557986-2994-4e1c-8425-9475d1281349") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:41:19.552536 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:19.551795    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7khxn\" (UniqueName: \"kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn\") pod \"network-check-target-t5xl7\" (UID: \"7f60d191-10e3-4ecb-9471-f6c6bfc3db0d\") " pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:19.552536 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:19.552027    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 19:41:19.552536 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:19.552050    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 19:41:19.552536 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:19.552064    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7khxn for pod openshift-network-diagnostics/network-check-target-t5xl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:41:19.552536 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:19.552124    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn podName:7f60d191-10e3-4ecb-9471-f6c6bfc3db0d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:23.552105188 +0000 UTC m=+10.142588563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7khxn" (UniqueName: "kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn") pod "network-check-target-t5xl7" (UID: "7f60d191-10e3-4ecb-9471-f6c6bfc3db0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:41:19.877027 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:19.876988    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:19.877502 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:19.877127    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:19.877587 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:19.877571    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:19.877721 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:19.877696    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:20.876532 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:20.876054    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:20.876532 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:20.876188    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:21.877104 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:21.877035    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:21.877104 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:21.877060    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:21.877530 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:21.877176    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:21.877530 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:21.877297    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:22.875023 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:22.874989    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:22.875202 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:22.875116    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:23.485263 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:23.485227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs\") pod \"network-metrics-daemon-dhn5t\" (UID: \"6c557986-2994-4e1c-8425-9475d1281349\") " pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:23.485727 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:23.485304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret\") pod \"global-pull-secret-syncer-6b7zc\" (UID: \"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b\") " pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:23.485727 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:23.485417    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:41:23.485727 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:23.485500    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs podName:6c557986-2994-4e1c-8425-9475d1281349 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:31.485476663 +0000 UTC m=+18.075960055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs") pod "network-metrics-daemon-dhn5t" (UID: "6c557986-2994-4e1c-8425-9475d1281349") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:41:23.486003 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:23.485425    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 19:41:23.486003 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:23.485915    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret podName:4aa79bf3-8eb3-4175-8706-2ddf3cfba37b nodeName:}" failed. No retries permitted until 2026-06-03 19:41:31.485896339 +0000 UTC m=+18.076379713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret") pod "global-pull-secret-syncer-6b7zc" (UID: "4aa79bf3-8eb3-4175-8706-2ddf3cfba37b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 19:41:23.586243 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:23.586201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7khxn\" (UniqueName: \"kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn\") pod \"network-check-target-t5xl7\" (UID: \"7f60d191-10e3-4ecb-9471-f6c6bfc3db0d\") " pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:23.586422 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:23.586398    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 19:41:23.586498 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:23.586434    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 19:41:23.586498 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:23.586449    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7khxn for pod openshift-network-diagnostics/network-check-target-t5xl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:41:23.586596 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:23.586521    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn podName:7f60d191-10e3-4ecb-9471-f6c6bfc3db0d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:31.58650036 +0000 UTC m=+18.176983730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7khxn" (UniqueName: "kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn") pod "network-check-target-t5xl7" (UID: "7f60d191-10e3-4ecb-9471-f6c6bfc3db0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:41:23.877164 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:23.877131    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:23.877339 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:23.877256    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:23.877339 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:23.877295    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:23.877497 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:23.877472    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:24.876085 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:24.875634    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:24.876085 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:24.875764    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:25.875401 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:25.875361    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:25.875401 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:25.875397    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:25.875641 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:25.875491    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:25.875707 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:25.875636    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:26.875789 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:26.875749    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:26.876258 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:26.875888    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:27.876001 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:27.875962    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:27.876536 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:27.876105    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:27.876536 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:27.876158    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:27.876536 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:27.876268    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:28.875415 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:28.875379    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:28.875611 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:28.875570    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:29.875505 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:29.875466    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:29.876017 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:29.875478    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:29.876017 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:29.875615    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:29.876017 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:29.875695    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:30.875302 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:30.875267    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:30.875539 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:30.875409    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:31.547527 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:31.547475    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret\") pod \"global-pull-secret-syncer-6b7zc\" (UID: \"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b\") " pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:31.547726 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:31.547579    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs\") pod \"network-metrics-daemon-dhn5t\" (UID: \"6c557986-2994-4e1c-8425-9475d1281349\") " pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:31.547726 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:31.547650    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 19:41:31.547726 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:31.547700    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:41:31.547857 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:31.547732    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret podName:4aa79bf3-8eb3-4175-8706-2ddf3cfba37b nodeName:}" failed. No retries permitted until 2026-06-03 19:41:47.547712306 +0000 UTC m=+34.138195677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret") pod "global-pull-secret-syncer-6b7zc" (UID: "4aa79bf3-8eb3-4175-8706-2ddf3cfba37b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 19:41:31.547857 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:31.547752    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs podName:6c557986-2994-4e1c-8425-9475d1281349 nodeName:}" failed. No retries permitted until 2026-06-03 19:41:47.547738945 +0000 UTC m=+34.138222316 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs") pod "network-metrics-daemon-dhn5t" (UID: "6c557986-2994-4e1c-8425-9475d1281349") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:41:31.647987 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:31.647951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7khxn\" (UniqueName: \"kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn\") pod \"network-check-target-t5xl7\" (UID: \"7f60d191-10e3-4ecb-9471-f6c6bfc3db0d\") " pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:31.648166 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:31.648142    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 19:41:31.648222 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:31.648171    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 19:41:31.648222 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:31.648186    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7khxn for pod openshift-network-diagnostics/network-check-target-t5xl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:41:31.648321 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:31.648256    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn podName:7f60d191-10e3-4ecb-9471-f6c6bfc3db0d nodeName:}" failed. No retries permitted until 2026-06-03 19:41:47.648236239 +0000 UTC m=+34.238719636 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7khxn" (UniqueName: "kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn") pod "network-check-target-t5xl7" (UID: "7f60d191-10e3-4ecb-9471-f6c6bfc3db0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:41:31.875503 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:31.875413    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:31.875503 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:31.875443    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:31.876052 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:31.875543    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:31.876052 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:31.875653    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:32.875016 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:32.874970    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:32.875214 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:32.875121    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:33.876588 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:33.876536    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:33.877019 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:33.876619    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:33.877019 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:33.876637    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:33.877019 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:33.876730    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:34.875479 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:34.875439    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:34.875668 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:34.875578    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:35.876017 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.875715    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:35.876913 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:35.876137    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:35.876913 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.876650    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:35.876913 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:35.876738    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:35.965948 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.965913    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j6mcb" event={"ID":"52b2344c-97b7-4445-86e4-4cc46b5683f5","Type":"ContainerStarted","Data":"1ba00e0f58266a56ba9d80cadf3e1c746b96e9fcc70c649de1e01a025b953351"}
Jun 03 19:41:35.967369 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.967335    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xhg77" event={"ID":"e42f9663-7a96-4ef0-95f5-a62af5edbee4","Type":"ContainerStarted","Data":"1b770931c716e1aba572e5670ee7df150fb38942aab2c6db0fca090c53d58a04"}
Jun 03 19:41:35.968825 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.968801    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5rjh2" event={"ID":"b2d54a40-d9b9-4483-aff6-1d4d4ce412a3","Type":"ContainerStarted","Data":"be7c8b9f7613089deb9012acdb48c2c489e2f1fd42504246d17751a89a78f322"}
Jun 03 19:41:35.970295 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.970264    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b4pm7" event={"ID":"b60890f3-bdb4-4b5d-8fa8-31c15a80a6e4","Type":"ContainerStarted","Data":"e053b60d38e3985e5a63b0f0dd305186129fa2e06a0f16c9b6799cbbcf23336b"}
Jun 03 19:41:35.972631 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.972614    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 19:41:35.972967 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.972948    2563 generic.go:356] "Generic (PLEG): container finished" podID="a2642983-5f96-4da4-b20d-f7864ba449e7" containerID="a31445291d2336b6e50c1f5923b70fb189422665226c605e977bfaf72e22802e" exitCode=1
Jun 03 19:41:35.973034 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.973019    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk" event={"ID":"a2642983-5f96-4da4-b20d-f7864ba449e7","Type":"ContainerStarted","Data":"94ce0016521865f36f3623b47be424e127e874a2857794929fe61d70959d0389"}
Jun 03 19:41:35.973090 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.973074    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk" event={"ID":"a2642983-5f96-4da4-b20d-f7864ba449e7","Type":"ContainerStarted","Data":"7f64ce391d916b14885f984f4523798b155cfec24993c9b3382d992b4d26edee"}
Jun 03 19:41:35.973139 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.973112    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk" event={"ID":"a2642983-5f96-4da4-b20d-f7864ba449e7","Type":"ContainerStarted","Data":"1c12713630096154644c89fe72dd9516c20c0a0a8a31c775ef8201914682ec91"}
Jun 03 19:41:35.973183 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.973141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk" event={"ID":"a2642983-5f96-4da4-b20d-f7864ba449e7","Type":"ContainerDied","Data":"a31445291d2336b6e50c1f5923b70fb189422665226c605e977bfaf72e22802e"}
Jun 03 19:41:35.973183 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.973182    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk" event={"ID":"a2642983-5f96-4da4-b20d-f7864ba449e7","Type":"ContainerStarted","Data":"c5738597b0b14146d57ff48a518737683316e458b7e9806532b0877296baed39"}
Jun 03 19:41:35.975570 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.975540    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh" event={"ID":"df083e33-c63d-4424-bfa4-80b1646dcce5","Type":"ContainerStarted","Data":"e45e317b1b70e200e606ba2f199a10fa88cf84205cdf47ef9d5bb15a6a757e27"}
Jun 03 19:41:35.977397 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.977372    2563 generic.go:356] "Generic (PLEG): container finished" podID="2e6d2055-8340-4249-985e-a172e9ca31b2" containerID="65c89edc3e25d8c32a503d4c0c454693702862140b089e6980e7f8c4f9dc678d" exitCode=0
Jun 03 19:41:35.977511 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.977443    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xv4qk" event={"ID":"2e6d2055-8340-4249-985e-a172e9ca31b2","Type":"ContainerDied","Data":"65c89edc3e25d8c32a503d4c0c454693702862140b089e6980e7f8c4f9dc678d"}
Jun 03 19:41:35.978929 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.978911    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rdmnt" event={"ID":"abc93e0d-584f-4984-a573-a50352a3ee23","Type":"ContainerStarted","Data":"80ff2c02a028a230ba843cf84805c1c45b47e1aeab22e68d42212e970a3b8697"}
Jun 03 19:41:35.982848 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:35.982805    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j6mcb" podStartSLOduration=3.549862126 podStartE2EDuration="21.982793162s" totalImagesPullingTime="18.432931036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:35.982611797 +0000 UTC m=+22.573095189" watchObservedRunningTime="2026-06-03 19:41:35.982793162 +0000 UTC m=+22.573276554"
Jun 03 19:41:36.002770 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.002714    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b4pm7" podStartSLOduration=4.562018488 podStartE2EDuration="23.002697932s" totalImagesPullingTime="18.440679444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:41:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:36.002153648 +0000 UTC m=+22.592637040" watchObservedRunningTime="2026-06-03 19:41:36.002697932 +0000 UTC m=+22.593181324"
Jun 03 19:41:36.018563 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.018516    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rdmnt" podStartSLOduration=3.578857249 podStartE2EDuration="22.018498521s" totalImagesPullingTime="18.439641272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:36.018086845 +0000 UTC m=+22.608570248" watchObservedRunningTime="2026-06-03 19:41:36.018498521 +0000 UTC m=+22.608981913"
Jun 03 19:41:36.064559 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.064499    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5rjh2" podStartSLOduration=3.62798637 podStartE2EDuration="22.064482603s" totalImagesPullingTime="18.436496233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:36.043447406 +0000 UTC m=+22.633930799" watchObservedRunningTime="2026-06-03 19:41:36.064482603 +0000 UTC m=+22.654966064"
Jun 03 19:41:36.081348 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.081299    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xhg77" podStartSLOduration=3.604333831 podStartE2EDuration="22.081282941s" totalImagesPullingTime="18.47694911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:36.080969427 +0000 UTC m=+22.671452820" watchObservedRunningTime="2026-06-03 19:41:36.081282941 +0000 UTC m=+22.671766332"
Jun 03 19:41:36.413024 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.412983    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:36.566911 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.566570    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:36.645461 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.644723    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 03 19:41:36.669127 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.669092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:36.775451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.775417    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:36.870575 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.870485    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:36.875484 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.875459    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:36.875641 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:36.875621    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:36.883400 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.883296    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T19:41:36.644744371Z","UUID":"664de4bd-9298-4617-b78c-29b49ad9789e","Handler":null,"Name":"","Endpoint":""}
Jun 03 19:41:36.885062 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.885028    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 03 19:41:36.885205 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.885084    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 03 19:41:36.968648 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.968613    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:36.983581 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.983537    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh" event={"ID":"df083e33-c63d-4424-bfa4-80b1646dcce5","Type":"ContainerStarted","Data":"37c6a86f080d2050b8821835fbd31496d6579fae97563732c84f02d53f10e318"}
Jun 03 19:41:36.985418 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.985351    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6kffg" event={"ID":"49704276-ef81-49a0-a090-d8dc1110e5c4","Type":"ContainerStarted","Data":"51eccea1a890ac8812aad0db6b8d1856cc89566df78527f443857024a7742f73"}
Jun 03 19:41:36.988603 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.988575    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 19:41:36.989071 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:36.988989    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk" event={"ID":"a2642983-5f96-4da4-b20d-f7864ba449e7","Type":"ContainerStarted","Data":"11d1803045dc461543f5b12c19042c1ceb00529eeb514e8cda3708bc528cb1c7"}
Jun 03 19:41:37.070528 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:37.070484    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:37.620280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:37.620232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:37.875700 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:37.875598    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:37.875852 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:37.875755    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:37.875852 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:37.875807    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:37.875970 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:37.875954    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:37.994505 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:37.994465    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh" event={"ID":"df083e33-c63d-4424-bfa4-80b1646dcce5","Type":"ContainerStarted","Data":"cd5cbbc9cbb1382183033e9d3fc49b1ad1b84e85f59899810eafa334a95abecf"}
Jun 03 19:41:38.017301 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:38.017248    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bnpwh" podStartSLOduration=3.34630555 podStartE2EDuration="24.017231162s" totalImagesPullingTime="20.670925612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:41:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:38.016751951 +0000 UTC m=+24.607235344" watchObservedRunningTime="2026-06-03 19:41:38.017231162 +0000 UTC m=+24.607714553"
Jun 03 19:41:38.017609 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:38.017578    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6kffg" podStartSLOduration=5.5756246019999995 podStartE2EDuration="24.017569946s" totalImagesPullingTime="18.441945344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:37.003037331 +0000 UTC m=+23.593520723" watchObservedRunningTime="2026-06-03 19:41:38.017569946 +0000 UTC m=+24.608053416"
Jun 03 19:41:38.324016 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:38.323974    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:38.460504 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:38.460369    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:38.589732 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:38.589656    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:38.690231 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:38.690194    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:38.875798 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:38.875718    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:38.875984 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:38.875827    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:39.005645 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:39.005617    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 19:41:39.006262 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:39.006232    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk" event={"ID":"a2642983-5f96-4da4-b20d-f7864ba449e7","Type":"ContainerStarted","Data":"f52597b1b8bffcf344d26baf9d4a387f3562122c757ef60d123d4f0cb94a2073"}
Jun 03 19:41:39.014417 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:39.014373    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:39.238633 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:39.238552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:39.619199 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:39.619155    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:39.875128 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:39.875046    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:39.875288 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:39.875164    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:39.875288 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:39.875217    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:39.875391 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:39.875330    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:40.263543 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:40.263508    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rdmnt"
Jun 03 19:41:40.264175 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:40.264117    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rdmnt"
Jun 03 19:41:40.421139 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:40.421049    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:40.813383 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:40.813156    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:40.875582 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:40.875547    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:40.875728 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:40.875664    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:41.013854 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:41.013827    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 19:41:41.014284 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:41.014259    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk" event={"ID":"a2642983-5f96-4da4-b20d-f7864ba449e7","Type":"ContainerStarted","Data":"877c3d50d5266b71844ef6b89c50a6fe71aa9cf906e8cc9ee7522ac2aba0f9e7"}
Jun 03 19:41:41.014610 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:41.014592    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:41.014704 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:41.014686    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:41.014758 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:41.014735    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:41.014814 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:41.014788    2563 scope.go:117] "RemoveContainer" containerID="a31445291d2336b6e50c1f5923b70fb189422665226c605e977bfaf72e22802e"
Jun 03 19:41:41.015934 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:41.015915    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:41.017030 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:41.017003    2563 generic.go:356] "Generic (PLEG): container finished" podID="2e6d2055-8340-4249-985e-a172e9ca31b2" containerID="c5c8876da2abeb4a28948bf3d5c2187301d9046506a07f9356973404d3d6ac05" exitCode=0
Jun 03 19:41:41.017113 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:41.017077    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xv4qk" event={"ID":"2e6d2055-8340-4249-985e-a172e9ca31b2","Type":"ContainerDied","Data":"c5c8876da2abeb4a28948bf3d5c2187301d9046506a07f9356973404d3d6ac05"}
Jun 03 19:41:41.035002 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:41.034973    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:41.036065 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:41.036045    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:41:41.213721 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:41.213681    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:41.444919 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:41.444806    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:41.876037 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:41.876000    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:41.876269 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:41.876004    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:41.876269 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:41.876127    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:41.876269 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:41.876229    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:42.022708 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:42.022681    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 19:41:42.023075 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:42.023053    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk" event={"ID":"a2642983-5f96-4da4-b20d-f7864ba449e7","Type":"ContainerStarted","Data":"2edc2ba585a9ba50e0a3d6670eb7631358840bb7c06251f846aa4cee4b472ed4"}
Jun 03 19:41:42.052806 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:42.052748    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk" podStartSLOduration=9.302744521 podStartE2EDuration="28.052733257s" totalImagesPullingTime="18.749988736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:42.051264077 +0000 UTC m=+28.641747468" watchObservedRunningTime="2026-06-03 19:41:42.052733257 +0000 UTC m=+28.643216648"
Jun 03 19:41:42.213135 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:42.213058    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:42.414160 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:42.414127    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:42.617912 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:42.617883    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:42.875833 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:42.875746    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:42.876006 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:42.875856    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:42.920110 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:42.920074    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rdmnt"
Jun 03 19:41:42.920279 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:42.920230    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 03 19:41:42.920662 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:42.920640    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rdmnt"
Jun 03 19:41:43.027546 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:43.027515    2563 generic.go:356] "Generic (PLEG): container finished" podID="2e6d2055-8340-4249-985e-a172e9ca31b2" containerID="4bde49c5862e87c9770916a0f9bc5260dd75684a0c457e2e640157710fd9c386" exitCode=0
Jun 03 19:41:43.027722 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:43.027605    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xv4qk" event={"ID":"2e6d2055-8340-4249-985e-a172e9ca31b2","Type":"ContainerDied","Data":"4bde49c5862e87c9770916a0f9bc5260dd75684a0c457e2e640157710fd9c386"}
Jun 03 19:41:43.598416 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:43.598381    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:43.676195 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:43.676164    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:43.875968 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:43.875862    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:43.876131 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:43.875993    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:43.876131 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:43.875987    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:43.876237 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:43.876096    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:44.875419 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:44.875223    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:44.875799 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:44.875500    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:45.034076 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:45.034036    2563 generic.go:356] "Generic (PLEG): container finished" podID="2e6d2055-8340-4249-985e-a172e9ca31b2" containerID="fcd8c7d24fb90b9e008f9cfbdecc92f603767c0f1b3d64d009f279b7ed7a4c0d" exitCode=0
Jun 03 19:41:45.034237 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:45.034123    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xv4qk" event={"ID":"2e6d2055-8340-4249-985e-a172e9ca31b2","Type":"ContainerDied","Data":"fcd8c7d24fb90b9e008f9cfbdecc92f603767c0f1b3d64d009f279b7ed7a4c0d"}
Jun 03 19:41:45.875379 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:45.875344    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:45.875580 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:45.875485    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:45.875580 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:45.875541    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:45.876021 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:45.875658    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:46.875096 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:46.875055    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:46.875315 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:46.875173    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:47.574748 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:47.574703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs\") pod \"network-metrics-daemon-dhn5t\" (UID: \"6c557986-2994-4e1c-8425-9475d1281349\") " pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:47.575141 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:47.574763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret\") pod \"global-pull-secret-syncer-6b7zc\" (UID: \"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b\") " pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:47.575141 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:47.574864    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:41:47.575141 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:47.574888    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 03 19:41:47.575141 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:47.574949    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret podName:4aa79bf3-8eb3-4175-8706-2ddf3cfba37b nodeName:}" failed. No retries permitted until 2026-06-03 19:42:19.574934048 +0000 UTC m=+66.165417421 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret") pod "global-pull-secret-syncer-6b7zc" (UID: "4aa79bf3-8eb3-4175-8706-2ddf3cfba37b") : object "kube-system"/"original-pull-secret" not registered
Jun 03 19:41:47.575141 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:47.574965    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs podName:6c557986-2994-4e1c-8425-9475d1281349 nodeName:}" failed. No retries permitted until 2026-06-03 19:42:19.574958098 +0000 UTC m=+66.165441467 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs") pod "network-metrics-daemon-dhn5t" (UID: "6c557986-2994-4e1c-8425-9475d1281349") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 19:41:47.676054 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:47.676015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7khxn\" (UniqueName: \"kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn\") pod \"network-check-target-t5xl7\" (UID: \"7f60d191-10e3-4ecb-9471-f6c6bfc3db0d\") " pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:47.676240 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:47.676202    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 19:41:47.676240 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:47.676229    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 19:41:47.676362 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:47.676246    2563 projected.go:196] Error preparing data for projected volume kube-api-access-7khxn for pod openshift-network-diagnostics/network-check-target-t5xl7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:41:47.676362 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:47.676317    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn podName:7f60d191-10e3-4ecb-9471-f6c6bfc3db0d nodeName:}" failed. No retries permitted until 2026-06-03 19:42:19.676295389 +0000 UTC m=+66.266778763 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7khxn" (UniqueName: "kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn") pod "network-check-target-t5xl7" (UID: "7f60d191-10e3-4ecb-9471-f6c6bfc3db0d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 19:41:47.879430 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:47.879344    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:47.879430 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:47.879367    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:47.879635 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:47.879502    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:47.879635 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:47.879607    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:48.875756 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:48.875724    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:48.876233 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:48.875853    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:49.875351 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:49.875312    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:49.875521 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:49.875424    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:49.875521 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:49.875477    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:49.875600 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:49.875570    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:50.049589 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:50.049543    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xv4qk" event={"ID":"2e6d2055-8340-4249-985e-a172e9ca31b2","Type":"ContainerStarted","Data":"04975c1a8653e6dc3d249fc7f6ac011339a41b6f1afac5476fb670fa55f68a54"}
Jun 03 19:41:50.875015 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:50.874982    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:50.875196 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:50.875092    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:51.054702 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:51.054670    2563 generic.go:356] "Generic (PLEG): container finished" podID="2e6d2055-8340-4249-985e-a172e9ca31b2" containerID="04975c1a8653e6dc3d249fc7f6ac011339a41b6f1afac5476fb670fa55f68a54" exitCode=0
Jun 03 19:41:51.055066 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:51.054716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xv4qk" event={"ID":"2e6d2055-8340-4249-985e-a172e9ca31b2","Type":"ContainerDied","Data":"04975c1a8653e6dc3d249fc7f6ac011339a41b6f1afac5476fb670fa55f68a54"}
Jun 03 19:41:51.875640 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:51.875602    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:51.875829 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:51.875716    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:51.875829 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:51.875790    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:51.875925 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:51.875894    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:52.060434 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:52.060393    2563 generic.go:356] "Generic (PLEG): container finished" podID="2e6d2055-8340-4249-985e-a172e9ca31b2" containerID="2aaacb94ee819e123abf92ec911cdc0b99c63e9ed7433569021811d14bd310b0" exitCode=0
Jun 03 19:41:52.060848 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:52.060440    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xv4qk" event={"ID":"2e6d2055-8340-4249-985e-a172e9ca31b2","Type":"ContainerDied","Data":"2aaacb94ee819e123abf92ec911cdc0b99c63e9ed7433569021811d14bd310b0"}
Jun 03 19:41:52.875611 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:52.875557    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:52.875801 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:52.875691    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:53.066572 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:53.066534    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xv4qk" event={"ID":"2e6d2055-8340-4249-985e-a172e9ca31b2","Type":"ContainerStarted","Data":"9712efbe1437ef0944bdd1932544dce53529e386613827ea2ccf4acd7ea968fe"}
Jun 03 19:41:53.114488 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:53.114427    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xv4qk" podStartSLOduration=9.078559478 podStartE2EDuration="39.114411768s" totalImagesPullingTime="30.03585229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:41:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:41:53.114174248 +0000 UTC m=+39.704657649" watchObservedRunningTime="2026-06-03 19:41:53.114411768 +0000 UTC m=+39.704895160"
Jun 03 19:41:53.121915 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:53.121880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:53.233812 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:53.233715    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:53.432768 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:53.432726    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:53.529892 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:53.529807    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:53.631511 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:53.631477    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:53.878719 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:53.878630    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:53.878909 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:53.878743    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:53.878909 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:53.878795    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:53.879037 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:53.878916    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:53.941344 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:53.941301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:54.051154 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:54.051124    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:54.182860 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:54.182773    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:54.309112 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:54.309074    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:54.410453 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:54.410417    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:54.508593 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:54.508562    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:54.582317 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:54.582284    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:54.664159 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:54.664128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:54.875451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:54.875424    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:54.875643 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:54.875568    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:54.882168 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:54.882141    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:55.062266 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:55.061979    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dhn5t"]
Jun 03 19:41:55.063050 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:55.062647    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6b7zc"]
Jun 03 19:41:55.063050 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:55.062774    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:55.063050 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:55.062910    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:55.063303 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:55.063285    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t5xl7"]
Jun 03 19:41:55.063380 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:55.063368    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:55.063467 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:55.063447    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:55.067258 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:55.067225    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:55.071899 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:55.071859    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:55.072037 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:55.071989    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:55.169441 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:55.169347    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:55.272426 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:55.272394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:55.340432 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:55.340387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:55.538974 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:55.538936    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:55.631845 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:55.631748    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:55.696168 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:55.696133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:56.123994 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:56.123964    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:56.190309 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:56.190276    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:56.440567 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:56.440490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:56.542253 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:56.542226    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:56.646240 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:56.646209    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:56.746283 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:56.746189    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:56.846467 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:56.846439    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:56.875412 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:56.875381    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:56.875575 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:56.875444    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:56.875575 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:56.875455    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:56.875575 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:56.875529    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:56.875678 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:56.875625    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:56.875711 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:56.875685    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:56.946787 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:56.946757    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:58.354110 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:58.354084    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:58.416708 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:58.416676    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:58.593613 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:58.593580    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:58.669160 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:58.669081    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:58.734457 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:58.734423    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:58.875431 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:58.875394    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:41:58.875610 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:58.875423    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:41:58.875610 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:58.875513    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:41:58.875610 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:58.875520    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6b7zc" podUID="4aa79bf3-8eb3-4175-8706-2ddf3cfba37b"
Jun 03 19:41:58.875745 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:58.875619    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dhn5t" podUID="6c557986-2994-4e1c-8425-9475d1281349"
Jun 03 19:41:58.875745 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:41:58.875706    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-t5xl7" podUID="7f60d191-10e3-4ecb-9471-f6c6bfc3db0d"
Jun 03 19:41:59.181367 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.181340    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-187.ec2.internal" event="NodeReady"
Jun 03 19:41:59.181544 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.181451    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 03 19:41:59.229544 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.229511    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hsc5x"]
Jun 03 19:41:59.232691 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.232654    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7smss"]
Jun 03 19:41:59.232832 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.232705    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hsc5x"
Jun 03 19:41:59.235362 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.235335    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 03 19:41:59.235362 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.235352    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 03 19:41:59.235547 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.235535    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7smss"
Jun 03 19:41:59.235754 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.235737    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6vfft\""
Jun 03 19:41:59.238002 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.237978    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 03 19:41:59.238123 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.238071    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 03 19:41:59.238123 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.238089    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 03 19:41:59.238234 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.238182    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bl6bl\""
Jun 03 19:41:59.243409 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.243382    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hsc5x"]
Jun 03 19:41:59.246797 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.246770    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7smss"]
Jun 03 19:41:59.253676 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.253644    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r6wlf"]
Jun 03 19:41:59.256976 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.256957    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r6wlf"
Jun 03 19:41:59.260048 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.260024    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hfxqt\""
Jun 03 19:41:59.260278 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.260211    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 03 19:41:59.260278 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.260222    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 03 19:41:59.260429 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.260351    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 03 19:41:59.261065 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.261048    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 03 19:41:59.267988 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.267961    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r6wlf"]
Jun 03 19:41:59.361607 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.361567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3306040-9145-4417-a279-c983d77434c0-metrics-tls\") pod \"dns-default-hsc5x\" (UID: \"f3306040-9145-4417-a279-c983d77434c0\") " pod="openshift-dns/dns-default-hsc5x"
Jun 03 19:41:59.361607 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.361610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5cd48d95-606d-4b68-94d3-df4cfb1ae654-crio-socket\") pod \"insights-runtime-extractor-r6wlf\" (UID: \"5cd48d95-606d-4b68-94d3-df4cfb1ae654\") " pod="openshift-insights/insights-runtime-extractor-r6wlf"
Jun 03 19:41:59.362134 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.361630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96455c83-4d2f-4c9c-b4c4-ff13857828ba-cert\") pod \"ingress-canary-7smss\" (UID: \"96455c83-4d2f-4c9c-b4c4-ff13857828ba\") " pod="openshift-ingress-canary/ingress-canary-7smss"
Jun 03 19:41:59.362134 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.361648    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xljmm\" (UniqueName: \"kubernetes.io/projected/96455c83-4d2f-4c9c-b4c4-ff13857828ba-kube-api-access-xljmm\") pod \"ingress-canary-7smss\" (UID: \"96455c83-4d2f-4c9c-b4c4-ff13857828ba\") " pod="openshift-ingress-canary/ingress-canary-7smss"
Jun 03 19:41:59.362134 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.361754    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3306040-9145-4417-a279-c983d77434c0-tmp-dir\") pod \"dns-default-hsc5x\" (UID: \"f3306040-9145-4417-a279-c983d77434c0\") " pod="openshift-dns/dns-default-hsc5x"
Jun 03 19:41:59.362134 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.361782    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5cd48d95-606d-4b68-94d3-df4cfb1ae654-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6wlf\" (UID: \"5cd48d95-606d-4b68-94d3-df4cfb1ae654\") " pod="openshift-insights/insights-runtime-extractor-r6wlf"
Jun 03 19:41:59.362134 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.361804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjdk7\" (UniqueName: \"kubernetes.io/projected/f3306040-9145-4417-a279-c983d77434c0-kube-api-access-qjdk7\") pod \"dns-default-hsc5x\" (UID: \"f3306040-9145-4417-a279-c983d77434c0\") " pod="openshift-dns/dns-default-hsc5x"
Jun 03 19:41:59.362134 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.361821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5cd48d95-606d-4b68-94d3-df4cfb1ae654-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6wlf\" (UID: \"5cd48d95-606d-4b68-94d3-df4cfb1ae654\") " pod="openshift-insights/insights-runtime-extractor-r6wlf"
Jun 03 19:41:59.362134 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.361861    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cd48d95-606d-4b68-94d3-df4cfb1ae654-data-volume\") pod \"insights-runtime-extractor-r6wlf\" (UID: \"5cd48d95-606d-4b68-94d3-df4cfb1ae654\") " pod="openshift-insights/insights-runtime-extractor-r6wlf"
Jun 03 19:41:59.362134 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.361902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58zrj\" (UniqueName: \"kubernetes.io/projected/5cd48d95-606d-4b68-94d3-df4cfb1ae654-kube-api-access-58zrj\") pod \"insights-runtime-extractor-r6wlf\" (UID: \"5cd48d95-606d-4b68-94d3-df4cfb1ae654\") " pod="openshift-insights/insights-runtime-extractor-r6wlf"
Jun 03 19:41:59.362134 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.361989    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f3306040-9145-4417-a279-c983d77434c0-config-volume\") pod \"dns-default-hsc5x\" (UID: \"f3306040-9145-4417-a279-c983d77434c0\") " pod="openshift-dns/dns-default-hsc5x"
Jun 03 19:41:59.372420 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.372387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:59.432413 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.432339    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:41:59.462481 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.462441    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3306040-9145-4417-a279-c983d77434c0-metrics-tls\") pod \"dns-default-hsc5x\" (UID: \"f3306040-9145-4417-a279-c983d77434c0\") " pod="openshift-dns/dns-default-hsc5x"
Jun 03 19:41:59.462606 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.462486    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5cd48d95-606d-4b68-94d3-df4cfb1ae654-crio-socket\") pod \"insights-runtime-extractor-r6wlf\" (UID: \"5cd48d95-606d-4b68-94d3-df4cfb1ae654\") " pod="openshift-insights/insights-runtime-extractor-r6wlf"
Jun 03 19:41:59.462606 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.462512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96455c83-4d2f-4c9c-b4c4-ff13857828ba-cert\") pod \"ingress-canary-7smss\" (UID: \"96455c83-4d2f-4c9c-b4c4-ff13857828ba\") " pod="openshift-ingress-canary/ingress-canary-7smss"
Jun 03 19:41:59.462703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.462635    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xljmm\" (UniqueName: \"kubernetes.io/projected/96455c83-4d2f-4c9c-b4c4-ff13857828ba-kube-api-access-xljmm\") pod \"ingress-canary-7smss\" (UID: \"96455c83-4d2f-4c9c-b4c4-ff13857828ba\") " pod="openshift-ingress-canary/ingress-canary-7smss"
Jun 03 19:41:59.462703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.462673    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5cd48d95-606d-4b68-94d3-df4cfb1ae654-crio-socket\") pod \"insights-runtime-extractor-r6wlf\" (UID: \"5cd48d95-606d-4b68-94d3-df4cfb1ae654\") " pod="openshift-insights/insights-runtime-extractor-r6wlf"
Jun 03 19:41:59.462803 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.462725    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3306040-9145-4417-a279-c983d77434c0-tmp-dir\") pod \"dns-default-hsc5x\" (UID: \"f3306040-9145-4417-a279-c983d77434c0\") " pod="openshift-dns/dns-default-hsc5x"
Jun 03 19:41:59.462803 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.462755    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5cd48d95-606d-4b68-94d3-df4cfb1ae654-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6wlf\" (UID: \"5cd48d95-606d-4b68-94d3-df4cfb1ae654\") " pod="openshift-insights/insights-runtime-extractor-r6wlf"
Jun 03 19:41:59.462803 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.462784    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjdk7\" (UniqueName: \"kubernetes.io/projected/f3306040-9145-4417-a279-c983d77434c0-kube-api-access-qjdk7\") pod \"dns-default-hsc5x\" (UID: \"f3306040-9145-4417-a279-c983d77434c0\") " pod="openshift-dns/dns-default-hsc5x"
Jun 03 19:41:59.463416 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.462805    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5cd48d95-606d-4b68-94d3-df4cfb1ae654-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6wlf\" (UID: \"5cd48d95-606d-4b68-94d3-df4cfb1ae654\") " pod="openshift-insights/insights-runtime-extractor-r6wlf"
Jun 03 19:41:59.463416 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.462852    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cd48d95-606d-4b68-94d3-df4cfb1ae654-data-volume\") pod \"insights-runtime-extractor-r6wlf\" (UID: \"5cd48d95-606d-4b68-94d3-df4cfb1ae654\") " pod="openshift-insights/insights-runtime-extractor-r6wlf"
Jun 03 19:41:59.463416 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.462909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58zrj\" (UniqueName: \"kubernetes.io/projected/5cd48d95-606d-4b68-94d3-df4cfb1ae654-kube-api-access-58zrj\") pod \"insights-runtime-extractor-r6wlf\" (UID: \"5cd48d95-606d-4b68-94d3-df4cfb1ae654\") " pod="openshift-insights/insights-runtime-extractor-r6wlf"
Jun 03 19:41:59.463416 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.462939    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f3306040-9145-4417-a279-c983d77434c0-config-volume\") pod \"dns-default-hsc5x\" (UID: \"f3306040-9145-4417-a279-c983d77434c0\") " pod="openshift-dns/dns-default-hsc5x"
Jun 03 19:41:59.463416 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.463105    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3306040-9145-4417-a279-c983d77434c0-tmp-dir\") pod \"dns-default-hsc5x\" (UID: \"f3306040-9145-4417-a279-c983d77434c0\") " pod="openshift-dns/dns-default-hsc5x"
Jun 03 19:41:59.463416 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.463283    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5cd48d95-606d-4b68-94d3-df4cfb1ae654-data-volume\") pod \"insights-runtime-extractor-r6wlf\" (UID: \"5cd48d95-606d-4b68-94d3-df4cfb1ae654\") " pod="openshift-insights/insights-runtime-extractor-r6wlf"
Jun 03 19:41:59.463646 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.463482    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5cd48d95-606d-4b68-94d3-df4cfb1ae654-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r6wlf\" (UID: \"5cd48d95-606d-4b68-94d3-df4cfb1ae654\") " pod="openshift-insights/insights-runtime-extractor-r6wlf"
Jun 03 19:41:59.463646 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.463509    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f3306040-9145-4417-a279-c983d77434c0-config-volume\") pod \"dns-default-hsc5x\" (UID: \"f3306040-9145-4417-a279-c983d77434c0\") " pod="openshift-dns/dns-default-hsc5x"
Jun 03 19:41:59.467017 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.466987    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5cd48d95-606d-4b68-94d3-df4cfb1ae654-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r6wlf\" (UID: \"5cd48d95-606d-4b68-94d3-df4cfb1ae654\") " pod="openshift-insights/insights-runtime-extractor-r6wlf"
Jun 03 19:41:59.467117 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.466987    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f3306040-9145-4417-a279-c983d77434c0-metrics-tls\") pod \"dns-default-hsc5x\" (UID: \"f3306040-9145-4417-a279-c983d77434c0\") " pod="openshift-dns/dns-default-hsc5x"
Jun 03 19:41:59.467169 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.467113    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96455c83-4d2f-4c9c-b4c4-ff13857828ba-cert\") pod \"ingress-canary-7smss\" (UID: \"96455c83-4d2f-4c9c-b4c4-ff13857828ba\") " pod="openshift-ingress-canary/ingress-canary-7smss"
Jun 03 19:41:59.471673 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.471622    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xljmm\" (UniqueName: \"kubernetes.io/projected/96455c83-4d2f-4c9c-b4c4-ff13857828ba-kube-api-access-xljmm\") pod \"ingress-canary-7smss\" (UID: \"96455c83-4d2f-4c9c-b4c4-ff13857828ba\") " pod="openshift-ingress-canary/ingress-canary-7smss"
Jun 03 19:41:59.471758 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.471676    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjdk7\" (UniqueName: \"kubernetes.io/projected/f3306040-9145-4417-a279-c983d77434c0-kube-api-access-qjdk7\") pod \"dns-default-hsc5x\" (UID: \"f3306040-9145-4417-a279-c983d77434c0\") " pod="openshift-dns/dns-default-hsc5x"
Jun 03 19:41:59.471758 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.471738    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58zrj\" (UniqueName: \"kubernetes.io/projected/5cd48d95-606d-4b68-94d3-df4cfb1ae654-kube-api-access-58zrj\") pod \"insights-runtime-extractor-r6wlf\" (UID: \"5cd48d95-606d-4b68-94d3-df4cfb1ae654\") " pod="openshift-insights/insights-runtime-extractor-r6wlf"
Jun 03 19:41:59.544992 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.544946    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hsc5x"
Jun 03 19:41:59.551225 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.551200    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7smss"
Jun 03 19:41:59.566005 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.565969    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r6wlf"
Jun 03 19:41:59.718275 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.718187    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7smss"]
Jun 03 19:41:59.721688 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:59.721658    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96455c83_4d2f_4c9c_b4c4_ff13857828ba.slice/crio-9037ec9f39d5b29deca65948440e62fa2eea61aa07127f8e59869b7cef212081 WatchSource:0}: Error finding container 9037ec9f39d5b29deca65948440e62fa2eea61aa07127f8e59869b7cef212081: Status 404 returned error can't find the container with id 9037ec9f39d5b29deca65948440e62fa2eea61aa07127f8e59869b7cef212081
Jun 03 19:41:59.727507 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.727477    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r6wlf"]
Jun 03 19:41:59.731706 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:59.731671    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd48d95_606d_4b68_94d3_df4cfb1ae654.slice/crio-9aa954749949de5483a371a69f7e0c77cb3f65d3fdf56ca7562597a9b99bbd63 WatchSource:0}: Error finding container 9aa954749949de5483a371a69f7e0c77cb3f65d3fdf56ca7562597a9b99bbd63: Status 404 returned error can't find the container with id 9aa954749949de5483a371a69f7e0c77cb3f65d3fdf56ca7562597a9b99bbd63
Jun 03 19:41:59.732581 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:41:59.732557    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hsc5x"]
Jun 03 19:41:59.735855 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:41:59.735829    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3306040_9145_4417_a279_c983d77434c0.slice/crio-30a70949bac0a60bcf44cbdee49f02e78660a5f7cac19cb8ca5b8f8b71a52246 WatchSource:0}: Error finding container 30a70949bac0a60bcf44cbdee49f02e78660a5f7cac19cb8ca5b8f8b71a52246: Status 404 returned error can't find the container with id 30a70949bac0a60bcf44cbdee49f02e78660a5f7cac19cb8ca5b8f8b71a52246
Jun 03 19:42:00.083853 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.083814    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7smss" event={"ID":"96455c83-4d2f-4c9c-b4c4-ff13857828ba","Type":"ContainerStarted","Data":"9037ec9f39d5b29deca65948440e62fa2eea61aa07127f8e59869b7cef212081"}
Jun 03 19:42:00.085226 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.085199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6wlf" event={"ID":"5cd48d95-606d-4b68-94d3-df4cfb1ae654","Type":"ContainerStarted","Data":"79425141b577af000d2984f411268013b0a973c82d8a689daef9bd97cc844d8d"}
Jun 03 19:42:00.085428 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.085256    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6wlf" event={"ID":"5cd48d95-606d-4b68-94d3-df4cfb1ae654","Type":"ContainerStarted","Data":"9aa954749949de5483a371a69f7e0c77cb3f65d3fdf56ca7562597a9b99bbd63"}
Jun 03 19:42:00.086240 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.086220    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hsc5x" event={"ID":"f3306040-9145-4417-a279-c983d77434c0","Type":"ContainerStarted","Data":"30a70949bac0a60bcf44cbdee49f02e78660a5f7cac19cb8ca5b8f8b71a52246"}
Jun 03 19:42:00.149086 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.147684    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78d7cd7d5b-hjfhq"]
Jun 03 19:42:00.164336 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.164302    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d7cd7d5b-hjfhq"]
Jun 03 19:42:00.164502 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.164436    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.167769 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.167744    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 03 19:42:00.168131 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.167826    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 03 19:42:00.168945 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.168925    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 03 19:42:00.169197 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.169180    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 03 19:42:00.169398 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.169383    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 03 19:42:00.169563 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.169548    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 03 19:42:00.169753 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.169735    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-w9q8g\""
Jun 03 19:42:00.170032 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.170014    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 03 19:42:00.264368 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.264336    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:00.271414 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.271378    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-oauth-config\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.271606 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.271510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-service-ca\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.271606 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.271545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-oauth-serving-cert\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.271606 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.271576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-config\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.271776 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.271612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsq6p\" (UniqueName: \"kubernetes.io/projected/5ecb218f-785d-490d-adb3-d2b4e11062e5-kube-api-access-gsq6p\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.271776 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.271679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-serving-cert\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.365244 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.365163    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:00.372818 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.372778    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-service-ca\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.372996 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.372834    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-oauth-serving-cert\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.372996 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.372863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-config\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.372996 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.372924    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsq6p\" (UniqueName: \"kubernetes.io/projected/5ecb218f-785d-490d-adb3-d2b4e11062e5-kube-api-access-gsq6p\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.372996 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.372965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-serving-cert\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.373236 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.372996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-oauth-config\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.374325 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.374295    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-config\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.374697 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.374680    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-oauth-serving-cert\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.374774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.374728    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-service-ca\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.378511 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.378482    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-oauth-config\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.378658 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.378491    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-serving-cert\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.383058 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.383017    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsq6p\" (UniqueName: \"kubernetes.io/projected/5ecb218f-785d-490d-adb3-d2b4e11062e5-kube-api-access-gsq6p\") pod \"console-78d7cd7d5b-hjfhq\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") " pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.481201 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.481163    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:00.809421 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.809385    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78d7cd7d5b-hjfhq"]
Jun 03 19:42:00.875415 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.875289    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:42:00.875415 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.875323    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:42:00.876025 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.875995    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:42:00.878746 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.878720    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 19:42:00.878906 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.878727    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4l42f\""
Jun 03 19:42:00.879649 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.879628    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 03 19:42:00.879773 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.879664    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 19:42:00.879773 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.879721    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sqzbn\""
Jun 03 19:42:00.879773 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:00.879667    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 19:42:00.908103 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:42:00.908063    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ecb218f_785d_490d_adb3_d2b4e11062e5.slice/crio-80304853055fef2a08ece896e8fac205f41b31c3ec0880883a4afca12318489e WatchSource:0}: Error finding container 80304853055fef2a08ece896e8fac205f41b31c3ec0880883a4afca12318489e: Status 404 returned error can't find the container with id 80304853055fef2a08ece896e8fac205f41b31c3ec0880883a4afca12318489e
Jun 03 19:42:01.008367 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:01.008336    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:01.091857 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:01.091816    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6wlf" event={"ID":"5cd48d95-606d-4b68-94d3-df4cfb1ae654","Type":"ContainerStarted","Data":"24af0da0c22bfb751dc50125cc0d8b4559af1eba90bfe29caeca6af1f447efb5"}
Jun 03 19:42:01.093147 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:01.093116    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d7cd7d5b-hjfhq" event={"ID":"5ecb218f-785d-490d-adb3-d2b4e11062e5","Type":"ContainerStarted","Data":"80304853055fef2a08ece896e8fac205f41b31c3ec0880883a4afca12318489e"}
Jun 03 19:42:01.099941 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:01.099908    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:01.570978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:01.570940    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:01.669912 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:01.669856    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:02.016623 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:02.016576    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:02.079866 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:02.079823    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:02.847817 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:02.847718    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:03.213157 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:03.213123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:03.269259 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:03.268994    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:03.801918 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:03.801672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:04.022079 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.022048    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:04.078427 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.078335    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m"]
Jun 03 19:42:04.089848 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.089810    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m"
Jun 03 19:42:04.094355 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.094050    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 03 19:42:04.095393 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.095359    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jun 03 19:42:04.095393 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.095382    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f8vkd"]
Jun 03 19:42:04.095598 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.095427    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 03 19:42:04.095598 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.095554    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 03 19:42:04.095702 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.095664    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-q2ppp\""
Jun 03 19:42:04.096028 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.096006    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jun 03 19:42:04.113329 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.113299    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hsc5x"
Jun 03 19:42:04.113524 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.113357    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m"]
Jun 03 19:42:04.113524 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.113398    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7smss" event={"ID":"96455c83-4d2f-4c9c-b4c4-ff13857828ba","Type":"ContainerStarted","Data":"e84bd01222cdc271129d2aba925cc48c0b836b9b835682d36f97198a7c3243d5"}
Jun 03 19:42:04.113524 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.113427    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r6wlf" event={"ID":"5cd48d95-606d-4b68-94d3-df4cfb1ae654","Type":"ContainerStarted","Data":"727ece6e105b90398aac862e04ee1a91e357b1e95e13b4daea723d93a23e10dc"}
Jun 03 19:42:04.113524 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.113454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hsc5x" event={"ID":"f3306040-9145-4417-a279-c983d77434c0","Type":"ContainerStarted","Data":"d4ed3ab32586a61e962b2c0dd5fbf54016d7aac20b3cd7d757769491076c4adf"}
Jun 03 19:42:04.113524 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.113470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hsc5x" event={"ID":"f3306040-9145-4417-a279-c983d77434c0","Type":"ContainerStarted","Data":"cb062dddda8a913a51f4230ee591011eb0e017953a154134cf32cbe8350e1d3d"}
Jun 03 19:42:04.113524 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.113502    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.116581 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.116556    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 03 19:42:04.116717 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.116607    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 03 19:42:04.117027 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.117007    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 03 19:42:04.117299 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.117280    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b5422\""
Jun 03 19:42:04.132968 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.132936    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:04.156411 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.156313    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7smss" podStartSLOduration=1.725997085 podStartE2EDuration="5.156293769s" totalImagesPullingTime="3.430296684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:04.1552811 +0000 UTC m=+50.745764492" watchObservedRunningTime="2026-06-03 19:42:04.156293769 +0000 UTC m=+50.746777160"
Jun 03 19:42:04.210724 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.208454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/60d136a9-cd54-410f-9a88-f57aac175267-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-2hb6m\" (UID: \"60d136a9-cd54-410f-9a88-f57aac175267\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m"
Jun 03 19:42:04.210724 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.208563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60d136a9-cd54-410f-9a88-f57aac175267-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-2hb6m\" (UID: \"60d136a9-cd54-410f-9a88-f57aac175267\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m"
Jun 03 19:42:04.210724 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.208828    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lgzw\" (UniqueName: \"kubernetes.io/projected/60d136a9-cd54-410f-9a88-f57aac175267-kube-api-access-5lgzw\") pod \"openshift-state-metrics-65f78d5c66-2hb6m\" (UID: \"60d136a9-cd54-410f-9a88-f57aac175267\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m"
Jun 03 19:42:04.210724 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.209437    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60d136a9-cd54-410f-9a88-f57aac175267-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-2hb6m\" (UID: \"60d136a9-cd54-410f-9a88-f57aac175267\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m"
Jun 03 19:42:04.234376 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.234304    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hsc5x" podStartSLOduration=1.823873767 podStartE2EDuration="5.234283396s" totalImagesPullingTime="3.410409629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:04.233469121 +0000 UTC m=+50.823952538" watchObservedRunningTime="2026-06-03 19:42:04.234283396 +0000 UTC m=+50.824766790"
Jun 03 19:42:04.257969 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.257889    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r6wlf" podStartSLOduration=1.7057699309999999 podStartE2EDuration="5.25784934s" totalImagesPullingTime="3.552079409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:41:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:04.257402936 +0000 UTC m=+50.847886341" watchObservedRunningTime="2026-06-03 19:42:04.25784934 +0000 UTC m=+50.848332807"
Jun 03 19:42:04.310404 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.310369    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60d136a9-cd54-410f-9a88-f57aac175267-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-2hb6m\" (UID: \"60d136a9-cd54-410f-9a88-f57aac175267\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m"
Jun 03 19:42:04.310404 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.310420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/60d136a9-cd54-410f-9a88-f57aac175267-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-2hb6m\" (UID: \"60d136a9-cd54-410f-9a88-f57aac175267\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m"
Jun 03 19:42:04.310664 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.310447    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60d136a9-cd54-410f-9a88-f57aac175267-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-2hb6m\" (UID: \"60d136a9-cd54-410f-9a88-f57aac175267\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m"
Jun 03 19:42:04.310664 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.310506    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/16fc5500-a86e-4f91-93ac-d969440ff199-node-exporter-textfile\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.310664 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.310554    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16fc5500-a86e-4f91-93ac-d969440ff199-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.310664 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.310575    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16fc5500-a86e-4f91-93ac-d969440ff199-metrics-client-ca\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.310664 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.310591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lgzw\" (UniqueName: \"kubernetes.io/projected/60d136a9-cd54-410f-9a88-f57aac175267-kube-api-access-5lgzw\") pod \"openshift-state-metrics-65f78d5c66-2hb6m\" (UID: \"60d136a9-cd54-410f-9a88-f57aac175267\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m"
Jun 03 19:42:04.310664 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.310608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/16fc5500-a86e-4f91-93ac-d969440ff199-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.310664 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.310628    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16fc5500-a86e-4f91-93ac-d969440ff199-sys\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.310664 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.310646    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/16fc5500-a86e-4f91-93ac-d969440ff199-root\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.311087 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.310677    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/16fc5500-a86e-4f91-93ac-d969440ff199-node-exporter-wtmp\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.311087 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.310705    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/16fc5500-a86e-4f91-93ac-d969440ff199-node-exporter-tls\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.311087 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.310728    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7qm4\" (UniqueName: \"kubernetes.io/projected/16fc5500-a86e-4f91-93ac-d969440ff199-kube-api-access-q7qm4\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.311272 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.311197    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60d136a9-cd54-410f-9a88-f57aac175267-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-2hb6m\" (UID: \"60d136a9-cd54-410f-9a88-f57aac175267\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m"
Jun 03 19:42:04.314807 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.314775    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60d136a9-cd54-410f-9a88-f57aac175267-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-2hb6m\" (UID: \"60d136a9-cd54-410f-9a88-f57aac175267\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m"
Jun 03 19:42:04.314807 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.314800    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/60d136a9-cd54-410f-9a88-f57aac175267-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-2hb6m\" (UID: \"60d136a9-cd54-410f-9a88-f57aac175267\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m"
Jun 03 19:42:04.327161 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.327132    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lgzw\" (UniqueName: \"kubernetes.io/projected/60d136a9-cd54-410f-9a88-f57aac175267-kube-api-access-5lgzw\") pod \"openshift-state-metrics-65f78d5c66-2hb6m\" (UID: \"60d136a9-cd54-410f-9a88-f57aac175267\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m"
Jun 03 19:42:04.353367 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.353272    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:04.403251 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.403213    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m"
Jun 03 19:42:04.411531 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.411502    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16fc5500-a86e-4f91-93ac-d969440ff199-metrics-client-ca\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.411641 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.411544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/16fc5500-a86e-4f91-93ac-d969440ff199-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.411641 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.411565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16fc5500-a86e-4f91-93ac-d969440ff199-sys\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.411641 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.411624    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/16fc5500-a86e-4f91-93ac-d969440ff199-sys\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.411791 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.411753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/16fc5500-a86e-4f91-93ac-d969440ff199-root\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.411839 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.411794    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/16fc5500-a86e-4f91-93ac-d969440ff199-node-exporter-wtmp\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.411916 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.411840    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/16fc5500-a86e-4f91-93ac-d969440ff199-node-exporter-tls\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.411916 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.411846    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/16fc5500-a86e-4f91-93ac-d969440ff199-root\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.411916 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.411886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7qm4\" (UniqueName: \"kubernetes.io/projected/16fc5500-a86e-4f91-93ac-d969440ff199-kube-api-access-q7qm4\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.412258 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.411982    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/16fc5500-a86e-4f91-93ac-d969440ff199-node-exporter-textfile\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.412258 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.412009    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/16fc5500-a86e-4f91-93ac-d969440ff199-node-exporter-wtmp\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.412258 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.412053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16fc5500-a86e-4f91-93ac-d969440ff199-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.412416 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.412295    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/16fc5500-a86e-4f91-93ac-d969440ff199-metrics-client-ca\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.412416 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.412332    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/16fc5500-a86e-4f91-93ac-d969440ff199-node-exporter-textfile\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.412416 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.412341    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/16fc5500-a86e-4f91-93ac-d969440ff199-node-exporter-accelerators-collector-config\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.414300 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.414278    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/16fc5500-a86e-4f91-93ac-d969440ff199-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.414451 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.414435    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/16fc5500-a86e-4f91-93ac-d969440ff199-node-exporter-tls\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.427137 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.427107    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7qm4\" (UniqueName: \"kubernetes.io/projected/16fc5500-a86e-4f91-93ac-d969440ff199-kube-api-access-q7qm4\") pod \"node-exporter-f8vkd\" (UID: \"16fc5500-a86e-4f91-93ac-d969440ff199\") " pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.456793 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.456730    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:04.558036 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.558005    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:04.561723 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.561698    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m"]
Jun 03 19:42:04.658077 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.657989    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:04.724062 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.724027    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f8vkd"
Jun 03 19:42:04.760265 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:04.760227    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:05.041305 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.041264    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:05.140679 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.140487    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:05.186905 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.186697    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 19:42:05.237148 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.237104    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 19:42:05.237330 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.237312    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.242495 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.242471    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 03 19:42:05.242718 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.242705    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 03 19:42:05.242773 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.242719    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 03 19:42:05.242820 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.242475    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 03 19:42:05.243019 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.242985    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 03 19:42:05.243019 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.243006    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 03 19:42:05.243231 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.243097    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 03 19:42:05.243231 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.243146    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x4jph\""
Jun 03 19:42:05.243231 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.243156    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 03 19:42:05.243231 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.243188    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 03 19:42:05.248889 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.248842    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:05.321413 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.321322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ab6364df-0756-4ad8-9591-02a3d1b80b68-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.321413 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.321374    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.321413 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.321411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.321679 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.321453    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab6364df-0756-4ad8-9591-02a3d1b80b68-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.321679 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.321496    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.321679 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.321514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5rkh\" (UniqueName: \"kubernetes.io/projected/ab6364df-0756-4ad8-9591-02a3d1b80b68-kube-api-access-c5rkh\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.321679 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.321538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.321679 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.321569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ab6364df-0756-4ad8-9591-02a3d1b80b68-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.321679 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.321600    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ab6364df-0756-4ad8-9591-02a3d1b80b68-config-out\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.321679 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.321620    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-config-volume\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.321679 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.321644    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-web-config\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.321679 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.321666    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6364df-0756-4ad8-9591-02a3d1b80b68-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.322167 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.321699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.341552 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.341519    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:05.422166 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.422125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5rkh\" (UniqueName: \"kubernetes.io/projected/ab6364df-0756-4ad8-9591-02a3d1b80b68-kube-api-access-c5rkh\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.422166 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.422171    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.422408 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.422198    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ab6364df-0756-4ad8-9591-02a3d1b80b68-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.422408 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.422227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ab6364df-0756-4ad8-9591-02a3d1b80b68-config-out\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.422408 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.422256    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-config-volume\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.422408 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.422279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-web-config\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.422408 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.422300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6364df-0756-4ad8-9591-02a3d1b80b68-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.422408 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.422332    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.422408 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.422411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ab6364df-0756-4ad8-9591-02a3d1b80b68-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.422736 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.422444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.422736 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.422481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.422736 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.422576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab6364df-0756-4ad8-9591-02a3d1b80b68-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.422736 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.422611    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ab6364df-0756-4ad8-9591-02a3d1b80b68-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.422736 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.422659    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.423796 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.423752    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6364df-0756-4ad8-9591-02a3d1b80b68-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.423796 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.423775    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab6364df-0756-4ad8-9591-02a3d1b80b68-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.427373 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.426215    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ab6364df-0756-4ad8-9591-02a3d1b80b68-config-out\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.427373 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.426220    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ab6364df-0756-4ad8-9591-02a3d1b80b68-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.427373 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.426557    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.427373 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.427119    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.427373 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.427359    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.428067 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.428044    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-config-volume\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.428196 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.428163    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.428464 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.428446    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.428728 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.428695    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-web-config\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.431684 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.431656    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5rkh\" (UniqueName: \"kubernetes.io/projected/ab6364df-0756-4ad8-9591-02a3d1b80b68-kube-api-access-c5rkh\") pod \"alertmanager-main-0\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.549689 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.549645    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:42:05.616732 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:42:05.616701    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d136a9_cd54_410f_9a88_f57aac175267.slice/crio-3bf611452ed619dd2eacd58c0f66dfdd3fcfb7ef5a23919ed593c1fa3b768639 WatchSource:0}: Error finding container 3bf611452ed619dd2eacd58c0f66dfdd3fcfb7ef5a23919ed593c1fa3b768639: Status 404 returned error can't find the container with id 3bf611452ed619dd2eacd58c0f66dfdd3fcfb7ef5a23919ed593c1fa3b768639
Jun 03 19:42:05.628790 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:42:05.628762    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16fc5500_a86e_4f91_93ac_d969440ff199.slice/crio-e60659fcd6125ebfe79be55c87d5c2aa04d794155174a48de19a6e3eaaa17ed3 WatchSource:0}: Error finding container e60659fcd6125ebfe79be55c87d5c2aa04d794155174a48de19a6e3eaaa17ed3: Status 404 returned error can't find the container with id e60659fcd6125ebfe79be55c87d5c2aa04d794155174a48de19a6e3eaaa17ed3
Jun 03 19:42:05.771026 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:05.770921    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 19:42:05.774935 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:42:05.774906    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab6364df_0756_4ad8_9591_02a3d1b80b68.slice/crio-941c054089ecc9c8db1d4f640d35ecb8c02d0851b69b1a51ddb8c03b4afdf6b8 WatchSource:0}: Error finding container 941c054089ecc9c8db1d4f640d35ecb8c02d0851b69b1a51ddb8c03b4afdf6b8: Status 404 returned error can't find the container with id 941c054089ecc9c8db1d4f640d35ecb8c02d0851b69b1a51ddb8c03b4afdf6b8
Jun 03 19:42:06.069609 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.069577    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66c8bc895-wsjns"]
Jun 03 19:42:06.090482 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.090450    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66c8bc895-wsjns"]
Jun 03 19:42:06.090660 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.090570    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.093781 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.093756    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 03 19:42:06.093935 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.093757    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6q9mj\""
Jun 03 19:42:06.093935 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.093757    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 03 19:42:06.094160 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.094144    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 03 19:42:06.094434 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.094416    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 03 19:42:06.094530 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.094473    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 03 19:42:06.094698 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.094675    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-3723gmuonuk4r\""
Jun 03 19:42:06.120156 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.120122    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d7cd7d5b-hjfhq" event={"ID":"5ecb218f-785d-490d-adb3-d2b4e11062e5","Type":"ContainerStarted","Data":"e8cb419b6da7660c964f200fd76cd35482a38181c639cd898f6a3851c0150cd1"}
Jun 03 19:42:06.122170 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.121792    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab6364df-0756-4ad8-9591-02a3d1b80b68","Type":"ContainerStarted","Data":"941c054089ecc9c8db1d4f640d35ecb8c02d0851b69b1a51ddb8c03b4afdf6b8"}
Jun 03 19:42:06.124080 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.124050    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m" event={"ID":"60d136a9-cd54-410f-9a88-f57aac175267","Type":"ContainerStarted","Data":"629ea468568cb71fe26aaecfb81de72bf2da83c5f6bdbc9529d45fa192fdc23a"}
Jun 03 19:42:06.124248 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.124113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m" event={"ID":"60d136a9-cd54-410f-9a88-f57aac175267","Type":"ContainerStarted","Data":"2a26e94713d04af752357506b8de75bd24c1ba40945744f40aa075edac465601"}
Jun 03 19:42:06.124248 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.124142    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m" event={"ID":"60d136a9-cd54-410f-9a88-f57aac175267","Type":"ContainerStarted","Data":"3bf611452ed619dd2eacd58c0f66dfdd3fcfb7ef5a23919ed593c1fa3b768639"}
Jun 03 19:42:06.130476 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.130246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-thanos-querier-tls\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.130476 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.130305    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.130476 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.130366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.130476 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.130404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/299aec1a-df97-4222-9751-08ffad78f8b7-metrics-client-ca\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.130476 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.130420    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgrjd\" (UniqueName: \"kubernetes.io/projected/299aec1a-df97-4222-9751-08ffad78f8b7-kube-api-access-tgrjd\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.130476 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.130444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.130923 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.130507    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.130923 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.130542    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-grpc-tls\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.130923 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.130591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8vkd" event={"ID":"16fc5500-a86e-4f91-93ac-d969440ff199","Type":"ContainerStarted","Data":"e60659fcd6125ebfe79be55c87d5c2aa04d794155174a48de19a6e3eaaa17ed3"}
Jun 03 19:42:06.231770 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.231735    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.231959 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.231783    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/299aec1a-df97-4222-9751-08ffad78f8b7-metrics-client-ca\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.231959 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.231809    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgrjd\" (UniqueName: \"kubernetes.io/projected/299aec1a-df97-4222-9751-08ffad78f8b7-kube-api-access-tgrjd\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.231959 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.231846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.231959 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.231898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.231959 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.231921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-grpc-tls\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.232263 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.232013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-thanos-querier-tls\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.232263 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.232052    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.233184 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.233157    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/299aec1a-df97-4222-9751-08ffad78f8b7-metrics-client-ca\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.236457 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.236393    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.236457 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.236395    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.236615 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.236470    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-grpc-tls\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.236615 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.236509    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.236615 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.236579    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.237100 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.237083    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/299aec1a-df97-4222-9751-08ffad78f8b7-secret-thanos-querier-tls\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.242705 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.242678    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgrjd\" (UniqueName: \"kubernetes.io/projected/299aec1a-df97-4222-9751-08ffad78f8b7-kube-api-access-tgrjd\") pod \"thanos-querier-66c8bc895-wsjns\" (UID: \"299aec1a-df97-4222-9751-08ffad78f8b7\") " pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.404573 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.404409    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:06.547972 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.547930    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56c58856f7-85s6s"]
Jun 03 19:42:06.565900 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.565843    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.577902 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.577790    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:06.580626 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.580595    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56c58856f7-85s6s"]
Jun 03 19:42:06.594371 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.594335    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 03 19:42:06.636690 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.636647    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-oauth-config\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.636904 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.636710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-service-ca\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.636904 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.636804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s86zx\" (UniqueName: \"kubernetes.io/projected/528e183a-7bea-439f-a3e4-6bf74a58b63c-kube-api-access-s86zx\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.636904 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.636841    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-oauth-serving-cert\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.636904 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.636893    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-serving-cert\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.637080 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.636950    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-config\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.637080 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.637017    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-trusted-ca-bundle\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.737663 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.737609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s86zx\" (UniqueName: \"kubernetes.io/projected/528e183a-7bea-439f-a3e4-6bf74a58b63c-kube-api-access-s86zx\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.737845 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.737674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-oauth-serving-cert\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.737845 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.737712    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-serving-cert\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.737845 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.737745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-config\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.737845 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.737801    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-trusted-ca-bundle\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.738094 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.737893    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-oauth-config\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.738094 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.737935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-service-ca\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.738704 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.738631    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-oauth-serving-cert\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.738704 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.738662    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-config\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.738704 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.738691    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-service-ca\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.739030 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.739012    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-trusted-ca-bundle\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.741632 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.741613    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-serving-cert\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.743572 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.743551    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-oauth-config\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.747621 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.747592    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66c8bc895-wsjns"]
Jun 03 19:42:06.753381 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.753330    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s86zx\" (UniqueName: \"kubernetes.io/projected/528e183a-7bea-439f-a3e4-6bf74a58b63c-kube-api-access-s86zx\") pod \"console-56c58856f7-85s6s\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") " pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:06.879260 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:06.879225    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:07.023161 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:42:07.023130    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299aec1a_df97_4222_9751_08ffad78f8b7.slice/crio-f31a00a09ee0ebb537c93b99de22d0d9dc98add1e5109115b01593f99c074697 WatchSource:0}: Error finding container f31a00a09ee0ebb537c93b99de22d0d9dc98add1e5109115b01593f99c074697: Status 404 returned error can't find the container with id f31a00a09ee0ebb537c93b99de22d0d9dc98add1e5109115b01593f99c074697
Jun 03 19:42:07.053302 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:07.053273    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:07.136328 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:07.136287    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns" event={"ID":"299aec1a-df97-4222-9751-08ffad78f8b7","Type":"ContainerStarted","Data":"f31a00a09ee0ebb537c93b99de22d0d9dc98add1e5109115b01593f99c074697"}
Jun 03 19:42:07.155139 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:07.155114    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:07.159249 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:07.159193    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78d7cd7d5b-hjfhq" podStartSLOduration=2.075439198 podStartE2EDuration="7.159169621s" totalImagesPullingTime="5.083730423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:07.157506717 +0000 UTC m=+53.747990110" watchObservedRunningTime="2026-06-03 19:42:07.159169621 +0000 UTC m=+53.749653013"
Jun 03 19:42:07.263285 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:07.263050    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:07.351711 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:07.351675    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56c58856f7-85s6s"]
Jun 03 19:42:07.356079 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:07.356025    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:07.379936 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:42:07.379902    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod528e183a_7bea_439f_a3e4_6bf74a58b63c.slice/crio-7b1fed79774524dab95fdb021712ec6798442a5b3e27424b8521bcd5eb7cb5c4 WatchSource:0}: Error finding container 7b1fed79774524dab95fdb021712ec6798442a5b3e27424b8521bcd5eb7cb5c4: Status 404 returned error can't find the container with id 7b1fed79774524dab95fdb021712ec6798442a5b3e27424b8521bcd5eb7cb5c4
Jun 03 19:42:08.142164 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:08.142125    2563 generic.go:356] "Generic (PLEG): container finished" podID="16fc5500-a86e-4f91-93ac-d969440ff199" containerID="5775fb3744e6c287586785fb56fd0b0c25887a01e02e38070394504566592786" exitCode=0
Jun 03 19:42:08.143072 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:08.142225    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8vkd" event={"ID":"16fc5500-a86e-4f91-93ac-d969440ff199","Type":"ContainerDied","Data":"5775fb3744e6c287586785fb56fd0b0c25887a01e02e38070394504566592786"}
Jun 03 19:42:08.144316 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:08.144275    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c58856f7-85s6s" event={"ID":"528e183a-7bea-439f-a3e4-6bf74a58b63c","Type":"ContainerStarted","Data":"a45655266937a7d10ddbd0052f1888ab3b889b0ca80d567e2675eb0c59892175"}
Jun 03 19:42:08.144427 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:08.144344    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c58856f7-85s6s" event={"ID":"528e183a-7bea-439f-a3e4-6bf74a58b63c","Type":"ContainerStarted","Data":"7b1fed79774524dab95fdb021712ec6798442a5b3e27424b8521bcd5eb7cb5c4"}
Jun 03 19:42:08.146505 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:08.146481    2563 generic.go:356] "Generic (PLEG): container finished" podID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerID="e2c810e669b9fa5d381897ae2ecf9431cf9de67602783c0cc26c930298ab0013" exitCode=0
Jun 03 19:42:08.146628 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:08.146557    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab6364df-0756-4ad8-9591-02a3d1b80b68","Type":"ContainerDied","Data":"e2c810e669b9fa5d381897ae2ecf9431cf9de67602783c0cc26c930298ab0013"}
Jun 03 19:42:08.149216 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:08.149187    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m" event={"ID":"60d136a9-cd54-410f-9a88-f57aac175267","Type":"ContainerStarted","Data":"011d3c379d4123c3c23e516c31b9c0efafa88a13e8e07128a6e4e8130f4a47c8"}
Jun 03 19:42:08.217941 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:08.217884    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56c58856f7-85s6s" podStartSLOduration=2.217848301 podStartE2EDuration="2.217848301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:08.217501571 +0000 UTC m=+54.807984964" watchObservedRunningTime="2026-06-03 19:42:08.217848301 +0000 UTC m=+54.808331692"
Jun 03 19:42:08.237562 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:08.237513    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2hb6m" podStartSLOduration=2.370295632 podStartE2EDuration="4.237495931s" totalImagesPullingTime="1.867200299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:08.236952052 +0000 UTC m=+54.827435447" watchObservedRunningTime="2026-06-03 19:42:08.237495931 +0000 UTC m=+54.827979322"
Jun 03 19:42:08.402550 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:08.402267    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:08.464082 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:08.464049    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:08.826557 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:08.826481    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:08.906598 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:08.906546    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:09.137789 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.137700    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:09.158428 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.158392    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8vkd" event={"ID":"16fc5500-a86e-4f91-93ac-d969440ff199","Type":"ContainerStarted","Data":"f9b6ba232c90e1b0a23ba09392e0565bab33f1912b9151a497ca8f5a83618c3b"}
Jun 03 19:42:09.158862 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.158459    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f8vkd" event={"ID":"16fc5500-a86e-4f91-93ac-d969440ff199","Type":"ContainerStarted","Data":"cd1bfb08cf82f0fb1f05e8e35011c339df977247ec8c9b41454bec7ff63b6efc"}
Jun 03 19:42:09.174545 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.174513    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d7cd7d5b-hjfhq"]
Jun 03 19:42:09.191214 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.191162    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f8vkd" podStartSLOduration=3.543064807 podStartE2EDuration="5.19114083s" totalImagesPullingTime="1.560995165s" totalInitContainerRuntime="87.080858ms" isStatefulPod=true podCreationTimestamp="2026-06-03 19:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:09.185306559 +0000 UTC m=+55.775789943" watchObservedRunningTime="2026-06-03 19:42:09.19114083 +0000 UTC m=+55.781624214"
Jun 03 19:42:09.218036 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.217997    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-568bdb8585-2jbpz"]
Jun 03 19:42:09.233551 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.233516    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.240183 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.240150    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568bdb8585-2jbpz"]
Jun 03 19:42:09.265264 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.265225    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n84g5\" (UniqueName: \"kubernetes.io/projected/a775df99-6533-49aa-b52a-7fe8701e9a9a-kube-api-access-n84g5\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.265493 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.265453    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-trusted-ca-bundle\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.265651 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.265526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-oauth-serving-cert\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.265651 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.265596    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-oauth-config\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.265651 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.265637    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-service-ca\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.265994 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.265728    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-serving-cert\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.265994 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.265762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-config\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.366575 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.366537    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-serving-cert\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.366575 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.366573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-config\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.366814 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.366614    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n84g5\" (UniqueName: \"kubernetes.io/projected/a775df99-6533-49aa-b52a-7fe8701e9a9a-kube-api-access-n84g5\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.367282 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.366714    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-trusted-ca-bundle\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.367396 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.367330    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-oauth-serving-cert\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.367396 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.367368    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-oauth-config\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.367496 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.367393    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-config\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.367496 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.367402    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-service-ca\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.367733 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.367707    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-trusted-ca-bundle\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.368099 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.368046    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-service-ca\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.368287 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.368188    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-oauth-serving-cert\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.370287 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.370264    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-serving-cert\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.370374 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.370321    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-oauth-config\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.373707 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.373678    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:09.375654 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.375629    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n84g5\" (UniqueName: \"kubernetes.io/projected/a775df99-6533-49aa-b52a-7fe8701e9a9a-kube-api-access-n84g5\") pod \"console-568bdb8585-2jbpz\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") " pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.475085 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.474974    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:09.547338 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.547298    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:09.575963 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:09.575920    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:10.396793 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.396754    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:10.403641 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.403607    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:42:10.426626 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.426597    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.430657 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.430424    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4q7454cbq36ou\""
Jun 03 19:42:10.430657 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.430460    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 03 19:42:10.430657 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.430585    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 03 19:42:10.430657 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.430588    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lsdhl\""
Jun 03 19:42:10.430997 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.430428    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 03 19:42:10.431208 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.431187    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 03 19:42:10.431305 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.431245    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 03 19:42:10.431305 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.431269    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 03 19:42:10.431411 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.431307    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:42:10.431411 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.431189    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 03 19:42:10.431411 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.431400    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 03 19:42:10.431541 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.431416    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jun 03 19:42:10.431541 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.431464    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 03 19:42:10.431635 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.431583    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 03 19:42:10.431693 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.431674    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 03 19:42:10.431742 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.431703    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 03 19:42:10.433597 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.433572    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jun 03 19:42:10.435417 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.434986    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 03 19:42:10.479426 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.479386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.479596 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.479441    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f27d7c8b-482d-4d24-93a4-9ea4f4791374-config-out\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.479596 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.479508    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.479596 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.479551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.479596 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.479584    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.479774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.479613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.479774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.479690    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.479774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.479722    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f27d7c8b-482d-4d24-93a4-9ea4f4791374-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.479774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.479764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.479918 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.479794    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.479918 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.479812    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-web-config\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.479918 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.479856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.479918 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.479904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bvtr\" (UniqueName: \"kubernetes.io/projected/f27d7c8b-482d-4d24-93a4-9ea4f4791374-kube-api-access-6bvtr\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.480040 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.479928    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.480040 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.479984    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-config\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.480040 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.480003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.480040 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.480022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.480151 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.480049    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.480151 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.480100    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.480151 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.480124    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.481551 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.481534    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:10.581200 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.581200 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-web-config\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.581455 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581224    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.581455 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bvtr\" (UniqueName: \"kubernetes.io/projected/f27d7c8b-482d-4d24-93a4-9ea4f4791374-kube-api-access-6bvtr\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.581455 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.581455 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-config\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.581455 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.581455 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.581455 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581435    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.581811 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581477    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.581811 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581503    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.581811 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581575    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.581811 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581641    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f27d7c8b-482d-4d24-93a4-9ea4f4791374-config-out\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.581811 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.581811 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581705    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.581811 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581736    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.581811 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581744    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.581811 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581764    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.582270 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581820    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.582270 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581857    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f27d7c8b-482d-4d24-93a4-9ea4f4791374-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.582270 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.581913    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.585385 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.582448    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.585385 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.582482    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.585385 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.584228    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.585385 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.584739    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.585385 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.584804    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.585385 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.585268    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.585385 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.585349    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.587045 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.586475    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.587045 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.586480    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.587045 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.586913    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-web-config\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.587045 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.586977    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.587325 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.587140    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-config\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.587325 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.587217    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.587764 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.587735    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.587860 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.587847    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.587926 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.587860    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f27d7c8b-482d-4d24-93a4-9ea4f4791374-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.588141 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.588120    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.589153 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.589135    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f27d7c8b-482d-4d24-93a4-9ea4f4791374-config-out\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.590337 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.590317    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bvtr\" (UniqueName: \"kubernetes.io/projected/f27d7c8b-482d-4d24-93a4-9ea4f4791374-kube-api-access-6bvtr\") pod \"prometheus-k8s-0\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.737916 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.737788    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:10.854123 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.854076    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:10.919832 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:10.919797    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:11.005272 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:11.005233    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568bdb8585-2jbpz"]
Jun 03 19:42:11.009895 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:42:11.009727    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda775df99_6533_49aa_b52a_7fe8701e9a9a.slice/crio-944d62b6ea2bcd832a04b91a56386996deed2db1281df1c99180209daabd937a WatchSource:0}: Error finding container 944d62b6ea2bcd832a04b91a56386996deed2db1281df1c99180209daabd937a: Status 404 returned error can't find the container with id 944d62b6ea2bcd832a04b91a56386996deed2db1281df1c99180209daabd937a
Jun 03 19:42:11.039303 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:11.039201    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:42:11.042437 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:42:11.042410    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf27d7c8b_482d_4d24_93a4_9ea4f4791374.slice/crio-a4758e42b3cdb612b10985de1a5b3ea766ecf67b18c74a7798a664b8592b013e WatchSource:0}: Error finding container a4758e42b3cdb612b10985de1a5b3ea766ecf67b18c74a7798a664b8592b013e: Status 404 returned error can't find the container with id a4758e42b3cdb612b10985de1a5b3ea766ecf67b18c74a7798a664b8592b013e
Jun 03 19:42:11.169684 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:11.169554    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns" event={"ID":"299aec1a-df97-4222-9751-08ffad78f8b7","Type":"ContainerStarted","Data":"d1cc4ffb71fa825663b566b84af227fd0f64df5353acc18da98bf16ff0482d21"}
Jun 03 19:42:11.169684 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:11.169640    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns" event={"ID":"299aec1a-df97-4222-9751-08ffad78f8b7","Type":"ContainerStarted","Data":"dc6fda9024f25a0a6c45317dc63684435c0b1000f7f8e6ebd2adf6a6830984bf"}
Jun 03 19:42:11.173014 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:11.172671    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f27d7c8b-482d-4d24-93a4-9ea4f4791374","Type":"ContainerStarted","Data":"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652"}
Jun 03 19:42:11.173014 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:11.172740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f27d7c8b-482d-4d24-93a4-9ea4f4791374","Type":"ContainerStarted","Data":"a4758e42b3cdb612b10985de1a5b3ea766ecf67b18c74a7798a664b8592b013e"}
Jun 03 19:42:11.175176 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:11.175135    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568bdb8585-2jbpz" event={"ID":"a775df99-6533-49aa-b52a-7fe8701e9a9a","Type":"ContainerStarted","Data":"6d943ed4720ac95323b1ca3d72702d5170b94ab858a59f5432af4dfa1d10928e"}
Jun 03 19:42:11.176675 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:11.175242    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568bdb8585-2jbpz" event={"ID":"a775df99-6533-49aa-b52a-7fe8701e9a9a","Type":"ContainerStarted","Data":"944d62b6ea2bcd832a04b91a56386996deed2db1281df1c99180209daabd937a"}
Jun 03 19:42:11.178842 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:11.178240    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab6364df-0756-4ad8-9591-02a3d1b80b68","Type":"ContainerStarted","Data":"485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff"}
Jun 03 19:42:11.178842 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:11.178354    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab6364df-0756-4ad8-9591-02a3d1b80b68","Type":"ContainerStarted","Data":"eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290"}
Jun 03 19:42:11.208972 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:11.208916    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-568bdb8585-2jbpz" podStartSLOduration=2.208896405 podStartE2EDuration="2.208896405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:11.208136446 +0000 UTC m=+57.798619839" watchObservedRunningTime="2026-06-03 19:42:11.208896405 +0000 UTC m=+57.799379865"
Jun 03 19:42:12.186848 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:12.186809    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns" event={"ID":"299aec1a-df97-4222-9751-08ffad78f8b7","Type":"ContainerStarted","Data":"35b94ae7eec3cc32a30d0f74e9d4c512d45129e8af73ab7f1a779a758802dd02"}
Jun 03 19:42:12.188794 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:12.188761    2563 generic.go:356] "Generic (PLEG): container finished" podID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerID="b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652" exitCode=0
Jun 03 19:42:12.188952 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:12.188849    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f27d7c8b-482d-4d24-93a4-9ea4f4791374","Type":"ContainerDied","Data":"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652"}
Jun 03 19:42:12.192763 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:12.192669    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab6364df-0756-4ad8-9591-02a3d1b80b68","Type":"ContainerStarted","Data":"8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86"}
Jun 03 19:42:12.192763 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:12.192743    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab6364df-0756-4ad8-9591-02a3d1b80b68","Type":"ContainerStarted","Data":"69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d"}
Jun 03 19:42:12.192914 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:12.192794    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab6364df-0756-4ad8-9591-02a3d1b80b68","Type":"ContainerStarted","Data":"ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b"}
Jun 03 19:42:13.045444 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:13.045415    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s7kdk"
Jun 03 19:42:13.173589 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:13.173477    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:13.201855 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:13.201817    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab6364df-0756-4ad8-9591-02a3d1b80b68","Type":"ContainerStarted","Data":"5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421"}
Jun 03 19:42:13.205382 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:13.205346    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns" event={"ID":"299aec1a-df97-4222-9751-08ffad78f8b7","Type":"ContainerStarted","Data":"8311efa80658222d7f38a6ff29b2491c8abbb4db3f89de3831b6c907906bbcc3"}
Jun 03 19:42:13.205550 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:13.205433    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns" event={"ID":"299aec1a-df97-4222-9751-08ffad78f8b7","Type":"ContainerStarted","Data":"a4700dad14b9a1f72008cc412b70578e1817dc037ef4777729a78e536f965620"}
Jun 03 19:42:13.205550 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:13.205483    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:13.205550 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:13.205532    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns" event={"ID":"299aec1a-df97-4222-9751-08ffad78f8b7","Type":"ContainerStarted","Data":"d27a97c31b9a2393a50e2313798bc0af6674048199fb793c37461b4aad1a3798"}
Jun 03 19:42:13.234861 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:13.234803    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.936282344 podStartE2EDuration="8.23478056s" totalImagesPullingTime="5.276394884s" totalInitContainerRuntime="22.103332ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:13.232663926 +0000 UTC m=+59.823147320" watchObservedRunningTime="2026-06-03 19:42:13.23478056 +0000 UTC m=+59.825263951"
Jun 03 19:42:13.257804 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:13.257744    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns" podStartSLOduration=2.233810688 podStartE2EDuration="7.257726411s" totalImagesPullingTime="5.023915723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:13.255961957 +0000 UTC m=+59.846445349" watchObservedRunningTime="2026-06-03 19:42:13.257726411 +0000 UTC m=+59.848209781"
Jun 03 19:42:13.262215 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:13.262189    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:13.592436 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:13.592398    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:13.693314 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:13.693280    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:13.795395 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:13.795351    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:14.547891 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:14.547836    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:14.606638 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:14.606589    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:15.133963 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:15.133937    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hsc5x"
Jun 03 19:42:16.223839 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:16.223746    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f27d7c8b-482d-4d24-93a4-9ea4f4791374","Type":"ContainerStarted","Data":"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764"}
Jun 03 19:42:16.223839 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:16.223825    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f27d7c8b-482d-4d24-93a4-9ea4f4791374","Type":"ContainerStarted","Data":"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43"}
Jun 03 19:42:16.224403 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:16.223906    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f27d7c8b-482d-4d24-93a4-9ea4f4791374","Type":"ContainerStarted","Data":"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403"}
Jun 03 19:42:16.224403 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:16.223948    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f27d7c8b-482d-4d24-93a4-9ea4f4791374","Type":"ContainerStarted","Data":"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59"}
Jun 03 19:42:16.224403 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:16.223996    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f27d7c8b-482d-4d24-93a4-9ea4f4791374","Type":"ContainerStarted","Data":"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a"}
Jun 03 19:42:16.224403 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:16.224038    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f27d7c8b-482d-4d24-93a4-9ea4f4791374","Type":"ContainerStarted","Data":"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47"}
Jun 03 19:42:16.256673 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:16.256604    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.867738462 podStartE2EDuration="6.256580852s" totalImagesPullingTime="3.354274416s" totalInitContainerRuntime="34.567974ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:16.252545086 +0000 UTC m=+62.843028504" watchObservedRunningTime="2026-06-03 19:42:16.256580852 +0000 UTC m=+62.847064245"
Jun 03 19:42:16.336530 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:16.336495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:16.402110 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:16.402078    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:16.880236 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:16.880170    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:16.880442 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:16.880298    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:16.885160 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:16.885137    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:17.231841 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:17.231756    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:17.475594 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:17.475541    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:17.576926 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:17.576892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:19.215584 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.215555    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66c8bc895-wsjns"
Jun 03 19:42:19.548056 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.548016    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:19.548240 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.548077    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:19.552917 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.552866    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:19.577393 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.577343    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs\") pod \"network-metrics-daemon-dhn5t\" (UID: \"6c557986-2994-4e1c-8425-9475d1281349\") " pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:42:19.577586 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.577444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret\") pod \"global-pull-secret-syncer-6b7zc\" (UID: \"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b\") " pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:42:19.580274 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.580249    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 03 19:42:19.580430 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.580378    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 19:42:19.590204 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.590170    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c557986-2994-4e1c-8425-9475d1281349-metrics-certs\") pod \"network-metrics-daemon-dhn5t\" (UID: \"6c557986-2994-4e1c-8425-9475d1281349\") " pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:42:19.590355 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.590262    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4aa79bf3-8eb3-4175-8706-2ddf3cfba37b-original-pull-secret\") pod \"global-pull-secret-syncer-6b7zc\" (UID: \"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b\") " pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:42:19.678848 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.678795    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7khxn\" (UniqueName: \"kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn\") pod \"network-check-target-t5xl7\" (UID: \"7f60d191-10e3-4ecb-9471-f6c6bfc3db0d\") " pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:42:19.681965 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.681928    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 19:42:19.692347 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.692317    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 19:42:19.703235 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.703203    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7khxn\" (UniqueName: \"kubernetes.io/projected/7f60d191-10e3-4ecb-9471-f6c6bfc3db0d-kube-api-access-7khxn\") pod \"network-check-target-t5xl7\" (UID: \"7f60d191-10e3-4ecb-9471-f6c6bfc3db0d\") " pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:42:19.793148 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.793113    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sqzbn\""
Jun 03 19:42:19.799055 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.798980    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4l42f\""
Jun 03 19:42:19.801079 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.801055    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dhn5t"
Jun 03 19:42:19.806916 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.806892    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:42:19.821056 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.820762    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6b7zc"
Jun 03 19:42:19.954625 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.954574    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dhn5t"]
Jun 03 19:42:19.958573 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:42:19.958541    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c557986_2994_4e1c_8425_9475d1281349.slice/crio-f3c3013a66aeacd9c32581830a9b35ed7967d4c6be0d71a84f3715520ca41fa4 WatchSource:0}: Error finding container f3c3013a66aeacd9c32581830a9b35ed7967d4c6be0d71a84f3715520ca41fa4: Status 404 returned error can't find the container with id f3c3013a66aeacd9c32581830a9b35ed7967d4c6be0d71a84f3715520ca41fa4
Jun 03 19:42:19.973547 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.973515    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-t5xl7"]
Jun 03 19:42:19.977214 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:42:19.977181    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f60d191_10e3_4ecb_9471_f6c6bfc3db0d.slice/crio-8d55264c14e938a3a21459c5c4a8b03a011bb14afbed5a53fb1a6ee39d8c372b WatchSource:0}: Error finding container 8d55264c14e938a3a21459c5c4a8b03a011bb14afbed5a53fb1a6ee39d8c372b: Status 404 returned error can't find the container with id 8d55264c14e938a3a21459c5c4a8b03a011bb14afbed5a53fb1a6ee39d8c372b
Jun 03 19:42:19.994773 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:19.994745    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6b7zc"]
Jun 03 19:42:19.997885 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:42:19.997844    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa79bf3_8eb3_4175_8706_2ddf3cfba37b.slice/crio-bc82f464b61d5a6333605b3087aebcbfeb372cc6df4bc55f4b603c9bb886deb1 WatchSource:0}: Error finding container bc82f464b61d5a6333605b3087aebcbfeb372cc6df4bc55f4b603c9bb886deb1: Status 404 returned error can't find the container with id bc82f464b61d5a6333605b3087aebcbfeb372cc6df4bc55f4b603c9bb886deb1
Jun 03 19:42:20.141189 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:20.141095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:20.221421 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:20.221385    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:20.239935 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:20.239896    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6b7zc" event={"ID":"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b","Type":"ContainerStarted","Data":"bc82f464b61d5a6333605b3087aebcbfeb372cc6df4bc55f4b603c9bb886deb1"}
Jun 03 19:42:20.240995 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:20.240972    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t5xl7" event={"ID":"7f60d191-10e3-4ecb-9471-f6c6bfc3db0d","Type":"ContainerStarted","Data":"8d55264c14e938a3a21459c5c4a8b03a011bb14afbed5a53fb1a6ee39d8c372b"}
Jun 03 19:42:20.242227 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:20.242203    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dhn5t" event={"ID":"6c557986-2994-4e1c-8425-9475d1281349","Type":"ContainerStarted","Data":"f3c3013a66aeacd9c32581830a9b35ed7967d4c6be0d71a84f3715520ca41fa4"}
Jun 03 19:42:20.246095 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:20.246075    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:42:20.300060 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:20.300026    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56c58856f7-85s6s"]
Jun 03 19:42:20.739522 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:20.738349    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:21.251994 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:21.251864    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dhn5t" event={"ID":"6c557986-2994-4e1c-8425-9475d1281349","Type":"ContainerStarted","Data":"2008f7aa3f034b22181cb1a4ff25aa724302f66d33757e57f1012b583899d6a4"}
Jun 03 19:42:21.251994 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:21.251948    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dhn5t" event={"ID":"6c557986-2994-4e1c-8425-9475d1281349","Type":"ContainerStarted","Data":"61815f9a28de23978b2a5f3b11a57856a9819beb4e3ac081689d3271a40a6162"}
Jun 03 19:42:21.277492 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:21.277306    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dhn5t" podStartSLOduration=67.30518091 podStartE2EDuration="1m8.277281706s" totalImagesPullingTime="972.100796ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:21.276276955 +0000 UTC m=+67.866760350" watchObservedRunningTime="2026-06-03 19:42:21.277281706 +0000 UTC m=+67.867765099"
Jun 03 19:42:21.496161 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:21.496062    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:21.590730 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:21.590636    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:22.786248 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:22.786213    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:22.882177 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:22.882135    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:23.167524 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:23.167427    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:23.269706 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:23.269667    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:24.963259 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:24.963222    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:25.270626 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:25.270587    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6b7zc" event={"ID":"4aa79bf3-8eb3-4175-8706-2ddf3cfba37b","Type":"ContainerStarted","Data":"63f4ebe758a777aeba108843944bbd9ddd5235ab96e4111955d7389c96e30fbc"}
Jun 03 19:42:25.272219 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:25.272184    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-t5xl7" event={"ID":"7f60d191-10e3-4ecb-9471-f6c6bfc3db0d","Type":"ContainerStarted","Data":"6b7ebf5b233cd2afef00814975fab9a540f364366416e60c1ffdac030a20176a"}
Jun 03 19:42:25.272367 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:25.272269    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:42:25.307759 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:25.307701    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6b7zc" podStartSLOduration=66.82574688 podStartE2EDuration="1m11.307683862s" totalImagesPullingTime="4.481936982s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 19:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:25.29005808 +0000 UTC m=+71.880541469" watchObservedRunningTime="2026-06-03 19:42:25.307683862 +0000 UTC m=+71.898167254"
Jun 03 19:42:25.308335 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:25.308310    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-t5xl7" podStartSLOduration=66.810166867 podStartE2EDuration="1m11.308301727s" totalImagesPullingTime="4.49813486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:42:25.307528426 +0000 UTC m=+71.898011817" watchObservedRunningTime="2026-06-03 19:42:25.308301727 +0000 UTC m=+71.898785132"
Jun 03 19:42:26.577585 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:26.577462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:26.638731 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:26.638695    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:28.597692 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:28.597656    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:28.697413 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:28.697374    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:31.706153 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:31.706119    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:31.760524 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:31.760493    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:34.205503 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.205464    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-78d7cd7d5b-hjfhq" podUID="5ecb218f-785d-490d-adb3-d2b4e11062e5" containerName="console" containerID="cri-o://e8cb419b6da7660c964f200fd76cd35482a38181c639cd898f6a3851c0150cd1" gracePeriod=15
Jun 03 19:42:34.478782 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.478690    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:34.625961 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.625924    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-serving-cert\") pod \"5ecb218f-785d-490d-adb3-d2b4e11062e5\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") "
Jun 03 19:42:34.625961 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.625972    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-oauth-config\") pod \"5ecb218f-785d-490d-adb3-d2b4e11062e5\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") "
Jun 03 19:42:34.626195 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.626094    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsq6p\" (UniqueName: \"kubernetes.io/projected/5ecb218f-785d-490d-adb3-d2b4e11062e5-kube-api-access-gsq6p\") pod \"5ecb218f-785d-490d-adb3-d2b4e11062e5\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") "
Jun 03 19:42:34.626195 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.626148    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-oauth-serving-cert\") pod \"5ecb218f-785d-490d-adb3-d2b4e11062e5\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") "
Jun 03 19:42:34.626195 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.626190    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-service-ca\") pod \"5ecb218f-785d-490d-adb3-d2b4e11062e5\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") "
Jun 03 19:42:34.626414 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.626209    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-config\") pod \"5ecb218f-785d-490d-adb3-d2b4e11062e5\" (UID: \"5ecb218f-785d-490d-adb3-d2b4e11062e5\") "
Jun 03 19:42:34.626672 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.626635    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5ecb218f-785d-490d-adb3-d2b4e11062e5" (UID: "5ecb218f-785d-490d-adb3-d2b4e11062e5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:42:34.626672 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.626645    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-service-ca" (OuterVolumeSpecName: "service-ca") pod "5ecb218f-785d-490d-adb3-d2b4e11062e5" (UID: "5ecb218f-785d-490d-adb3-d2b4e11062e5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:42:34.626823 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.626652    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-config" (OuterVolumeSpecName: "console-config") pod "5ecb218f-785d-490d-adb3-d2b4e11062e5" (UID: "5ecb218f-785d-490d-adb3-d2b4e11062e5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:42:34.628546 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.628521    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ecb218f-785d-490d-adb3-d2b4e11062e5-kube-api-access-gsq6p" (OuterVolumeSpecName: "kube-api-access-gsq6p") pod "5ecb218f-785d-490d-adb3-d2b4e11062e5" (UID: "5ecb218f-785d-490d-adb3-d2b4e11062e5"). InnerVolumeSpecName "kube-api-access-gsq6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:42:34.628546 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.628525    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5ecb218f-785d-490d-adb3-d2b4e11062e5" (UID: "5ecb218f-785d-490d-adb3-d2b4e11062e5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:42:34.628663 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.628588    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5ecb218f-785d-490d-adb3-d2b4e11062e5" (UID: "5ecb218f-785d-490d-adb3-d2b4e11062e5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:42:34.726940 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.726898    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-oauth-serving-cert\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:42:34.726940 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.726932    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-service-ca\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:42:34.726940 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.726941    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-config\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:42:34.726940 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.726949    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-serving-cert\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:42:34.727206 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.726957    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ecb218f-785d-490d-adb3-d2b4e11062e5-console-oauth-config\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:42:34.727206 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:34.726965    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsq6p\" (UniqueName: \"kubernetes.io/projected/5ecb218f-785d-490d-adb3-d2b4e11062e5-kube-api-access-gsq6p\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:42:35.315336 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:35.315306    2563 generic.go:356] "Generic (PLEG): container finished" podID="5ecb218f-785d-490d-adb3-d2b4e11062e5" containerID="e8cb419b6da7660c964f200fd76cd35482a38181c639cd898f6a3851c0150cd1" exitCode=0
Jun 03 19:42:35.315737 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:35.315354    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78d7cd7d5b-hjfhq"
Jun 03 19:42:35.315737 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:35.315356    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d7cd7d5b-hjfhq" event={"ID":"5ecb218f-785d-490d-adb3-d2b4e11062e5","Type":"ContainerDied","Data":"e8cb419b6da7660c964f200fd76cd35482a38181c639cd898f6a3851c0150cd1"}
Jun 03 19:42:35.315737 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:35.315484    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78d7cd7d5b-hjfhq" event={"ID":"5ecb218f-785d-490d-adb3-d2b4e11062e5","Type":"ContainerDied","Data":"80304853055fef2a08ece896e8fac205f41b31c3ec0880883a4afca12318489e"}
Jun 03 19:42:35.315737 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:35.315515    2563 scope.go:117] "RemoveContainer" containerID="e8cb419b6da7660c964f200fd76cd35482a38181c639cd898f6a3851c0150cd1"
Jun 03 19:42:35.327491 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:35.327464    2563 scope.go:117] "RemoveContainer" containerID="e8cb419b6da7660c964f200fd76cd35482a38181c639cd898f6a3851c0150cd1"
Jun 03 19:42:35.327799 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:42:35.327779    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8cb419b6da7660c964f200fd76cd35482a38181c639cd898f6a3851c0150cd1\": container with ID starting with e8cb419b6da7660c964f200fd76cd35482a38181c639cd898f6a3851c0150cd1 not found: ID does not exist" containerID="e8cb419b6da7660c964f200fd76cd35482a38181c639cd898f6a3851c0150cd1"
Jun 03 19:42:35.327854 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:35.327809    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8cb419b6da7660c964f200fd76cd35482a38181c639cd898f6a3851c0150cd1"} err="failed to get container status \"e8cb419b6da7660c964f200fd76cd35482a38181c639cd898f6a3851c0150cd1\": rpc error: code = NotFound desc = could not find container \"e8cb419b6da7660c964f200fd76cd35482a38181c639cd898f6a3851c0150cd1\": container with ID starting with e8cb419b6da7660c964f200fd76cd35482a38181c639cd898f6a3851c0150cd1 not found: ID does not exist"
Jun 03 19:42:35.336108 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:35.336079    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78d7cd7d5b-hjfhq"]
Jun 03 19:42:35.340024 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:35.339996    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78d7cd7d5b-hjfhq"]
Jun 03 19:42:35.880003 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:35.879972    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ecb218f-785d-490d-adb3-d2b4e11062e5" path="/var/lib/kubelet/pods/5ecb218f-785d-490d-adb3-d2b4e11062e5/volumes"
Jun 03 19:42:42.933110 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:42.933065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:43.045368 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:43.045330    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:43.119422 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:43.119387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:43.597325 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:43.597292    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:43.699270 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:43.699236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:42:45.329579 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.329512    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56c58856f7-85s6s" podUID="528e183a-7bea-439f-a3e4-6bf74a58b63c" containerName="console" containerID="cri-o://a45655266937a7d10ddbd0052f1888ab3b889b0ca80d567e2675eb0c59892175" gracePeriod=15
Jun 03 19:42:45.573865 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.573836    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:45.612573 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.612487    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-serving-cert\") pod \"528e183a-7bea-439f-a3e4-6bf74a58b63c\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") "
Jun 03 19:42:45.612573 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.612542    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-oauth-config\") pod \"528e183a-7bea-439f-a3e4-6bf74a58b63c\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") "
Jun 03 19:42:45.612806 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.612586    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s86zx\" (UniqueName: \"kubernetes.io/projected/528e183a-7bea-439f-a3e4-6bf74a58b63c-kube-api-access-s86zx\") pod \"528e183a-7bea-439f-a3e4-6bf74a58b63c\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") "
Jun 03 19:42:45.612806 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.612623    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-config\") pod \"528e183a-7bea-439f-a3e4-6bf74a58b63c\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") "
Jun 03 19:42:45.612806 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.612655    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-trusted-ca-bundle\") pod \"528e183a-7bea-439f-a3e4-6bf74a58b63c\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") "
Jun 03 19:42:45.612806 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.612712    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-oauth-serving-cert\") pod \"528e183a-7bea-439f-a3e4-6bf74a58b63c\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") "
Jun 03 19:42:45.612806 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.612768    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-service-ca\") pod \"528e183a-7bea-439f-a3e4-6bf74a58b63c\" (UID: \"528e183a-7bea-439f-a3e4-6bf74a58b63c\") "
Jun 03 19:42:45.613157 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.613124    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-config" (OuterVolumeSpecName: "console-config") pod "528e183a-7bea-439f-a3e4-6bf74a58b63c" (UID: "528e183a-7bea-439f-a3e4-6bf74a58b63c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:42:45.613349 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.613310    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-service-ca" (OuterVolumeSpecName: "service-ca") pod "528e183a-7bea-439f-a3e4-6bf74a58b63c" (UID: "528e183a-7bea-439f-a3e4-6bf74a58b63c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:42:45.613530 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.613500    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "528e183a-7bea-439f-a3e4-6bf74a58b63c" (UID: "528e183a-7bea-439f-a3e4-6bf74a58b63c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:42:45.613822 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.613793    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "528e183a-7bea-439f-a3e4-6bf74a58b63c" (UID: "528e183a-7bea-439f-a3e4-6bf74a58b63c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:42:45.615144 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.615121    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "528e183a-7bea-439f-a3e4-6bf74a58b63c" (UID: "528e183a-7bea-439f-a3e4-6bf74a58b63c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:42:45.615429 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.615402    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "528e183a-7bea-439f-a3e4-6bf74a58b63c" (UID: "528e183a-7bea-439f-a3e4-6bf74a58b63c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:42:45.615517 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.615457    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/528e183a-7bea-439f-a3e4-6bf74a58b63c-kube-api-access-s86zx" (OuterVolumeSpecName: "kube-api-access-s86zx") pod "528e183a-7bea-439f-a3e4-6bf74a58b63c" (UID: "528e183a-7bea-439f-a3e4-6bf74a58b63c"). InnerVolumeSpecName "kube-api-access-s86zx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:42:45.714012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.713969    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-service-ca\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:42:45.714012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.714004    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-serving-cert\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:42:45.714012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.714014    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-oauth-config\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:42:45.714012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.714022    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s86zx\" (UniqueName: \"kubernetes.io/projected/528e183a-7bea-439f-a3e4-6bf74a58b63c-kube-api-access-s86zx\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:42:45.714286 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.714031    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-console-config\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:42:45.714286 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.714039    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-trusted-ca-bundle\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:42:45.714286 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:45.714046    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/528e183a-7bea-439f-a3e4-6bf74a58b63c-oauth-serving-cert\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:42:46.359934 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:46.359900    2563 generic.go:356] "Generic (PLEG): container finished" podID="528e183a-7bea-439f-a3e4-6bf74a58b63c" containerID="a45655266937a7d10ddbd0052f1888ab3b889b0ca80d567e2675eb0c59892175" exitCode=0
Jun 03 19:42:46.359934 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:46.359947    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c58856f7-85s6s" event={"ID":"528e183a-7bea-439f-a3e4-6bf74a58b63c","Type":"ContainerDied","Data":"a45655266937a7d10ddbd0052f1888ab3b889b0ca80d567e2675eb0c59892175"}
Jun 03 19:42:46.360422 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:46.359954    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56c58856f7-85s6s"
Jun 03 19:42:46.360422 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:46.360016    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56c58856f7-85s6s" event={"ID":"528e183a-7bea-439f-a3e4-6bf74a58b63c","Type":"ContainerDied","Data":"7b1fed79774524dab95fdb021712ec6798442a5b3e27424b8521bcd5eb7cb5c4"}
Jun 03 19:42:46.360422 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:46.360036    2563 scope.go:117] "RemoveContainer" containerID="a45655266937a7d10ddbd0052f1888ab3b889b0ca80d567e2675eb0c59892175"
Jun 03 19:42:46.368910 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:46.368862    2563 scope.go:117] "RemoveContainer" containerID="a45655266937a7d10ddbd0052f1888ab3b889b0ca80d567e2675eb0c59892175"
Jun 03 19:42:46.369257 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:42:46.369239    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a45655266937a7d10ddbd0052f1888ab3b889b0ca80d567e2675eb0c59892175\": container with ID starting with a45655266937a7d10ddbd0052f1888ab3b889b0ca80d567e2675eb0c59892175 not found: ID does not exist" containerID="a45655266937a7d10ddbd0052f1888ab3b889b0ca80d567e2675eb0c59892175"
Jun 03 19:42:46.369320 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:46.369265    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a45655266937a7d10ddbd0052f1888ab3b889b0ca80d567e2675eb0c59892175"} err="failed to get container status \"a45655266937a7d10ddbd0052f1888ab3b889b0ca80d567e2675eb0c59892175\": rpc error: code = NotFound desc = could not find container \"a45655266937a7d10ddbd0052f1888ab3b889b0ca80d567e2675eb0c59892175\": container with ID starting with a45655266937a7d10ddbd0052f1888ab3b889b0ca80d567e2675eb0c59892175 not found: ID does not exist"
Jun 03 19:42:46.377742 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:46.377709    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56c58856f7-85s6s"]
Jun 03 19:42:46.381530 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:46.381501    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56c58856f7-85s6s"]
Jun 03 19:42:47.882050 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:47.882012    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="528e183a-7bea-439f-a3e4-6bf74a58b63c" path="/var/lib/kubelet/pods/528e183a-7bea-439f-a3e4-6bf74a58b63c/volumes"
Jun 03 19:42:53.011517 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:53.011471    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:53.032218 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:53.032189    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:53.405036 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:53.404953    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:42:56.278725 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:42:56.278691    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-t5xl7"
Jun 03 19:43:03.342149 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:03.342108    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:43:03.760598 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:03.760560    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:43:04.414419 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:04.414384    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 19:43:04.414786 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:04.414723    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="alertmanager" containerID="cri-o://eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290" gracePeriod=120
Jun 03 19:43:04.414909 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:04.414799    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="kube-rbac-proxy-web" containerID="cri-o://ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b" gracePeriod=120
Jun 03 19:43:04.414909 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:04.414815    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="kube-rbac-proxy-metric" containerID="cri-o://8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86" gracePeriod=120
Jun 03 19:43:04.414909 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:04.414859    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="config-reloader" containerID="cri-o://485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff" gracePeriod=120
Jun 03 19:43:04.415307 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:04.414855    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="kube-rbac-proxy" containerID="cri-o://69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d" gracePeriod=120
Jun 03 19:43:04.415307 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:04.414930    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="prom-label-proxy" containerID="cri-o://5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421" gracePeriod=120
Jun 03 19:43:05.439467 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.439430    2563 generic.go:356] "Generic (PLEG): container finished" podID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerID="5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421" exitCode=0
Jun 03 19:43:05.439467 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.439455    2563 generic.go:356] "Generic (PLEG): container finished" podID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerID="69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d" exitCode=0
Jun 03 19:43:05.439467 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.439464    2563 generic.go:356] "Generic (PLEG): container finished" podID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerID="485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff" exitCode=0
Jun 03 19:43:05.439467 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.439469    2563 generic.go:356] "Generic (PLEG): container finished" podID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerID="eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290" exitCode=0
Jun 03 19:43:05.440059 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.439499    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab6364df-0756-4ad8-9591-02a3d1b80b68","Type":"ContainerDied","Data":"5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421"}
Jun 03 19:43:05.440059 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.439568    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab6364df-0756-4ad8-9591-02a3d1b80b68","Type":"ContainerDied","Data":"69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d"}
Jun 03 19:43:05.440059 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.439595    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab6364df-0756-4ad8-9591-02a3d1b80b68","Type":"ContainerDied","Data":"485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff"}
Jun 03 19:43:05.440059 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.439620    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab6364df-0756-4ad8-9591-02a3d1b80b68","Type":"ContainerDied","Data":"eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290"}
Jun 03 19:43:05.685155 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.685129    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:05.781599 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.781567    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy-web\") pod \"ab6364df-0756-4ad8-9591-02a3d1b80b68\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") "
Jun 03 19:43:05.781599 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.781606    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5rkh\" (UniqueName: \"kubernetes.io/projected/ab6364df-0756-4ad8-9591-02a3d1b80b68-kube-api-access-c5rkh\") pod \"ab6364df-0756-4ad8-9591-02a3d1b80b68\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") "
Jun 03 19:43:05.781947 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.781634    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy\") pod \"ab6364df-0756-4ad8-9591-02a3d1b80b68\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") "
Jun 03 19:43:05.781947 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.781663    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab6364df-0756-4ad8-9591-02a3d1b80b68-alertmanager-trusted-ca-bundle\") pod \"ab6364df-0756-4ad8-9591-02a3d1b80b68\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") "
Jun 03 19:43:05.781947 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.781702    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-main-tls\") pod \"ab6364df-0756-4ad8-9591-02a3d1b80b68\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") "
Jun 03 19:43:05.781947 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.781743    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-config-volume\") pod \"ab6364df-0756-4ad8-9591-02a3d1b80b68\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") "
Jun 03 19:43:05.781947 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.781782    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ab6364df-0756-4ad8-9591-02a3d1b80b68-config-out\") pod \"ab6364df-0756-4ad8-9591-02a3d1b80b68\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") "
Jun 03 19:43:05.781947 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.781807    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6364df-0756-4ad8-9591-02a3d1b80b68-metrics-client-ca\") pod \"ab6364df-0756-4ad8-9591-02a3d1b80b68\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") "
Jun 03 19:43:05.781947 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.781833    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy-metric\") pod \"ab6364df-0756-4ad8-9591-02a3d1b80b68\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") "
Jun 03 19:43:05.781947 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.781901    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ab6364df-0756-4ad8-9591-02a3d1b80b68-tls-assets\") pod \"ab6364df-0756-4ad8-9591-02a3d1b80b68\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") "
Jun 03 19:43:05.781947 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.781938    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ab6364df-0756-4ad8-9591-02a3d1b80b68-alertmanager-main-db\") pod \"ab6364df-0756-4ad8-9591-02a3d1b80b68\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") "
Jun 03 19:43:05.782383 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.781983    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-cluster-tls-config\") pod \"ab6364df-0756-4ad8-9591-02a3d1b80b68\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") "
Jun 03 19:43:05.782383 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.782009    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-web-config\") pod \"ab6364df-0756-4ad8-9591-02a3d1b80b68\" (UID: \"ab6364df-0756-4ad8-9591-02a3d1b80b68\") "
Jun 03 19:43:05.782383 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.782053    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab6364df-0756-4ad8-9591-02a3d1b80b68-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "ab6364df-0756-4ad8-9591-02a3d1b80b68" (UID: "ab6364df-0756-4ad8-9591-02a3d1b80b68"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:43:05.782383 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.782273    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ab6364df-0756-4ad8-9591-02a3d1b80b68-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:05.782383 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.782266    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab6364df-0756-4ad8-9591-02a3d1b80b68-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "ab6364df-0756-4ad8-9591-02a3d1b80b68" (UID: "ab6364df-0756-4ad8-9591-02a3d1b80b68"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:43:05.782640 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.782607    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab6364df-0756-4ad8-9591-02a3d1b80b68-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "ab6364df-0756-4ad8-9591-02a3d1b80b68" (UID: "ab6364df-0756-4ad8-9591-02a3d1b80b68"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 19:43:05.786455 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.786404    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "ab6364df-0756-4ad8-9591-02a3d1b80b68" (UID: "ab6364df-0756-4ad8-9591-02a3d1b80b68"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:05.786698 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.786673    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "ab6364df-0756-4ad8-9591-02a3d1b80b68" (UID: "ab6364df-0756-4ad8-9591-02a3d1b80b68"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:05.787134 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.787098    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab6364df-0756-4ad8-9591-02a3d1b80b68-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ab6364df-0756-4ad8-9591-02a3d1b80b68" (UID: "ab6364df-0756-4ad8-9591-02a3d1b80b68"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:43:05.787236 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.787170    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-config-volume" (OuterVolumeSpecName: "config-volume") pod "ab6364df-0756-4ad8-9591-02a3d1b80b68" (UID: "ab6364df-0756-4ad8-9591-02a3d1b80b68"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:05.787906 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.787541    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "ab6364df-0756-4ad8-9591-02a3d1b80b68" (UID: "ab6364df-0756-4ad8-9591-02a3d1b80b68"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:05.787906 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.787842    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab6364df-0756-4ad8-9591-02a3d1b80b68-kube-api-access-c5rkh" (OuterVolumeSpecName: "kube-api-access-c5rkh") pod "ab6364df-0756-4ad8-9591-02a3d1b80b68" (UID: "ab6364df-0756-4ad8-9591-02a3d1b80b68"). InnerVolumeSpecName "kube-api-access-c5rkh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:43:05.788201 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.788122    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab6364df-0756-4ad8-9591-02a3d1b80b68-config-out" (OuterVolumeSpecName: "config-out") pod "ab6364df-0756-4ad8-9591-02a3d1b80b68" (UID: "ab6364df-0756-4ad8-9591-02a3d1b80b68"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 19:43:05.788201 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.788140    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "ab6364df-0756-4ad8-9591-02a3d1b80b68" (UID: "ab6364df-0756-4ad8-9591-02a3d1b80b68"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:05.792160 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.792129    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "ab6364df-0756-4ad8-9591-02a3d1b80b68" (UID: "ab6364df-0756-4ad8-9591-02a3d1b80b68"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:05.812289 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.812246    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-web-config" (OuterVolumeSpecName: "web-config") pod "ab6364df-0756-4ad8-9591-02a3d1b80b68" (UID: "ab6364df-0756-4ad8-9591-02a3d1b80b68"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:05.883171 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.883130    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-main-tls\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:05.883171 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.883170    2563 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-config-volume\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:05.883414 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.883193    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ab6364df-0756-4ad8-9591-02a3d1b80b68-config-out\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:05.883414 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.883204    2563 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab6364df-0756-4ad8-9591-02a3d1b80b68-metrics-client-ca\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:05.883414 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.883218    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:05.883414 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.883229    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ab6364df-0756-4ad8-9591-02a3d1b80b68-tls-assets\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:05.883414 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.883240    2563 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ab6364df-0756-4ad8-9591-02a3d1b80b68-alertmanager-main-db\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:05.883414 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.883254    2563 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-cluster-tls-config\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:05.883414 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.883293    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-web-config\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:05.883414 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.883306    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:05.883414 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.883320    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5rkh\" (UniqueName: \"kubernetes.io/projected/ab6364df-0756-4ad8-9591-02a3d1b80b68-kube-api-access-c5rkh\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:05.883414 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:05.883334    2563 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ab6364df-0756-4ad8-9591-02a3d1b80b68-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:06.448447 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.448413    2563 generic.go:356] "Generic (PLEG): container finished" podID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerID="8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86" exitCode=0
Jun 03 19:43:06.448447 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.448441    2563 generic.go:356] "Generic (PLEG): container finished" podID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerID="ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b" exitCode=0
Jun 03 19:43:06.448930 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.448499    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab6364df-0756-4ad8-9591-02a3d1b80b68","Type":"ContainerDied","Data":"8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86"}
Jun 03 19:43:06.448930 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.448529    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.448930 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.448567    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab6364df-0756-4ad8-9591-02a3d1b80b68","Type":"ContainerDied","Data":"ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b"}
Jun 03 19:43:06.448930 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.448596    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ab6364df-0756-4ad8-9591-02a3d1b80b68","Type":"ContainerDied","Data":"941c054089ecc9c8db1d4f640d35ecb8c02d0851b69b1a51ddb8c03b4afdf6b8"}
Jun 03 19:43:06.448930 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.448636    2563 scope.go:117] "RemoveContainer" containerID="5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421"
Jun 03 19:43:06.457325 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.457300    2563 scope.go:117] "RemoveContainer" containerID="8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86"
Jun 03 19:43:06.465648 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.465622    2563 scope.go:117] "RemoveContainer" containerID="69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d"
Jun 03 19:43:06.471530 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.471500    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 19:43:06.483320 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.483279    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 19:43:06.493261 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.493231    2563 scope.go:117] "RemoveContainer" containerID="ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b"
Jun 03 19:43:06.501509 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.501488    2563 scope.go:117] "RemoveContainer" containerID="485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff"
Jun 03 19:43:06.505588 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.505557    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 19:43:06.505902 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.505886    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="config-reloader"
Jun 03 19:43:06.505993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.505906    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="config-reloader"
Jun 03 19:43:06.505993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.505917    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="kube-rbac-proxy-metric"
Jun 03 19:43:06.505993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.505927    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="kube-rbac-proxy-metric"
Jun 03 19:43:06.505993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.505943    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="528e183a-7bea-439f-a3e4-6bf74a58b63c" containerName="console"
Jun 03 19:43:06.505993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.505952    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="528e183a-7bea-439f-a3e4-6bf74a58b63c" containerName="console"
Jun 03 19:43:06.505993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.505968    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="init-config-reloader"
Jun 03 19:43:06.505993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.505977    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="init-config-reloader"
Jun 03 19:43:06.505993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.505986    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="alertmanager"
Jun 03 19:43:06.505993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.505994    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="alertmanager"
Jun 03 19:43:06.506402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.506005    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ecb218f-785d-490d-adb3-d2b4e11062e5" containerName="console"
Jun 03 19:43:06.506402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.506013    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ecb218f-785d-490d-adb3-d2b4e11062e5" containerName="console"
Jun 03 19:43:06.506402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.506025    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="kube-rbac-proxy-web"
Jun 03 19:43:06.506402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.506033    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="kube-rbac-proxy-web"
Jun 03 19:43:06.506402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.506048    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="kube-rbac-proxy"
Jun 03 19:43:06.506402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.506056    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="kube-rbac-proxy"
Jun 03 19:43:06.506402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.506068    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="prom-label-proxy"
Jun 03 19:43:06.506402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.506076    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="prom-label-proxy"
Jun 03 19:43:06.506402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.506150    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="528e183a-7bea-439f-a3e4-6bf74a58b63c" containerName="console"
Jun 03 19:43:06.506402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.506164    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ecb218f-785d-490d-adb3-d2b4e11062e5" containerName="console"
Jun 03 19:43:06.506402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.506174    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="kube-rbac-proxy-metric"
Jun 03 19:43:06.506402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.506183    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="config-reloader"
Jun 03 19:43:06.506402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.506192    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="kube-rbac-proxy-web"
Jun 03 19:43:06.506402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.506200    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="kube-rbac-proxy"
Jun 03 19:43:06.506402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.506209    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="prom-label-proxy"
Jun 03 19:43:06.506402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.506219    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" containerName="alertmanager"
Jun 03 19:43:06.510101 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.510078    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.516703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.511113    2563 scope.go:117] "RemoveContainer" containerID="eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290"
Jun 03 19:43:06.516703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.513151    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 03 19:43:06.516703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.513767    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 03 19:43:06.516703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.513846    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 03 19:43:06.516703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.514108    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 03 19:43:06.516703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.514166    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 03 19:43:06.516703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.514409    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 03 19:43:06.516703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.514451    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 03 19:43:06.516703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.514942    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 03 19:43:06.518331 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.518190    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x4jph\""
Jun 03 19:43:06.522539 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.522511    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 03 19:43:06.527074 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.527053    2563 scope.go:117] "RemoveContainer" containerID="e2c810e669b9fa5d381897ae2ecf9431cf9de67602783c0cc26c930298ab0013"
Jun 03 19:43:06.529526 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.529498    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 19:43:06.545103 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.537225    2563 scope.go:117] "RemoveContainer" containerID="5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421"
Jun 03 19:43:06.545103 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:43:06.537581    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421\": container with ID starting with 5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421 not found: ID does not exist" containerID="5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421"
Jun 03 19:43:06.545103 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.537620    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421"} err="failed to get container status \"5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421\": rpc error: code = NotFound desc = could not find container \"5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421\": container with ID starting with 5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421 not found: ID does not exist"
Jun 03 19:43:06.545103 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.537647    2563 scope.go:117] "RemoveContainer" containerID="8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86"
Jun 03 19:43:06.545103 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:43:06.538365    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86\": container with ID starting with 8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86 not found: ID does not exist" containerID="8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86"
Jun 03 19:43:06.545103 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.538394    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86"} err="failed to get container status \"8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86\": rpc error: code = NotFound desc = could not find container \"8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86\": container with ID starting with 8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86 not found: ID does not exist"
Jun 03 19:43:06.545103 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.538416    2563 scope.go:117] "RemoveContainer" containerID="69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d"
Jun 03 19:43:06.545103 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:43:06.538700    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d\": container with ID starting with 69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d not found: ID does not exist" containerID="69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d"
Jun 03 19:43:06.545103 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.538725    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d"} err="failed to get container status \"69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d\": rpc error: code = NotFound desc = could not find container \"69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d\": container with ID starting with 69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d not found: ID does not exist"
Jun 03 19:43:06.545103 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.538745    2563 scope.go:117] "RemoveContainer" containerID="ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b"
Jun 03 19:43:06.545103 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:43:06.539055    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b\": container with ID starting with ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b not found: ID does not exist" containerID="ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b"
Jun 03 19:43:06.545103 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.539080    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b"} err="failed to get container status \"ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b\": rpc error: code = NotFound desc = could not find container \"ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b\": container with ID starting with ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b not found: ID does not exist"
Jun 03 19:43:06.545103 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.539099    2563 scope.go:117] "RemoveContainer" containerID="485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff"
Jun 03 19:43:06.545103 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:43:06.539354    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff\": container with ID starting with 485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff not found: ID does not exist" containerID="485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff"
Jun 03 19:43:06.545103 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.539380    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff"} err="failed to get container status \"485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff\": rpc error: code = NotFound desc = could not find container \"485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff\": container with ID starting with 485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff not found: ID does not exist"
Jun 03 19:43:06.545103 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.539399    2563 scope.go:117] "RemoveContainer" containerID="eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290"
Jun 03 19:43:06.545993 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:43:06.539646    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290\": container with ID starting with eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290 not found: ID does not exist" containerID="eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290"
Jun 03 19:43:06.545993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.539670    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290"} err="failed to get container status \"eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290\": rpc error: code = NotFound desc = could not find container \"eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290\": container with ID starting with eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290 not found: ID does not exist"
Jun 03 19:43:06.545993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.539689    2563 scope.go:117] "RemoveContainer" containerID="e2c810e669b9fa5d381897ae2ecf9431cf9de67602783c0cc26c930298ab0013"
Jun 03 19:43:06.545993 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:43:06.540083    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2c810e669b9fa5d381897ae2ecf9431cf9de67602783c0cc26c930298ab0013\": container with ID starting with e2c810e669b9fa5d381897ae2ecf9431cf9de67602783c0cc26c930298ab0013 not found: ID does not exist" containerID="e2c810e669b9fa5d381897ae2ecf9431cf9de67602783c0cc26c930298ab0013"
Jun 03 19:43:06.545993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.540109    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2c810e669b9fa5d381897ae2ecf9431cf9de67602783c0cc26c930298ab0013"} err="failed to get container status \"e2c810e669b9fa5d381897ae2ecf9431cf9de67602783c0cc26c930298ab0013\": rpc error: code = NotFound desc = could not find container \"e2c810e669b9fa5d381897ae2ecf9431cf9de67602783c0cc26c930298ab0013\": container with ID starting with e2c810e669b9fa5d381897ae2ecf9431cf9de67602783c0cc26c930298ab0013 not found: ID does not exist"
Jun 03 19:43:06.545993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.540133    2563 scope.go:117] "RemoveContainer" containerID="5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421"
Jun 03 19:43:06.545993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.540410    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421"} err="failed to get container status \"5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421\": rpc error: code = NotFound desc = could not find container \"5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421\": container with ID starting with 5be5130570d5a9394cd1d56dd005c25537c92a7d439e46d1fab9bff182dba421 not found: ID does not exist"
Jun 03 19:43:06.545993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.540434    2563 scope.go:117] "RemoveContainer" containerID="8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86"
Jun 03 19:43:06.545993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.540718    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86"} err="failed to get container status \"8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86\": rpc error: code = NotFound desc = could not find container \"8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86\": container with ID starting with 8d8c08b99f85b8be8d6a7fcac0e5937468fd11145cbcd7f1d06dd85c6d7c5f86 not found: ID does not exist"
Jun 03 19:43:06.545993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.540741    2563 scope.go:117] "RemoveContainer" containerID="69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d"
Jun 03 19:43:06.545993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.541060    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d"} err="failed to get container status \"69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d\": rpc error: code = NotFound desc = could not find container \"69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d\": container with ID starting with 69a6f030832a057309101e9339d75f1cfbfa3a7908102778c1b055fa48c77c4d not found: ID does not exist"
Jun 03 19:43:06.545993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.541082    2563 scope.go:117] "RemoveContainer" containerID="ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b"
Jun 03 19:43:06.545993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.541343    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b"} err="failed to get container status \"ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b\": rpc error: code = NotFound desc = could not find container \"ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b\": container with ID starting with ee1d42b05f8fde323214710694c22ad80c1b557159bc0d9d4da511d02249cf0b not found: ID does not exist"
Jun 03 19:43:06.545993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.541366    2563 scope.go:117] "RemoveContainer" containerID="485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff"
Jun 03 19:43:06.545993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.541612    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff"} err="failed to get container status \"485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff\": rpc error: code = NotFound desc = could not find container \"485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff\": container with ID starting with 485db6b12983399e0a634ede9eba66e1762cd5bac4b4f867eb764ac5dad1a3ff not found: ID does not exist"
Jun 03 19:43:06.545993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.541633    2563 scope.go:117] "RemoveContainer" containerID="eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290"
Jun 03 19:43:06.546937 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.541901    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290"} err="failed to get container status \"eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290\": rpc error: code = NotFound desc = could not find container \"eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290\": container with ID starting with eb6e6ca59a73f8465b32f6127296b5475d4d2a6ae680f34509d642e155a17290 not found: ID does not exist"
Jun 03 19:43:06.546937 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.541922    2563 scope.go:117] "RemoveContainer" containerID="e2c810e669b9fa5d381897ae2ecf9431cf9de67602783c0cc26c930298ab0013"
Jun 03 19:43:06.546937 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.542200    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2c810e669b9fa5d381897ae2ecf9431cf9de67602783c0cc26c930298ab0013"} err="failed to get container status \"e2c810e669b9fa5d381897ae2ecf9431cf9de67602783c0cc26c930298ab0013\": rpc error: code = NotFound desc = could not find container \"e2c810e669b9fa5d381897ae2ecf9431cf9de67602783c0cc26c930298ab0013\": container with ID starting with e2c810e669b9fa5d381897ae2ecf9431cf9de67602783c0cc26c930298ab0013 not found: ID does not exist"
Jun 03 19:43:06.590021 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.589956    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02697ff8-adb8-4464-a774-cecd719976fe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.590220 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.590031    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.590220 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.590062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.590220 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.590139    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.590220 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.590188    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.590387 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.590224    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02697ff8-adb8-4464-a774-cecd719976fe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.590387 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.590243    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts68d\" (UniqueName: \"kubernetes.io/projected/02697ff8-adb8-4464-a774-cecd719976fe-kube-api-access-ts68d\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.590387 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.590263    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02697ff8-adb8-4464-a774-cecd719976fe-config-out\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.590387 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.590322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02697ff8-adb8-4464-a774-cecd719976fe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.590387 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.590359    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-config-volume\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.590387 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.590380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.590570 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.590456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-web-config\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.590570 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.590492    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02697ff8-adb8-4464-a774-cecd719976fe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.691714 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.691666    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02697ff8-adb8-4464-a774-cecd719976fe-config-out\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.691957 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.691746    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02697ff8-adb8-4464-a774-cecd719976fe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.691957 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.691786    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-config-volume\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.691957 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.691823    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.691957 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.691863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-web-config\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.691957 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.691907    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02697ff8-adb8-4464-a774-cecd719976fe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.691957 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.691951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02697ff8-adb8-4464-a774-cecd719976fe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.692296 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.691987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.692296 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.692024    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.692296 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.692064    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.692296 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.692102    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.692296 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.692130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02697ff8-adb8-4464-a774-cecd719976fe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.692296 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.692160    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts68d\" (UniqueName: \"kubernetes.io/projected/02697ff8-adb8-4464-a774-cecd719976fe-kube-api-access-ts68d\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.693389 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.693353    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02697ff8-adb8-4464-a774-cecd719976fe-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.694515 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.694484    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02697ff8-adb8-4464-a774-cecd719976fe-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.695283 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.695193    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02697ff8-adb8-4464-a774-cecd719976fe-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.697740 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.697709    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02697ff8-adb8-4464-a774-cecd719976fe-config-out\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.698807 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.698731    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-web-config\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.699358 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.699318    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.710082 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.708435    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02697ff8-adb8-4464-a774-cecd719976fe-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.710082 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.708905    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-config-volume\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.710082 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.709281    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.710082 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.709280    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.710082 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.709743    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.710082 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.709844    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts68d\" (UniqueName: \"kubernetes.io/projected/02697ff8-adb8-4464-a774-cecd719976fe-kube-api-access-ts68d\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.710574 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.710293    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02697ff8-adb8-4464-a774-cecd719976fe-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02697ff8-adb8-4464-a774-cecd719976fe\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:06.831599 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:06.831555    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 19:43:07.023949 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:07.023693    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 19:43:07.030465 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:43:07.030426    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02697ff8_adb8_4464_a774_cecd719976fe.slice/crio-cd8a5aa721386a0a56f4afdebf787b958c351a18ec084ae6e73bd04adf17b8fa WatchSource:0}: Error finding container cd8a5aa721386a0a56f4afdebf787b958c351a18ec084ae6e73bd04adf17b8fa: Status 404 returned error can't find the container with id cd8a5aa721386a0a56f4afdebf787b958c351a18ec084ae6e73bd04adf17b8fa
Jun 03 19:43:07.455600 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:07.455503    2563 generic.go:356] "Generic (PLEG): container finished" podID="02697ff8-adb8-4464-a774-cecd719976fe" containerID="ea4b4748bee7706f3269b3468a53d8e9a779e7d2733fb6033bed890b8cf4a827" exitCode=0
Jun 03 19:43:07.455600 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:07.455589    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02697ff8-adb8-4464-a774-cecd719976fe","Type":"ContainerDied","Data":"ea4b4748bee7706f3269b3468a53d8e9a779e7d2733fb6033bed890b8cf4a827"}
Jun 03 19:43:07.456043 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:07.455653    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02697ff8-adb8-4464-a774-cecd719976fe","Type":"ContainerStarted","Data":"cd8a5aa721386a0a56f4afdebf787b958c351a18ec084ae6e73bd04adf17b8fa"}
Jun 03 19:43:07.880717 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:07.880683    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab6364df-0756-4ad8-9591-02a3d1b80b68" path="/var/lib/kubelet/pods/ab6364df-0756-4ad8-9591-02a3d1b80b68/volumes"
Jun 03 19:43:08.465197 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.465164    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02697ff8-adb8-4464-a774-cecd719976fe","Type":"ContainerStarted","Data":"8be11f62ed430e7cdc997f94dab62bbcdfe370ef0c247cee93ea53dbb34a9506"}
Jun 03 19:43:08.465727 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.465247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02697ff8-adb8-4464-a774-cecd719976fe","Type":"ContainerStarted","Data":"4bf571a9c316285fea005d1ca80da8236b53f238e193ba7b2133b3fd491d7bfd"}
Jun 03 19:43:08.465727 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.465286    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02697ff8-adb8-4464-a774-cecd719976fe","Type":"ContainerStarted","Data":"cc1b19d2c11556c1f0dbb4318965867a643ee8d4d8180bba8bacc4d1f59a8e59"}
Jun 03 19:43:08.465727 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.465430    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02697ff8-adb8-4464-a774-cecd719976fe","Type":"ContainerStarted","Data":"5d35720768b6000d7b8bdccd35de8efa0baf74a3d06ed196eb2d07a74366a2f8"}
Jun 03 19:43:08.465727 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.465586    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02697ff8-adb8-4464-a774-cecd719976fe","Type":"ContainerStarted","Data":"a233883d0e159f74f184ca45349dae04c1621984bd0723fd0584d8f7d4740dba"}
Jun 03 19:43:08.465971 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.465627    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02697ff8-adb8-4464-a774-cecd719976fe","Type":"ContainerStarted","Data":"5b955269b8a7c55afe3bc5d36fceea9c0bda2a73f9882f348be9bf3d95dc2778"}
Jun 03 19:43:08.468220 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.468190    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"]
Jun 03 19:43:08.471266 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.471251    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.473939 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.473919    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jun 03 19:43:08.474061 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.473958    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jun 03 19:43:08.474061 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.473969    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jun 03 19:43:08.474183 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.474066    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wms9n\""
Jun 03 19:43:08.474183 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.474122    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jun 03 19:43:08.474284 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.474222    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jun 03 19:43:08.480100 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.480078    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jun 03 19:43:08.488899 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.487451    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"]
Jun 03 19:43:08.498429 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.498377    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.4730815919999998 podStartE2EDuration="2.498359051s" totalImagesPullingTime="0s" totalInitContainerRuntime="25.277459ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:43:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:43:08.497274262 +0000 UTC m=+115.087757647" watchObservedRunningTime="2026-06-03 19:43:08.498359051 +0000 UTC m=+115.088842513"
Jun 03 19:43:08.607690 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.607653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-secret-telemeter-client\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.607690 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.607693    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-metrics-client-ca\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.608005 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.607806    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-telemeter-trusted-ca-bundle\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.608005 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.607965    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-telemeter-client-tls\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.608144 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.608121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.608208 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.608167    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-serving-certs-ca-bundle\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.608208 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.608202    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w465x\" (UniqueName: \"kubernetes.io/projected/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-kube-api-access-w465x\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.608312 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.608262    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-federate-client-tls\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.709652 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.709609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-telemeter-client-tls\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.709812 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.709664    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.709812 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.709782    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-serving-certs-ca-bundle\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.709940 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.709817    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w465x\" (UniqueName: \"kubernetes.io/projected/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-kube-api-access-w465x\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.709940 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.709845    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-federate-client-tls\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.710012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.709948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-secret-telemeter-client\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.710012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.709998    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-metrics-client-ca\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.710106 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.710065    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-telemeter-trusted-ca-bundle\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.710652 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.710622    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-serving-certs-ca-bundle\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.711087 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.711058    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-metrics-client-ca\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.711175 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.711117    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-telemeter-trusted-ca-bundle\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.712417 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.712388    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-federate-client-tls\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.712563 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.712543    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.712638 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.712567    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-telemeter-client-tls\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.712638 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.712584    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-secret-telemeter-client\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.718372 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.718322    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w465x\" (UniqueName: \"kubernetes.io/projected/61c6a7f6-ba7a-4e94-bbbf-e5969c125194-kube-api-access-w465x\") pod \"telemeter-client-689ff59ffc-j9jq2\" (UID: \"61c6a7f6-ba7a-4e94-bbbf-e5969c125194\") " pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.750144 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.750104    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:43:08.750446 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.750410    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="config-reloader" containerID="cri-o://89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a" gracePeriod=600
Jun 03 19:43:08.750446 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.750430    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="thanos-sidecar" containerID="cri-o://30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59" gracePeriod=600
Jun 03 19:43:08.750663 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.750456    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="kube-rbac-proxy-thanos" containerID="cri-o://87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764" gracePeriod=600
Jun 03 19:43:08.750663 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.750410    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="kube-rbac-proxy" containerID="cri-o://072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43" gracePeriod=600
Jun 03 19:43:08.750663 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.750461    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="prometheus" containerID="cri-o://123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47" gracePeriod=600
Jun 03 19:43:08.750663 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.750504    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="kube-rbac-proxy-web" containerID="cri-o://b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403" gracePeriod=600
Jun 03 19:43:08.792443 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.792413    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"
Jun 03 19:43:08.939536 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:08.939501    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-689ff59ffc-j9jq2"]
Jun 03 19:43:08.943382 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:43:08.943346    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c6a7f6_ba7a_4e94_bbbf_e5969c125194.slice/crio-b880aea2a914dae00f51bae31167e142266f966b62110dce44dbc51e1ad875d9 WatchSource:0}: Error finding container b880aea2a914dae00f51bae31167e142266f966b62110dce44dbc51e1ad875d9: Status 404 returned error can't find the container with id b880aea2a914dae00f51bae31167e142266f966b62110dce44dbc51e1ad875d9
Jun 03 19:43:09.006316 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.006292    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.114263 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114221    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-thanos-prometheus-http-client-file\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114263 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114265    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-serving-certs-ca-bundle\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114501 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114294    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-kubelet-serving-ca-bundle\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114501 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114328    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-grpc-tls\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114501 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114358    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-db\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114501 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114385    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-1\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114501 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114413    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-web-config\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114501 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114445    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-metrics-client-certs\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114501 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114474    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114501 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114499    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f27d7c8b-482d-4d24-93a4-9ea4f4791374-tls-assets\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114920 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114534    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-kube-rbac-proxy\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114920 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114578    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-metrics-client-ca\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114920 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114610    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-tls\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114920 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114645    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f27d7c8b-482d-4d24-93a4-9ea4f4791374-config-out\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114920 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114671    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114920 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114706    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-config\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114920 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114750    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:43:09.114920 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114763    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bvtr\" (UniqueName: \"kubernetes.io/projected/f27d7c8b-482d-4d24-93a4-9ea4f4791374-kube-api-access-6bvtr\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114920 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114801    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-trusted-ca-bundle\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114920 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114825    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-0\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114920 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114855    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-2\") pod \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\" (UID: \"f27d7c8b-482d-4d24-93a4-9ea4f4791374\") "
Jun 03 19:43:09.114920 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.114847    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:43:09.115661 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.115120    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:43:09.115661 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.115205    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.115661 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.115223    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.115661 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.115240    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.115661 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.115386    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 19:43:09.115919 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.115755    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:43:09.116408 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.116152    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:43:09.117636 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.117550    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f27d7c8b-482d-4d24-93a4-9ea4f4791374-config-out" (OuterVolumeSpecName: "config-out") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 19:43:09.117636 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.117577    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:09.117817 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.117776    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:43:09.118091 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.118017    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:09.118670 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.118157    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:09.118789 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.118358    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f27d7c8b-482d-4d24-93a4-9ea4f4791374-kube-api-access-6bvtr" (OuterVolumeSpecName: "kube-api-access-6bvtr") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "kube-api-access-6bvtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:43:09.118789 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.118364    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:43:09.118789 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.118745    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:09.120123 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.120093    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f27d7c8b-482d-4d24-93a4-9ea4f4791374-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:43:09.120317 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.120278    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:09.120612 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.120588    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:09.120775 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.120759    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:09.120854 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.120833    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-config" (OuterVolumeSpecName: "config") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:09.128937 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.128897    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-web-config" (OuterVolumeSpecName: "web-config") pod "f27d7c8b-482d-4d24-93a4-9ea4f4791374" (UID: "f27d7c8b-482d-4d24-93a4-9ea4f4791374"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:09.216394 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.216362    2563 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-web-config\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.216394 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.216391    2563 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-metrics-client-certs\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.216394 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.216401    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.216643 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.216411    2563 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f27d7c8b-482d-4d24-93a4-9ea4f4791374-tls-assets\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.216643 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.216421    2563 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-kube-rbac-proxy\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.216643 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.216429    2563 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-configmap-metrics-client-ca\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.216643 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.216438    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.216643 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.216446    2563 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f27d7c8b-482d-4d24-93a4-9ea4f4791374-config-out\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.216643 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.216456    2563 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.216643 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.216464    2563 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-config\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.216643 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.216481    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bvtr\" (UniqueName: \"kubernetes.io/projected/f27d7c8b-482d-4d24-93a4-9ea4f4791374-kube-api-access-6bvtr\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.216643 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.216499    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.216643 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.216507    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.216643 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.216518    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.216643 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.216526    2563 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.216643 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.216534    2563 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f27d7c8b-482d-4d24-93a4-9ea4f4791374-secret-grpc-tls\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.216643 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.216542    2563 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f27d7c8b-482d-4d24-93a4-9ea4f4791374-prometheus-k8s-db\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:09.471935 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.471828    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2" event={"ID":"61c6a7f6-ba7a-4e94-bbbf-e5969c125194","Type":"ContainerStarted","Data":"b880aea2a914dae00f51bae31167e142266f966b62110dce44dbc51e1ad875d9"}
Jun 03 19:43:09.476090 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.476055    2563 generic.go:356] "Generic (PLEG): container finished" podID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerID="87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764" exitCode=0
Jun 03 19:43:09.476090 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.476087    2563 generic.go:356] "Generic (PLEG): container finished" podID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerID="072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43" exitCode=0
Jun 03 19:43:09.476090 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.476096    2563 generic.go:356] "Generic (PLEG): container finished" podID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerID="b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403" exitCode=0
Jun 03 19:43:09.476357 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.476104    2563 generic.go:356] "Generic (PLEG): container finished" podID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerID="30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59" exitCode=0
Jun 03 19:43:09.476357 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.476113    2563 generic.go:356] "Generic (PLEG): container finished" podID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerID="89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a" exitCode=0
Jun 03 19:43:09.476357 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.476120    2563 generic.go:356] "Generic (PLEG): container finished" podID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerID="123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47" exitCode=0
Jun 03 19:43:09.476357 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.476146    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f27d7c8b-482d-4d24-93a4-9ea4f4791374","Type":"ContainerDied","Data":"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764"}
Jun 03 19:43:09.476357 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.476233    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f27d7c8b-482d-4d24-93a4-9ea4f4791374","Type":"ContainerDied","Data":"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43"}
Jun 03 19:43:09.476357 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.476159    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.476357 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.476276    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f27d7c8b-482d-4d24-93a4-9ea4f4791374","Type":"ContainerDied","Data":"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403"}
Jun 03 19:43:09.476357 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.476323    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f27d7c8b-482d-4d24-93a4-9ea4f4791374","Type":"ContainerDied","Data":"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59"}
Jun 03 19:43:09.476357 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.476338    2563 scope.go:117] "RemoveContainer" containerID="87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764"
Jun 03 19:43:09.476757 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.476365    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f27d7c8b-482d-4d24-93a4-9ea4f4791374","Type":"ContainerDied","Data":"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a"}
Jun 03 19:43:09.476757 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.476406    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f27d7c8b-482d-4d24-93a4-9ea4f4791374","Type":"ContainerDied","Data":"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47"}
Jun 03 19:43:09.476757 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.476448    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f27d7c8b-482d-4d24-93a4-9ea4f4791374","Type":"ContainerDied","Data":"a4758e42b3cdb612b10985de1a5b3ea766ecf67b18c74a7798a664b8592b013e"}
Jun 03 19:43:09.520427 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.520407    2563 scope.go:117] "RemoveContainer" containerID="072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43"
Jun 03 19:43:09.529467 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.529441    2563 scope.go:117] "RemoveContainer" containerID="b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403"
Jun 03 19:43:09.539117 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.539082    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:43:09.539371 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.539347    2563 scope.go:117] "RemoveContainer" containerID="30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59"
Jun 03 19:43:09.543468 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.543445    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:43:09.547838 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.547816    2563 scope.go:117] "RemoveContainer" containerID="89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a"
Jun 03 19:43:09.556181 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.556162    2563 scope.go:117] "RemoveContainer" containerID="123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47"
Jun 03 19:43:09.564020 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.563999    2563 scope.go:117] "RemoveContainer" containerID="b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652"
Jun 03 19:43:09.572130 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572111    2563 scope.go:117] "RemoveContainer" containerID="87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764"
Jun 03 19:43:09.572335 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572317    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:43:09.572501 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:43:09.572468    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764\": container with ID starting with 87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764 not found: ID does not exist" containerID="87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764"
Jun 03 19:43:09.572609 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572509    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764"} err="failed to get container status \"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764\": rpc error: code = NotFound desc = could not find container \"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764\": container with ID starting with 87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764 not found: ID does not exist"
Jun 03 19:43:09.572609 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572530    2563 scope.go:117] "RemoveContainer" containerID="072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43"
Jun 03 19:43:09.572703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572645    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="thanos-sidecar"
Jun 03 19:43:09.572703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572661    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="thanos-sidecar"
Jun 03 19:43:09.572703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572672    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="kube-rbac-proxy"
Jun 03 19:43:09.572703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572680    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="kube-rbac-proxy"
Jun 03 19:43:09.572703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572698    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="config-reloader"
Jun 03 19:43:09.572703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572705    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="config-reloader"
Jun 03 19:43:09.572978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572718    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="prometheus"
Jun 03 19:43:09.572978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572724    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="prometheus"
Jun 03 19:43:09.572978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572730    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="kube-rbac-proxy-thanos"
Jun 03 19:43:09.572978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572737    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="kube-rbac-proxy-thanos"
Jun 03 19:43:09.572978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572745    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="init-config-reloader"
Jun 03 19:43:09.572978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572751    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="init-config-reloader"
Jun 03 19:43:09.572978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572757    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="kube-rbac-proxy-web"
Jun 03 19:43:09.572978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572762    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="kube-rbac-proxy-web"
Jun 03 19:43:09.572978 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:43:09.572784    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43\": container with ID starting with 072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43 not found: ID does not exist" containerID="072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43"
Jun 03 19:43:09.572978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572802    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43"} err="failed to get container status \"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43\": rpc error: code = NotFound desc = could not find container \"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43\": container with ID starting with 072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43 not found: ID does not exist"
Jun 03 19:43:09.572978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572814    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="prometheus"
Jun 03 19:43:09.572978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572829    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="kube-rbac-proxy-web"
Jun 03 19:43:09.572978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572838    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="config-reloader"
Jun 03 19:43:09.572978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572845    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="kube-rbac-proxy"
Jun 03 19:43:09.572978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572851    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="thanos-sidecar"
Jun 03 19:43:09.572978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572857    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" containerName="kube-rbac-proxy-thanos"
Jun 03 19:43:09.572978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.572815    2563 scope.go:117] "RemoveContainer" containerID="b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403"
Jun 03 19:43:09.573738 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:43:09.573199    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403\": container with ID starting with b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403 not found: ID does not exist" containerID="b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403"
Jun 03 19:43:09.573738 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.573217    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403"} err="failed to get container status \"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403\": rpc error: code = NotFound desc = could not find container \"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403\": container with ID starting with b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403 not found: ID does not exist"
Jun 03 19:43:09.573738 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.573231    2563 scope.go:117] "RemoveContainer" containerID="30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59"
Jun 03 19:43:09.573738 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:43:09.573471    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59\": container with ID starting with 30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59 not found: ID does not exist" containerID="30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59"
Jun 03 19:43:09.573738 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.573490    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59"} err="failed to get container status \"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59\": rpc error: code = NotFound desc = could not find container \"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59\": container with ID starting with 30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59 not found: ID does not exist"
Jun 03 19:43:09.573738 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.573503    2563 scope.go:117] "RemoveContainer" containerID="89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a"
Jun 03 19:43:09.574373 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:43:09.573758    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a\": container with ID starting with 89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a not found: ID does not exist" containerID="89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a"
Jun 03 19:43:09.574373 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.573791    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a"} err="failed to get container status \"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a\": rpc error: code = NotFound desc = could not find container \"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a\": container with ID starting with 89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a not found: ID does not exist"
Jun 03 19:43:09.574373 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.573814    2563 scope.go:117] "RemoveContainer" containerID="123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47"
Jun 03 19:43:09.574373 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:43:09.574117    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47\": container with ID starting with 123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47 not found: ID does not exist" containerID="123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47"
Jun 03 19:43:09.574373 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.574138    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47"} err="failed to get container status \"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47\": rpc error: code = NotFound desc = could not find container \"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47\": container with ID starting with 123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47 not found: ID does not exist"
Jun 03 19:43:09.574373 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.574156    2563 scope.go:117] "RemoveContainer" containerID="b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652"
Jun 03 19:43:09.574568 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:43:09.574412    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652\": container with ID starting with b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652 not found: ID does not exist" containerID="b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652"
Jun 03 19:43:09.574568 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.574431    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652"} err="failed to get container status \"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652\": rpc error: code = NotFound desc = could not find container \"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652\": container with ID starting with b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652 not found: ID does not exist"
Jun 03 19:43:09.574568 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.574445    2563 scope.go:117] "RemoveContainer" containerID="87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764"
Jun 03 19:43:09.574710 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.574693    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764"} err="failed to get container status \"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764\": rpc error: code = NotFound desc = could not find container \"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764\": container with ID starting with 87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764 not found: ID does not exist"
Jun 03 19:43:09.574746 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.574710    2563 scope.go:117] "RemoveContainer" containerID="072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43"
Jun 03 19:43:09.574987 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.574965    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43"} err="failed to get container status \"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43\": rpc error: code = NotFound desc = could not find container \"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43\": container with ID starting with 072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43 not found: ID does not exist"
Jun 03 19:43:09.574987 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.574984    2563 scope.go:117] "RemoveContainer" containerID="b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403"
Jun 03 19:43:09.575230 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.575212    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403"} err="failed to get container status \"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403\": rpc error: code = NotFound desc = could not find container \"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403\": container with ID starting with b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403 not found: ID does not exist"
Jun 03 19:43:09.575230 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.575229    2563 scope.go:117] "RemoveContainer" containerID="30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59"
Jun 03 19:43:09.575494 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.575475    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59"} err="failed to get container status \"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59\": rpc error: code = NotFound desc = could not find container \"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59\": container with ID starting with 30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59 not found: ID does not exist"
Jun 03 19:43:09.575561 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.575496    2563 scope.go:117] "RemoveContainer" containerID="89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a"
Jun 03 19:43:09.575742 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.575723    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a"} err="failed to get container status \"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a\": rpc error: code = NotFound desc = could not find container \"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a\": container with ID starting with 89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a not found: ID does not exist"
Jun 03 19:43:09.575797 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.575744    2563 scope.go:117] "RemoveContainer" containerID="123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47"
Jun 03 19:43:09.575993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.575973    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47"} err="failed to get container status \"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47\": rpc error: code = NotFound desc = could not find container \"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47\": container with ID starting with 123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47 not found: ID does not exist"
Jun 03 19:43:09.575993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.575989    2563 scope.go:117] "RemoveContainer" containerID="b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652"
Jun 03 19:43:09.576225 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.576203    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652"} err="failed to get container status \"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652\": rpc error: code = NotFound desc = could not find container \"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652\": container with ID starting with b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652 not found: ID does not exist"
Jun 03 19:43:09.576225 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.576224    2563 scope.go:117] "RemoveContainer" containerID="87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764"
Jun 03 19:43:09.576420 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.576400    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764"} err="failed to get container status \"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764\": rpc error: code = NotFound desc = could not find container \"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764\": container with ID starting with 87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764 not found: ID does not exist"
Jun 03 19:43:09.576503 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.576418    2563 scope.go:117] "RemoveContainer" containerID="072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43"
Jun 03 19:43:09.577169 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.576615    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43"} err="failed to get container status \"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43\": rpc error: code = NotFound desc = could not find container \"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43\": container with ID starting with 072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43 not found: ID does not exist"
Jun 03 19:43:09.577169 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.576632    2563 scope.go:117] "RemoveContainer" containerID="b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403"
Jun 03 19:43:09.577169 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.576823    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403"} err="failed to get container status \"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403\": rpc error: code = NotFound desc = could not find container \"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403\": container with ID starting with b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403 not found: ID does not exist"
Jun 03 19:43:09.577169 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.576836    2563 scope.go:117] "RemoveContainer" containerID="30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59"
Jun 03 19:43:09.577169 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.577038    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59"} err="failed to get container status \"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59\": rpc error: code = NotFound desc = could not find container \"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59\": container with ID starting with 30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59 not found: ID does not exist"
Jun 03 19:43:09.577169 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.577052    2563 scope.go:117] "RemoveContainer" containerID="89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a"
Jun 03 19:43:09.577484 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.577332    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.577484 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.577329    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a"} err="failed to get container status \"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a\": rpc error: code = NotFound desc = could not find container \"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a\": container with ID starting with 89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a not found: ID does not exist"
Jun 03 19:43:09.577484 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.577421    2563 scope.go:117] "RemoveContainer" containerID="123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47"
Jun 03 19:43:09.578014 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.577991    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47"} err="failed to get container status \"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47\": rpc error: code = NotFound desc = could not find container \"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47\": container with ID starting with 123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47 not found: ID does not exist"
Jun 03 19:43:09.578014 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.578012    2563 scope.go:117] "RemoveContainer" containerID="b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652"
Jun 03 19:43:09.578238 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.578218    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652"} err="failed to get container status \"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652\": rpc error: code = NotFound desc = could not find container \"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652\": container with ID starting with b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652 not found: ID does not exist"
Jun 03 19:43:09.578238 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.578238    2563 scope.go:117] "RemoveContainer" containerID="87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764"
Jun 03 19:43:09.578481 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.578461    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764"} err="failed to get container status \"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764\": rpc error: code = NotFound desc = could not find container \"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764\": container with ID starting with 87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764 not found: ID does not exist"
Jun 03 19:43:09.578481 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.578479    2563 scope.go:117] "RemoveContainer" containerID="072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43"
Jun 03 19:43:09.578719 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.578699    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43"} err="failed to get container status \"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43\": rpc error: code = NotFound desc = could not find container \"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43\": container with ID starting with 072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43 not found: ID does not exist"
Jun 03 19:43:09.578719 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.578718    2563 scope.go:117] "RemoveContainer" containerID="b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403"
Jun 03 19:43:09.579003 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.578978    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403"} err="failed to get container status \"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403\": rpc error: code = NotFound desc = could not find container \"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403\": container with ID starting with b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403 not found: ID does not exist"
Jun 03 19:43:09.579099 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.579004    2563 scope.go:117] "RemoveContainer" containerID="30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59"
Jun 03 19:43:09.579274 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.579249    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59"} err="failed to get container status \"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59\": rpc error: code = NotFound desc = could not find container \"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59\": container with ID starting with 30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59 not found: ID does not exist"
Jun 03 19:43:09.579274 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.579273    2563 scope.go:117] "RemoveContainer" containerID="89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a"
Jun 03 19:43:09.579510 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.579483    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a"} err="failed to get container status \"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a\": rpc error: code = NotFound desc = could not find container \"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a\": container with ID starting with 89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a not found: ID does not exist"
Jun 03 19:43:09.579510 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.579509    2563 scope.go:117] "RemoveContainer" containerID="123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47"
Jun 03 19:43:09.579742 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.579720    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47"} err="failed to get container status \"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47\": rpc error: code = NotFound desc = could not find container \"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47\": container with ID starting with 123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47 not found: ID does not exist"
Jun 03 19:43:09.579742 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.579741    2563 scope.go:117] "RemoveContainer" containerID="b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652"
Jun 03 19:43:09.579955 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.579921    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652"} err="failed to get container status \"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652\": rpc error: code = NotFound desc = could not find container \"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652\": container with ID starting with b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652 not found: ID does not exist"
Jun 03 19:43:09.579955 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.579947    2563 scope.go:117] "RemoveContainer" containerID="87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764"
Jun 03 19:43:09.580154 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.580136    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764"} err="failed to get container status \"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764\": rpc error: code = NotFound desc = could not find container \"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764\": container with ID starting with 87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764 not found: ID does not exist"
Jun 03 19:43:09.580210 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.580154    2563 scope.go:117] "RemoveContainer" containerID="072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43"
Jun 03 19:43:09.580210 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.580203    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 03 19:43:09.580397 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.580378    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43"} err="failed to get container status \"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43\": rpc error: code = NotFound desc = could not find container \"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43\": container with ID starting with 072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43 not found: ID does not exist"
Jun 03 19:43:09.580459 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.580397    2563 scope.go:117] "RemoveContainer" containerID="b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403"
Jun 03 19:43:09.580566 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.580550    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 03 19:43:09.580630 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.580586    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 03 19:43:09.580688 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.580636    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 03 19:43:09.580741 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.580683    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403"} err="failed to get container status \"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403\": rpc error: code = NotFound desc = could not find container \"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403\": container with ID starting with b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403 not found: ID does not exist"
Jun 03 19:43:09.580741 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.580708    2563 scope.go:117] "RemoveContainer" containerID="30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59"
Jun 03 19:43:09.580861 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.580812    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 03 19:43:09.581059 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.581041    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 03 19:43:09.581152 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.581104    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59"} err="failed to get container status \"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59\": rpc error: code = NotFound desc = could not find container \"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59\": container with ID starting with 30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59 not found: ID does not exist"
Jun 03 19:43:09.581152 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.581126    2563 scope.go:117] "RemoveContainer" containerID="89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a"
Jun 03 19:43:09.581152 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.581139    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 03 19:43:09.581306 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.581235    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 03 19:43:09.581503 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.581475    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jun 03 19:43:09.581609 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.581588    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 03 19:43:09.581684 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.581603    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 03 19:43:09.581684 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.581475    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jun 03 19:43:09.581684 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.581640    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a"} err="failed to get container status \"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a\": rpc error: code = NotFound desc = could not find container \"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a\": container with ID starting with 89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a not found: ID does not exist"
Jun 03 19:43:09.581842 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.581692    2563 scope.go:117] "RemoveContainer" containerID="123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47"
Jun 03 19:43:09.581975 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.581950    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lsdhl\""
Jun 03 19:43:09.582026 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.581968    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47"} err="failed to get container status \"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47\": rpc error: code = NotFound desc = could not find container \"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47\": container with ID starting with 123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47 not found: ID does not exist"
Jun 03 19:43:09.582026 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.581992    2563 scope.go:117] "RemoveContainer" containerID="b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652"
Jun 03 19:43:09.582509 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.582487    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652"} err="failed to get container status \"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652\": rpc error: code = NotFound desc = could not find container \"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652\": container with ID starting with b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652 not found: ID does not exist"
Jun 03 19:43:09.582571 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.582512    2563 scope.go:117] "RemoveContainer" containerID="87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764"
Jun 03 19:43:09.582825 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.582651    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4q7454cbq36ou\""
Jun 03 19:43:09.582928 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.582819    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764"} err="failed to get container status \"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764\": rpc error: code = NotFound desc = could not find container \"87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764\": container with ID starting with 87afa6fb347b19890a0e29446a1b08c54de826032ab1d275bbcc2c640862e764 not found: ID does not exist"
Jun 03 19:43:09.582928 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.582839    2563 scope.go:117] "RemoveContainer" containerID="072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43"
Jun 03 19:43:09.583049 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.583004    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 03 19:43:09.583124 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.583097    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43"} err="failed to get container status \"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43\": rpc error: code = NotFound desc = could not find container \"072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43\": container with ID starting with 072df5829bc7bc0f724acbc3c8836989d77179407a400e562e653741119a7b43 not found: ID does not exist"
Jun 03 19:43:09.583176 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.583127    2563 scope.go:117] "RemoveContainer" containerID="b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403"
Jun 03 19:43:09.583411 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.583384    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403"} err="failed to get container status \"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403\": rpc error: code = NotFound desc = could not find container \"b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403\": container with ID starting with b871838c995e4c1a302255ed72e344866056dca82c611201695972692b805403 not found: ID does not exist"
Jun 03 19:43:09.583495 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.583414    2563 scope.go:117] "RemoveContainer" containerID="30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59"
Jun 03 19:43:09.584353 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.584059    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59"} err="failed to get container status \"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59\": rpc error: code = NotFound desc = could not find container \"30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59\": container with ID starting with 30601e449f3ada2d4bf1d777441d903c918b78be08000d07dcda5fcf3e1a4c59 not found: ID does not exist"
Jun 03 19:43:09.584353 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.584087    2563 scope.go:117] "RemoveContainer" containerID="89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a"
Jun 03 19:43:09.584353 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.584152    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 03 19:43:09.584353 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.584337    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a"} err="failed to get container status \"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a\": rpc error: code = NotFound desc = could not find container \"89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a\": container with ID starting with 89e7940ce29f7eafa3b8da4d2b460ffb307923a71866ff87574a9e1db509979a not found: ID does not exist"
Jun 03 19:43:09.584353 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.584355    2563 scope.go:117] "RemoveContainer" containerID="123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47"
Jun 03 19:43:09.585125 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.585102    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47"} err="failed to get container status \"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47\": rpc error: code = NotFound desc = could not find container \"123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47\": container with ID starting with 123ee84a44b6efa42415d44d078803721d0a0af5fa79084278a5f32ed03b1f47 not found: ID does not exist"
Jun 03 19:43:09.585306 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.585126    2563 scope.go:117] "RemoveContainer" containerID="b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652"
Jun 03 19:43:09.585508 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.585478    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652"} err="failed to get container status \"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652\": rpc error: code = NotFound desc = could not find container \"b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652\": container with ID starting with b91a8635d65de494f0c55bb4c12e2fb9e6663521bf3b2e64fc31248fb18f7652 not found: ID does not exist"
Jun 03 19:43:09.587192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.586957    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 03 19:43:09.598584 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.598538    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:43:09.721493 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.721453    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.721652 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.721503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.721652 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.721530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.721652 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.721622    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.721773 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.721675    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-config\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.721773 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.721708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e494e0fd-7f9c-46ee-aba2-8acae486536f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.721773 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.721751    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.721971 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.721780    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.721971 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.721803    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.721971 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.721825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.721971 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.721846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-web-config\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.721971 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.721925    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e494e0fd-7f9c-46ee-aba2-8acae486536f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.721971 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.721953    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e494e0fd-7f9c-46ee-aba2-8acae486536f-config-out\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.722199 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.722027    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.722199 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.722049    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.722199 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.722066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w6b8\" (UniqueName: \"kubernetes.io/projected/e494e0fd-7f9c-46ee-aba2-8acae486536f-kube-api-access-8w6b8\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.722199 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.722084    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.722199 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.722112    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.722199 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.722163    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.722199 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.722196    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823081 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823038    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-config\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823081 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823084    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e494e0fd-7f9c-46ee-aba2-8acae486536f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823332 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823332 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823332 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823175    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823332 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823204    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823332 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823228    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-web-config\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823332 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823245    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e494e0fd-7f9c-46ee-aba2-8acae486536f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823332 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e494e0fd-7f9c-46ee-aba2-8acae486536f-config-out\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823332 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823298    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823332 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823700 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823348    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w6b8\" (UniqueName: \"kubernetes.io/projected/e494e0fd-7f9c-46ee-aba2-8acae486536f-kube-api-access-8w6b8\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823700 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823700 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823403    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823700 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823700 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823700 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823496    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823700 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823521    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e494e0fd-7f9c-46ee-aba2-8acae486536f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823700 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823700 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.823700 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.823631    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.824433 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.824224    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.824433 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.824233    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.824847 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.824821    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.824969 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.824945    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.827859 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.826682    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.827859 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.826941    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-config\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.827859 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.827086    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e494e0fd-7f9c-46ee-aba2-8acae486536f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.827859 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.827249    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-web-config\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.827859 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.827314    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.827859 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.827586    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.827859 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.827800    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.828839 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.828436    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.828839 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.828796    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.829119 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.829093    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e494e0fd-7f9c-46ee-aba2-8acae486536f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.829482 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.829460    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.829634 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.829612    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.829892 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.829843    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e494e0fd-7f9c-46ee-aba2-8acae486536f-config-out\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.830053 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.830032    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e494e0fd-7f9c-46ee-aba2-8acae486536f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.833259 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.833237    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w6b8\" (UniqueName: \"kubernetes.io/projected/e494e0fd-7f9c-46ee-aba2-8acae486536f-kube-api-access-8w6b8\") pod \"prometheus-k8s-0\" (UID: \"e494e0fd-7f9c-46ee-aba2-8acae486536f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:09.884541 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.884492    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f27d7c8b-482d-4d24-93a4-9ea4f4791374" path="/var/lib/kubelet/pods/f27d7c8b-482d-4d24-93a4-9ea4f4791374/volumes"
Jun 03 19:43:09.894111 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:09.894074    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:10.057764 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:10.057729    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 03 19:43:10.058507 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:43:10.058474    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode494e0fd_7f9c_46ee_aba2_8acae486536f.slice/crio-6b2431ba701bbcb5d738bac4078f263179b807000cf5098b1909462dc97a9260 WatchSource:0}: Error finding container 6b2431ba701bbcb5d738bac4078f263179b807000cf5098b1909462dc97a9260: Status 404 returned error can't find the container with id 6b2431ba701bbcb5d738bac4078f263179b807000cf5098b1909462dc97a9260
Jun 03 19:43:10.484105 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:10.484057    2563 generic.go:356] "Generic (PLEG): container finished" podID="e494e0fd-7f9c-46ee-aba2-8acae486536f" containerID="b7f645fefcced1f98034e082dc9747d2d94d06e422e9010c22ec86554c9a4955" exitCode=0
Jun 03 19:43:10.484559 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:10.484147    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e494e0fd-7f9c-46ee-aba2-8acae486536f","Type":"ContainerDied","Data":"b7f645fefcced1f98034e082dc9747d2d94d06e422e9010c22ec86554c9a4955"}
Jun 03 19:43:10.484559 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:10.484241    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e494e0fd-7f9c-46ee-aba2-8acae486536f","Type":"ContainerStarted","Data":"6b2431ba701bbcb5d738bac4078f263179b807000cf5098b1909462dc97a9260"}
Jun 03 19:43:11.492045 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:11.492007    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e494e0fd-7f9c-46ee-aba2-8acae486536f","Type":"ContainerStarted","Data":"3bfd5c6f928ea48516d9758dbe25e4d939db87cc630b6fe0b9987d303ed313d3"}
Jun 03 19:43:11.492480 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:11.492114    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e494e0fd-7f9c-46ee-aba2-8acae486536f","Type":"ContainerStarted","Data":"232dbecd1e643a022ebd2190e6f3a405f8f3633f171caa2d28903480fccf2aa1"}
Jun 03 19:43:11.492480 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:11.492157    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e494e0fd-7f9c-46ee-aba2-8acae486536f","Type":"ContainerStarted","Data":"d644b7deaf4f3ccd33f635ee412de2f4a34870758c75a260ef275a89174b5ba6"}
Jun 03 19:43:11.492480 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:11.492185    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e494e0fd-7f9c-46ee-aba2-8acae486536f","Type":"ContainerStarted","Data":"411c67e604ca24b1054c8b31dfcaeda2fe193aa399d2fc640bb3895ffe3dcc54"}
Jun 03 19:43:11.492480 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:11.492219    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e494e0fd-7f9c-46ee-aba2-8acae486536f","Type":"ContainerStarted","Data":"27f528783c223b4bde8a1f19e5fe09f133c2c9c6390feaa471c8d1ac0e235ac4"}
Jun 03 19:43:11.492480 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:11.492245    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e494e0fd-7f9c-46ee-aba2-8acae486536f","Type":"ContainerStarted","Data":"c9fbb150b002197df3dc8b2d28a78f6256a910dae63e5dd08ab701a9b191b307"}
Jun 03 19:43:11.494158 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:11.494128    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2" event={"ID":"61c6a7f6-ba7a-4e94-bbbf-e5969c125194","Type":"ContainerStarted","Data":"549b82fe99c44c2393a8d0a222d56218f3769ab3e9a0f6c0b378a37dcd893eaf"}
Jun 03 19:43:11.494273 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:11.494184    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2" event={"ID":"61c6a7f6-ba7a-4e94-bbbf-e5969c125194","Type":"ContainerStarted","Data":"efb0a0e615f5c889c85a0d1ed0116d865053e4b1ee31f4c849797022d74317cd"}
Jun 03 19:43:11.494273 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:11.494205    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2" event={"ID":"61c6a7f6-ba7a-4e94-bbbf-e5969c125194","Type":"ContainerStarted","Data":"547a4c3394d1c4e9bd41bcec7201777183f0c2a7efa2324f3169f8309c1772c5"}
Jun 03 19:43:11.522084 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:11.521974    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.503607975 podStartE2EDuration="2.521957459s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.349484ms" isStatefulPod=false podCreationTimestamp="2026-06-03 19:43:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:43:11.520244226 +0000 UTC m=+118.110727628" watchObservedRunningTime="2026-06-03 19:43:11.521957459 +0000 UTC m=+118.112440901"
Jun 03 19:43:11.546771 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:11.546711    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-689ff59ffc-j9jq2" podStartSLOduration=1.451011512 podStartE2EDuration="3.546693189s" totalImagesPullingTime="2.095681677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:43:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:43:11.545985007 +0000 UTC m=+118.136468398" watchObservedRunningTime="2026-06-03 19:43:11.546693189 +0000 UTC m=+118.137176581"
Jun 03 19:43:12.277562 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.277523    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-875759b67-xgs7l"]
Jun 03 19:43:12.280598 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.280581    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.292887 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.292837    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-875759b67-xgs7l"]
Jun 03 19:43:12.326682 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.326637    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:43:12.347850 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.347817    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-serving-cert\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.347963 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.347943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-service-ca\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.347997 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.347982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-config\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.348034 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.348012    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-oauth-config\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.348102 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.348053    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-oauth-serving-cert\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.348102 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.348071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss56z\" (UniqueName: \"kubernetes.io/projected/985f704a-42b1-414e-9563-bcf46b6eb9e3-kube-api-access-ss56z\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.348192 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.348166    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-trusted-ca-bundle\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.392105 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.392071    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:43:12.449429 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.449396    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-config\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.449602 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.449437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-oauth-config\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.449602 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.449459    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-oauth-serving-cert\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.449602 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.449500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss56z\" (UniqueName: \"kubernetes.io/projected/985f704a-42b1-414e-9563-bcf46b6eb9e3-kube-api-access-ss56z\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.449757 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.449634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-trusted-ca-bundle\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.449809 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.449763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-serving-cert\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.449863 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.449807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-service-ca\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.450311 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.450282    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-oauth-serving-cert\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.450311 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.450294    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-config\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.450535 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.450513    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-service-ca\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.450576 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.450513    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-trusted-ca-bundle\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.452210 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.452191    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-oauth-config\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.452325 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.452294    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-serving-cert\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.459353 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.459326    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss56z\" (UniqueName: \"kubernetes.io/projected/985f704a-42b1-414e-9563-bcf46b6eb9e3-kube-api-access-ss56z\") pod \"console-875759b67-xgs7l\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") " pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.591093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.591005    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:12.735508 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.735308    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-875759b67-xgs7l"]
Jun 03 19:43:12.738651 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:43:12.738614    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod985f704a_42b1_414e_9563_bcf46b6eb9e3.slice/crio-79dbb50d33766a31d13140aa3ad102ea29c355ea69a16351efb63ebf32b08f5c WatchSource:0}: Error finding container 79dbb50d33766a31d13140aa3ad102ea29c355ea69a16351efb63ebf32b08f5c: Status 404 returned error can't find the container with id 79dbb50d33766a31d13140aa3ad102ea29c355ea69a16351efb63ebf32b08f5c
Jun 03 19:43:12.741193 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:12.741141    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:43:13.505157 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:13.505117    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-875759b67-xgs7l" event={"ID":"985f704a-42b1-414e-9563-bcf46b6eb9e3","Type":"ContainerStarted","Data":"8a4ee699c2124a0062787220a6c5cd430292d0cf83cc3285956e7d1f09e25281"}
Jun 03 19:43:13.505343 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:13.505175    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-875759b67-xgs7l" event={"ID":"985f704a-42b1-414e-9563-bcf46b6eb9e3","Type":"ContainerStarted","Data":"79dbb50d33766a31d13140aa3ad102ea29c355ea69a16351efb63ebf32b08f5c"}
Jun 03 19:43:13.525552 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:13.525490    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-875759b67-xgs7l" podStartSLOduration=1.525473286 podStartE2EDuration="1.525473286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:43:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:43:13.524258448 +0000 UTC m=+120.114741840" watchObservedRunningTime="2026-06-03 19:43:13.525473286 +0000 UTC m=+120.115956675"
Jun 03 19:43:14.894391 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:14.894335    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:43:22.591378 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:22.591331    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:22.591799 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:22.591407    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:22.596146 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:22.596118    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:23.547570 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:23.547540    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:43:23.591674 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:23.591638    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568bdb8585-2jbpz"]
Jun 03 19:43:23.727116 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:23.727081    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:43:23.818704 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:23.818619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:43:48.614391 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:48.614320    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-568bdb8585-2jbpz" podUID="a775df99-6533-49aa-b52a-7fe8701e9a9a" containerName="console" containerID="cri-o://6d943ed4720ac95323b1ca3d72702d5170b94ab858a59f5432af4dfa1d10928e" gracePeriod=15
Jun 03 19:43:48.854180 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:48.854152    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:43:48.976904 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:48.976761    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-service-ca\") pod \"a775df99-6533-49aa-b52a-7fe8701e9a9a\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") "
Jun 03 19:43:48.976904 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:48.976835    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-oauth-config\") pod \"a775df99-6533-49aa-b52a-7fe8701e9a9a\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") "
Jun 03 19:43:48.976904 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:48.976892    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n84g5\" (UniqueName: \"kubernetes.io/projected/a775df99-6533-49aa-b52a-7fe8701e9a9a-kube-api-access-n84g5\") pod \"a775df99-6533-49aa-b52a-7fe8701e9a9a\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") "
Jun 03 19:43:48.976904 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:48.976911    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-serving-cert\") pod \"a775df99-6533-49aa-b52a-7fe8701e9a9a\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") "
Jun 03 19:43:48.977260 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:48.976939    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-trusted-ca-bundle\") pod \"a775df99-6533-49aa-b52a-7fe8701e9a9a\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") "
Jun 03 19:43:48.977260 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:48.976977    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-oauth-serving-cert\") pod \"a775df99-6533-49aa-b52a-7fe8701e9a9a\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") "
Jun 03 19:43:48.977260 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:48.977001    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-config\") pod \"a775df99-6533-49aa-b52a-7fe8701e9a9a\" (UID: \"a775df99-6533-49aa-b52a-7fe8701e9a9a\") "
Jun 03 19:43:48.977403 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:48.977279    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-service-ca" (OuterVolumeSpecName: "service-ca") pod "a775df99-6533-49aa-b52a-7fe8701e9a9a" (UID: "a775df99-6533-49aa-b52a-7fe8701e9a9a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:43:48.977520 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:48.977488    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a775df99-6533-49aa-b52a-7fe8701e9a9a" (UID: "a775df99-6533-49aa-b52a-7fe8701e9a9a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:43:48.977558 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:48.977505    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a775df99-6533-49aa-b52a-7fe8701e9a9a" (UID: "a775df99-6533-49aa-b52a-7fe8701e9a9a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:43:48.977558 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:48.977495    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-config" (OuterVolumeSpecName: "console-config") pod "a775df99-6533-49aa-b52a-7fe8701e9a9a" (UID: "a775df99-6533-49aa-b52a-7fe8701e9a9a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:43:48.979319 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:48.979273    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a775df99-6533-49aa-b52a-7fe8701e9a9a" (UID: "a775df99-6533-49aa-b52a-7fe8701e9a9a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:48.979319 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:48.979305    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a775df99-6533-49aa-b52a-7fe8701e9a9a-kube-api-access-n84g5" (OuterVolumeSpecName: "kube-api-access-n84g5") pod "a775df99-6533-49aa-b52a-7fe8701e9a9a" (UID: "a775df99-6533-49aa-b52a-7fe8701e9a9a"). InnerVolumeSpecName "kube-api-access-n84g5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:43:48.979458 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:48.979366    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a775df99-6533-49aa-b52a-7fe8701e9a9a" (UID: "a775df99-6533-49aa-b52a-7fe8701e9a9a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:43:49.077888 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:49.077833    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-oauth-serving-cert\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:49.077888 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:49.077892    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-config\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:49.078085 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:49.077903    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-service-ca\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:49.078085 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:49.077912    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-oauth-config\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:49.078085 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:49.077920    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n84g5\" (UniqueName: \"kubernetes.io/projected/a775df99-6533-49aa-b52a-7fe8701e9a9a-kube-api-access-n84g5\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:49.078085 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:49.077930    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a775df99-6533-49aa-b52a-7fe8701e9a9a-console-serving-cert\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:49.078085 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:49.077939    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a775df99-6533-49aa-b52a-7fe8701e9a9a-trusted-ca-bundle\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:43:49.643575 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:49.643537    2563 generic.go:356] "Generic (PLEG): container finished" podID="a775df99-6533-49aa-b52a-7fe8701e9a9a" containerID="6d943ed4720ac95323b1ca3d72702d5170b94ab858a59f5432af4dfa1d10928e" exitCode=0
Jun 03 19:43:49.643575 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:49.643584    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568bdb8585-2jbpz"
Jun 03 19:43:49.644148 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:49.643633    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568bdb8585-2jbpz" event={"ID":"a775df99-6533-49aa-b52a-7fe8701e9a9a","Type":"ContainerDied","Data":"6d943ed4720ac95323b1ca3d72702d5170b94ab858a59f5432af4dfa1d10928e"}
Jun 03 19:43:49.644148 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:49.643689    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568bdb8585-2jbpz" event={"ID":"a775df99-6533-49aa-b52a-7fe8701e9a9a","Type":"ContainerDied","Data":"944d62b6ea2bcd832a04b91a56386996deed2db1281df1c99180209daabd937a"}
Jun 03 19:43:49.644148 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:49.643712    2563 scope.go:117] "RemoveContainer" containerID="6d943ed4720ac95323b1ca3d72702d5170b94ab858a59f5432af4dfa1d10928e"
Jun 03 19:43:49.653219 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:49.653196    2563 scope.go:117] "RemoveContainer" containerID="6d943ed4720ac95323b1ca3d72702d5170b94ab858a59f5432af4dfa1d10928e"
Jun 03 19:43:49.653544 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:43:49.653525    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d943ed4720ac95323b1ca3d72702d5170b94ab858a59f5432af4dfa1d10928e\": container with ID starting with 6d943ed4720ac95323b1ca3d72702d5170b94ab858a59f5432af4dfa1d10928e not found: ID does not exist" containerID="6d943ed4720ac95323b1ca3d72702d5170b94ab858a59f5432af4dfa1d10928e"
Jun 03 19:43:49.653598 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:49.653557    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d943ed4720ac95323b1ca3d72702d5170b94ab858a59f5432af4dfa1d10928e"} err="failed to get container status \"6d943ed4720ac95323b1ca3d72702d5170b94ab858a59f5432af4dfa1d10928e\": rpc error: code = NotFound desc = could not find container \"6d943ed4720ac95323b1ca3d72702d5170b94ab858a59f5432af4dfa1d10928e\": container with ID starting with 6d943ed4720ac95323b1ca3d72702d5170b94ab858a59f5432af4dfa1d10928e not found: ID does not exist"
Jun 03 19:43:49.676342 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:49.676310    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-568bdb8585-2jbpz"]
Jun 03 19:43:49.679048 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:49.679019    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-568bdb8585-2jbpz"]
Jun 03 19:43:49.880139 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:43:49.880097    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a775df99-6533-49aa-b52a-7fe8701e9a9a" path="/var/lib/kubelet/pods/a775df99-6533-49aa-b52a-7fe8701e9a9a/volumes"
Jun 03 19:44:09.895288 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:09.895246    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:44:09.911928 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:09.911898    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:44:10.742914 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:10.742850    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 03 19:44:18.655104 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:18.655064    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:44:18.707631 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:18.707600    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:44:23.557908 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:23.557848    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:44:23.617013 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:23.616983    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:44:25.242229 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.242197    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f79787f74-dqp8n"]
Jun 03 19:44:25.242610 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.242491    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a775df99-6533-49aa-b52a-7fe8701e9a9a" containerName="console"
Jun 03 19:44:25.242610 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.242502    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a775df99-6533-49aa-b52a-7fe8701e9a9a" containerName="console"
Jun 03 19:44:25.242610 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.242570    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a775df99-6533-49aa-b52a-7fe8701e9a9a" containerName="console"
Jun 03 19:44:25.245361 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.245343    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.259196 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.259164    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f79787f74-dqp8n"]
Jun 03 19:44:25.283274 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.283237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-config\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.283274 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.283270    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-service-ca\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.283503 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.283299    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-oauth-serving-cert\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.283503 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.283366    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-trusted-ca-bundle\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.283503 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.283396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-oauth-config\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.283503 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.283419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-serving-cert\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.283503 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.283437    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kfff\" (UniqueName: \"kubernetes.io/projected/5421efc8-00fd-496e-bc96-c91dca3d2ac5-kube-api-access-8kfff\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.301049 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.301012    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:44:25.360069 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.360033    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:44:25.383882 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.383828    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kfff\" (UniqueName: \"kubernetes.io/projected/5421efc8-00fd-496e-bc96-c91dca3d2ac5-kube-api-access-8kfff\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.384008 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.383954    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-config\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.384008 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.383981    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-service-ca\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.384156 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.384022    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-oauth-serving-cert\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.384156 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.384081    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-trusted-ca-bundle\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.384156 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.384116    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-oauth-config\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.384156 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.384149    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-serving-cert\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.384849 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.384814    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-config\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.385163 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.384814    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-service-ca\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.385163 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.384955    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-oauth-serving-cert\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.385163 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.385016    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-trusted-ca-bundle\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.386655 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.386629    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-serving-cert\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.386811 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.386793    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-oauth-config\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.393380 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.393352    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kfff\" (UniqueName: \"kubernetes.io/projected/5421efc8-00fd-496e-bc96-c91dca3d2ac5-kube-api-access-8kfff\") pod \"console-7f79787f74-dqp8n\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") " pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.437597 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.437564    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:44:25.492956 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.492845    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:44:25.556012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.555969    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:25.698591 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.698564    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f79787f74-dqp8n"]
Jun 03 19:44:25.700821 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:44:25.700796    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5421efc8_00fd_496e_bc96_c91dca3d2ac5.slice/crio-27cf4e1cb4a866eace1d3a39320d410e193f7d49b3c6a01d3d03041fe728a209 WatchSource:0}: Error finding container 27cf4e1cb4a866eace1d3a39320d410e193f7d49b3c6a01d3d03041fe728a209: Status 404 returned error can't find the container with id 27cf4e1cb4a866eace1d3a39320d410e193f7d49b3c6a01d3d03041fe728a209
Jun 03 19:44:25.783272 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.783238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f79787f74-dqp8n" event={"ID":"5421efc8-00fd-496e-bc96-c91dca3d2ac5","Type":"ContainerStarted","Data":"5530b48d5b543bf47e1a227f9d493e76bd8a14a246449612919c4eda889740a2"}
Jun 03 19:44:25.783477 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.783298    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f79787f74-dqp8n" event={"ID":"5421efc8-00fd-496e-bc96-c91dca3d2ac5","Type":"ContainerStarted","Data":"27cf4e1cb4a866eace1d3a39320d410e193f7d49b3c6a01d3d03041fe728a209"}
Jun 03 19:44:25.804346 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:25.804281    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f79787f74-dqp8n" podStartSLOduration=0.804261701 podStartE2EDuration="804.261701ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:44:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:44:25.803263984 +0000 UTC m=+192.393747373" watchObservedRunningTime="2026-06-03 19:44:25.804261701 +0000 UTC m=+192.394745093"
Jun 03 19:44:26.036944 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:26.036835    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:44:30.567962 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:30.567923    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:44:30.622314 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:30.622278    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:44:35.557072 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:35.557023    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:35.557488 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:35.557120    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:35.562088 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:35.562060    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:35.823900 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:35.823794    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:44:35.873416 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:35.873383    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-875759b67-xgs7l"]
Jun 03 19:44:35.977927 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:35.977890    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:44:36.084310 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:36.084224    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:44:36.143724 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:36.143687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:44:43.595107 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:43.595061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:44:43.697668 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:43.697629    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:44:43.762672 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:44:43.762638    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:00.003464 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:00.003425    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:00.097555 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:00.097507    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:00.895203 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:00.895150    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-875759b67-xgs7l" podUID="985f704a-42b1-414e-9563-bcf46b6eb9e3" containerName="console" containerID="cri-o://8a4ee699c2124a0062787220a6c5cd430292d0cf83cc3285956e7d1f09e25281" gracePeriod=15
Jun 03 19:45:01.134472 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.134446    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:45:01.305322 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.305280    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-oauth-config\") pod \"985f704a-42b1-414e-9563-bcf46b6eb9e3\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") "
Jun 03 19:45:01.305524 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.305333    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-config\") pod \"985f704a-42b1-414e-9563-bcf46b6eb9e3\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") "
Jun 03 19:45:01.305524 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.305357    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-service-ca\") pod \"985f704a-42b1-414e-9563-bcf46b6eb9e3\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") "
Jun 03 19:45:01.305524 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.305383    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-serving-cert\") pod \"985f704a-42b1-414e-9563-bcf46b6eb9e3\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") "
Jun 03 19:45:01.305524 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.305436    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-trusted-ca-bundle\") pod \"985f704a-42b1-414e-9563-bcf46b6eb9e3\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") "
Jun 03 19:45:01.305524 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.305506    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ss56z\" (UniqueName: \"kubernetes.io/projected/985f704a-42b1-414e-9563-bcf46b6eb9e3-kube-api-access-ss56z\") pod \"985f704a-42b1-414e-9563-bcf46b6eb9e3\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") "
Jun 03 19:45:01.305768 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.305554    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-oauth-serving-cert\") pod \"985f704a-42b1-414e-9563-bcf46b6eb9e3\" (UID: \"985f704a-42b1-414e-9563-bcf46b6eb9e3\") "
Jun 03 19:45:01.305820 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.305790    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-service-ca" (OuterVolumeSpecName: "service-ca") pod "985f704a-42b1-414e-9563-bcf46b6eb9e3" (UID: "985f704a-42b1-414e-9563-bcf46b6eb9e3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:45:01.305913 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.305798    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-config" (OuterVolumeSpecName: "console-config") pod "985f704a-42b1-414e-9563-bcf46b6eb9e3" (UID: "985f704a-42b1-414e-9563-bcf46b6eb9e3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:45:01.305992 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.305965    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "985f704a-42b1-414e-9563-bcf46b6eb9e3" (UID: "985f704a-42b1-414e-9563-bcf46b6eb9e3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:45:01.306163 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.306143    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "985f704a-42b1-414e-9563-bcf46b6eb9e3" (UID: "985f704a-42b1-414e-9563-bcf46b6eb9e3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:45:01.307788 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.307758    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "985f704a-42b1-414e-9563-bcf46b6eb9e3" (UID: "985f704a-42b1-414e-9563-bcf46b6eb9e3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:45:01.307788 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.307772    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/985f704a-42b1-414e-9563-bcf46b6eb9e3-kube-api-access-ss56z" (OuterVolumeSpecName: "kube-api-access-ss56z") pod "985f704a-42b1-414e-9563-bcf46b6eb9e3" (UID: "985f704a-42b1-414e-9563-bcf46b6eb9e3"). InnerVolumeSpecName "kube-api-access-ss56z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:45:01.308055 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.307808    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "985f704a-42b1-414e-9563-bcf46b6eb9e3" (UID: "985f704a-42b1-414e-9563-bcf46b6eb9e3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:45:01.407144 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.407098    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-trusted-ca-bundle\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:45:01.407144 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.407133    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss56z\" (UniqueName: \"kubernetes.io/projected/985f704a-42b1-414e-9563-bcf46b6eb9e3-kube-api-access-ss56z\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:45:01.407144 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.407144    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-oauth-serving-cert\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:45:01.407144 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.407153    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-oauth-config\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:45:01.407420 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.407162    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-config\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:45:01.407420 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.407171    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/985f704a-42b1-414e-9563-bcf46b6eb9e3-service-ca\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:45:01.407420 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.407178    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/985f704a-42b1-414e-9563-bcf46b6eb9e3-console-serving-cert\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:45:01.918569 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.918534    2563 generic.go:356] "Generic (PLEG): container finished" podID="985f704a-42b1-414e-9563-bcf46b6eb9e3" containerID="8a4ee699c2124a0062787220a6c5cd430292d0cf83cc3285956e7d1f09e25281" exitCode=0
Jun 03 19:45:01.918774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.918576    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-875759b67-xgs7l"
Jun 03 19:45:01.918774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.918607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-875759b67-xgs7l" event={"ID":"985f704a-42b1-414e-9563-bcf46b6eb9e3","Type":"ContainerDied","Data":"8a4ee699c2124a0062787220a6c5cd430292d0cf83cc3285956e7d1f09e25281"}
Jun 03 19:45:01.918774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.918659    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-875759b67-xgs7l" event={"ID":"985f704a-42b1-414e-9563-bcf46b6eb9e3","Type":"ContainerDied","Data":"79dbb50d33766a31d13140aa3ad102ea29c355ea69a16351efb63ebf32b08f5c"}
Jun 03 19:45:01.918774 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.918685    2563 scope.go:117] "RemoveContainer" containerID="8a4ee699c2124a0062787220a6c5cd430292d0cf83cc3285956e7d1f09e25281"
Jun 03 19:45:01.927784 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.927764    2563 scope.go:117] "RemoveContainer" containerID="8a4ee699c2124a0062787220a6c5cd430292d0cf83cc3285956e7d1f09e25281"
Jun 03 19:45:01.928153 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:45:01.928134    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a4ee699c2124a0062787220a6c5cd430292d0cf83cc3285956e7d1f09e25281\": container with ID starting with 8a4ee699c2124a0062787220a6c5cd430292d0cf83cc3285956e7d1f09e25281 not found: ID does not exist" containerID="8a4ee699c2124a0062787220a6c5cd430292d0cf83cc3285956e7d1f09e25281"
Jun 03 19:45:01.928228 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.928167    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a4ee699c2124a0062787220a6c5cd430292d0cf83cc3285956e7d1f09e25281"} err="failed to get container status \"8a4ee699c2124a0062787220a6c5cd430292d0cf83cc3285956e7d1f09e25281\": rpc error: code = NotFound desc = could not find container \"8a4ee699c2124a0062787220a6c5cd430292d0cf83cc3285956e7d1f09e25281\": container with ID starting with 8a4ee699c2124a0062787220a6c5cd430292d0cf83cc3285956e7d1f09e25281 not found: ID does not exist"
Jun 03 19:45:01.935635 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.935595    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-875759b67-xgs7l"]
Jun 03 19:45:01.939185 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:01.939157    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-875759b67-xgs7l"]
Jun 03 19:45:03.879923 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:03.879864    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="985f704a-42b1-414e-9563-bcf46b6eb9e3" path="/var/lib/kubelet/pods/985f704a-42b1-414e-9563-bcf46b6eb9e3/volumes"
Jun 03 19:45:21.042154 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:21.042122    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:21.142638 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:21.142599    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:26.595489 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:26.595355    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:28.011545 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:28.011511    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:30.213459 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:30.213424    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:30.273257 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:30.273176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:31.361138 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:31.361098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:31.465106 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:31.465061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:34.828798 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:34.828753    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:35.249049 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:35.249016    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:37.206173 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:37.206136    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:37.271105 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:37.271068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:41.514012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:41.513972    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:41.615598 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:41.615559    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:42.851656 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:42.851625    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:46.617755 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:46.617718    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:47.831576 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:47.831537    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:48.348110 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:48.348066    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz67f"]
Jun 03 19:45:48.348500 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:48.348481    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="985f704a-42b1-414e-9563-bcf46b6eb9e3" containerName="console"
Jun 03 19:45:48.348590 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:48.348503    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="985f704a-42b1-414e-9563-bcf46b6eb9e3" containerName="console"
Jun 03 19:45:48.348642 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:48.348608    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="985f704a-42b1-414e-9563-bcf46b6eb9e3" containerName="console"
Jun 03 19:45:48.351630 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:48.351604    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz67f"
Jun 03 19:45:48.358958 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:48.358934    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 03 19:45:48.359333 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:48.359310    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 03 19:45:48.359733 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:48.359713    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bd5m7\""
Jun 03 19:45:48.372749 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:48.372714    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz67f"]
Jun 03 19:45:48.510926 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:48.510851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnjqs\" (UniqueName: \"kubernetes.io/projected/3a29082d-9ec0-44d4-b0c7-d085dc1cce31-kube-api-access-gnjqs\") pod \"openshift-lws-operator-fd8ccff4c-lz67f\" (UID: \"3a29082d-9ec0-44d4-b0c7-d085dc1cce31\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz67f"
Jun 03 19:45:48.511103 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:48.510938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a29082d-9ec0-44d4-b0c7-d085dc1cce31-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lz67f\" (UID: \"3a29082d-9ec0-44d4-b0c7-d085dc1cce31\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz67f"
Jun 03 19:45:48.612308 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:48.612206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a29082d-9ec0-44d4-b0c7-d085dc1cce31-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lz67f\" (UID: \"3a29082d-9ec0-44d4-b0c7-d085dc1cce31\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz67f"
Jun 03 19:45:48.612467 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:48.612329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnjqs\" (UniqueName: \"kubernetes.io/projected/3a29082d-9ec0-44d4-b0c7-d085dc1cce31-kube-api-access-gnjqs\") pod \"openshift-lws-operator-fd8ccff4c-lz67f\" (UID: \"3a29082d-9ec0-44d4-b0c7-d085dc1cce31\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz67f"
Jun 03 19:45:48.612644 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:48.612625    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a29082d-9ec0-44d4-b0c7-d085dc1cce31-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lz67f\" (UID: \"3a29082d-9ec0-44d4-b0c7-d085dc1cce31\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz67f"
Jun 03 19:45:48.622452 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:48.622425    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnjqs\" (UniqueName: \"kubernetes.io/projected/3a29082d-9ec0-44d4-b0c7-d085dc1cce31-kube-api-access-gnjqs\") pod \"openshift-lws-operator-fd8ccff4c-lz67f\" (UID: \"3a29082d-9ec0-44d4-b0c7-d085dc1cce31\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz67f"
Jun 03 19:45:48.671431 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:48.671392    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz67f"
Jun 03 19:45:48.806787 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:48.806760    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz67f"]
Jun 03 19:45:48.809462 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:45:48.809429    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a29082d_9ec0_44d4_b0c7_d085dc1cce31.slice/crio-968f5fa0949d057c343e72812e164769197167671eff9f0ce35944192cdefd3c WatchSource:0}: Error finding container 968f5fa0949d057c343e72812e164769197167671eff9f0ce35944192cdefd3c: Status 404 returned error can't find the container with id 968f5fa0949d057c343e72812e164769197167671eff9f0ce35944192cdefd3c
Jun 03 19:45:49.107413 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:49.107373    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz67f" event={"ID":"3a29082d-9ec0-44d4-b0c7-d085dc1cce31","Type":"ContainerStarted","Data":"968f5fa0949d057c343e72812e164769197167671eff9f0ce35944192cdefd3c"}
Jun 03 19:45:52.123980 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:52.123944    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz67f" event={"ID":"3a29082d-9ec0-44d4-b0c7-d085dc1cce31","Type":"ContainerStarted","Data":"948dcc9197ed5c8836de461adcdd8a79562c64c318280367a679237baefe5d29"}
Jun 03 19:45:52.140856 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:52.140782    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lz67f" podStartSLOduration=1.461961744 podStartE2EDuration="4.140765889s" totalImagesPullingTime="2.678804145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:45:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:45:52.140070593 +0000 UTC m=+278.730553986" watchObservedRunningTime="2026-06-03 19:45:52.140765889 +0000 UTC m=+278.731249281"
Jun 03 19:45:52.871435 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:52.871403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:52.971817 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:52.971784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:45:54.675487 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:45:54.675447    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:08.231865 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:08.231829    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:08.325967 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:08.325929    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:08.872246 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:08.872210    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:09.142615 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.142521    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:09.242950 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.242918    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:09.292585 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.292553    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"]
Jun 03 19:46:09.296410 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.296388    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:09.301302 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.301275    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 03 19:46:09.301461 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.301274    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 03 19:46:09.301461 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.301335    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5rddl\""
Jun 03 19:46:09.301461 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.301280    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 03 19:46:09.301601 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.301466    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 03 19:46:09.314856 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.314824    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"]
Jun 03 19:46:09.392171 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.392132    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36158627-79f8-4a63-9235-1e2b6ea31253-manifests\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-sltwk\" (UID: \"36158627-79f8-4a63-9235-1e2b6ea31253\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:09.392363 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.392199    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36158627-79f8-4a63-9235-1e2b6ea31253-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-sltwk\" (UID: \"36158627-79f8-4a63-9235-1e2b6ea31253\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:09.392363 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.392221    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36158627-79f8-4a63-9235-1e2b6ea31253-webhook-cert\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-sltwk\" (UID: \"36158627-79f8-4a63-9235-1e2b6ea31253\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:09.392363 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.392280    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36158627-79f8-4a63-9235-1e2b6ea31253-tmp\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-sltwk\" (UID: \"36158627-79f8-4a63-9235-1e2b6ea31253\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:09.392363 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.392319    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvz9t\" (UniqueName: \"kubernetes.io/projected/36158627-79f8-4a63-9235-1e2b6ea31253-kube-api-access-zvz9t\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-sltwk\" (UID: \"36158627-79f8-4a63-9235-1e2b6ea31253\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:09.425329 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.425249    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:09.493193 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.493149    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36158627-79f8-4a63-9235-1e2b6ea31253-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-sltwk\" (UID: \"36158627-79f8-4a63-9235-1e2b6ea31253\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:09.493193 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.493194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36158627-79f8-4a63-9235-1e2b6ea31253-webhook-cert\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-sltwk\" (UID: \"36158627-79f8-4a63-9235-1e2b6ea31253\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:09.493455 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.493220    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36158627-79f8-4a63-9235-1e2b6ea31253-tmp\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-sltwk\" (UID: \"36158627-79f8-4a63-9235-1e2b6ea31253\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:09.493455 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.493243    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvz9t\" (UniqueName: \"kubernetes.io/projected/36158627-79f8-4a63-9235-1e2b6ea31253-kube-api-access-zvz9t\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-sltwk\" (UID: \"36158627-79f8-4a63-9235-1e2b6ea31253\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:09.493455 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.493293    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36158627-79f8-4a63-9235-1e2b6ea31253-manifests\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-sltwk\" (UID: \"36158627-79f8-4a63-9235-1e2b6ea31253\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:09.493776 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.493741    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36158627-79f8-4a63-9235-1e2b6ea31253-manifests\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-sltwk\" (UID: \"36158627-79f8-4a63-9235-1e2b6ea31253\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:09.495705 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.495681    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36158627-79f8-4a63-9235-1e2b6ea31253-tmp\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-sltwk\" (UID: \"36158627-79f8-4a63-9235-1e2b6ea31253\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:09.495939 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.495922    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36158627-79f8-4a63-9235-1e2b6ea31253-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-sltwk\" (UID: \"36158627-79f8-4a63-9235-1e2b6ea31253\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:09.495989 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.495975    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36158627-79f8-4a63-9235-1e2b6ea31253-webhook-cert\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-sltwk\" (UID: \"36158627-79f8-4a63-9235-1e2b6ea31253\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:09.502119 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.502083    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvz9t\" (UniqueName: \"kubernetes.io/projected/36158627-79f8-4a63-9235-1e2b6ea31253-kube-api-access-zvz9t\") pod \"opendatahub-operator-controller-manager-5584b5f9cd-sltwk\" (UID: \"36158627-79f8-4a63-9235-1e2b6ea31253\") " pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:09.527793 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.527744    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:09.606218 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.606185    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:09.627074 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.627042    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:09.725646 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.725614    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:09.797709 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.797663    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"]
Jun 03 19:46:09.803326 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:46:09.803293    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36158627_79f8_4a63_9235_1e2b6ea31253.slice/crio-c09dc9955618b867705c6282f2851840be63cd3add66c30d931338d155ab06e4 WatchSource:0}: Error finding container c09dc9955618b867705c6282f2851840be63cd3add66c30d931338d155ab06e4: Status 404 returned error can't find the container with id c09dc9955618b867705c6282f2851840be63cd3add66c30d931338d155ab06e4
Jun 03 19:46:09.834661 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.834622    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:09.935887 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:09.935837    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:10.035535 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:10.035505    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:10.196512 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:10.196475    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk" event={"ID":"36158627-79f8-4a63-9235-1e2b6ea31253","Type":"ContainerStarted","Data":"c09dc9955618b867705c6282f2851840be63cd3add66c30d931338d155ab06e4"}
Jun 03 19:46:13.211423 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:13.211387    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk" event={"ID":"36158627-79f8-4a63-9235-1e2b6ea31253","Type":"ContainerStarted","Data":"9120a831d542fa648390668b31f63cdf53d02ed77e85b15cc2d6429f0194965b"}
Jun 03 19:46:13.825928 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:13.825898    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 19:46:13.826179 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:13.826163    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 19:46:13.833381 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:13.833357    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jun 03 19:46:14.216797 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:14.216760    2563 generic.go:356] "Generic (PLEG): container finished" podID="36158627-79f8-4a63-9235-1e2b6ea31253" containerID="9120a831d542fa648390668b31f63cdf53d02ed77e85b15cc2d6429f0194965b" exitCode=0
Jun 03 19:46:14.218219 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:14.216852    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk" event={"ID":"36158627-79f8-4a63-9235-1e2b6ea31253","Type":"ContainerDied","Data":"9120a831d542fa648390668b31f63cdf53d02ed77e85b15cc2d6429f0194965b"}
Jun 03 19:46:15.222389 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:15.222355    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk" event={"ID":"36158627-79f8-4a63-9235-1e2b6ea31253","Type":"ContainerStarted","Data":"87a62ec37d28c0a2262e54f5ab5494396c545113fe5d28f912ebabbcc9ce9a72"}
Jun 03 19:46:15.222920 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:15.222471    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:15.245397 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:15.245326    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk" podStartSLOduration=2.078219317 podStartE2EDuration="6.245302337s" totalImagesPullingTime="3.113514192s" totalInitContainerRuntime="1.053568828s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:46:15.243591905 +0000 UTC m=+301.834075349" watchObservedRunningTime="2026-06-03 19:46:15.245302337 +0000 UTC m=+301.835785730"
Jun 03 19:46:16.931282 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:16.931247    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:17.082324 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:17.082284    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:20.432142 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:20.432103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:20.527782 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:20.527733    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:26.229353 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:26.229319    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5584b5f9cd-sltwk"
Jun 03 19:46:27.604780 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.604733    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"]
Jun 03 19:46:27.612866 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.612823    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"
Jun 03 19:46:27.616969 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.616945    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jun 03 19:46:27.617128 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.616946    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jun 03 19:46:27.617128 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.616946    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jgx26\""
Jun 03 19:46:27.617128 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.616974    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jun 03 19:46:27.629020 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.628990    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"]
Jun 03 19:46:27.766696 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.766649    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq7zs\" (UniqueName: \"kubernetes.io/projected/4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd-kube-api-access-gq7zs\") pod \"lws-controller-manager-c9655f554-tnznz\" (UID: \"4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd\") " pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"
Jun 03 19:46:27.766696 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.766695    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd-cert\") pod \"lws-controller-manager-c9655f554-tnznz\" (UID: \"4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd\") " pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"
Jun 03 19:46:27.766977 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.766731    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd-metrics-cert\") pod \"lws-controller-manager-c9655f554-tnznz\" (UID: \"4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd\") " pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"
Jun 03 19:46:27.766977 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.766848    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd-manager-config\") pod \"lws-controller-manager-c9655f554-tnznz\" (UID: \"4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd\") " pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"
Jun 03 19:46:27.868327 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.868225    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd-manager-config\") pod \"lws-controller-manager-c9655f554-tnznz\" (UID: \"4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd\") " pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"
Jun 03 19:46:27.868327 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.868288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq7zs\" (UniqueName: \"kubernetes.io/projected/4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd-kube-api-access-gq7zs\") pod \"lws-controller-manager-c9655f554-tnznz\" (UID: \"4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd\") " pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"
Jun 03 19:46:27.868327 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.868320    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd-cert\") pod \"lws-controller-manager-c9655f554-tnznz\" (UID: \"4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd\") " pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"
Jun 03 19:46:27.868650 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.868358    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd-metrics-cert\") pod \"lws-controller-manager-c9655f554-tnznz\" (UID: \"4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd\") " pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"
Jun 03 19:46:27.869068 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.869044    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd-manager-config\") pod \"lws-controller-manager-c9655f554-tnznz\" (UID: \"4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd\") " pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"
Jun 03 19:46:27.871154 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.871125    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd-metrics-cert\") pod \"lws-controller-manager-c9655f554-tnznz\" (UID: \"4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd\") " pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"
Jun 03 19:46:27.871154 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.871148    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd-cert\") pod \"lws-controller-manager-c9655f554-tnznz\" (UID: \"4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd\") " pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"
Jun 03 19:46:27.886530 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.886501    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq7zs\" (UniqueName: \"kubernetes.io/projected/4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd-kube-api-access-gq7zs\") pod \"lws-controller-manager-c9655f554-tnznz\" (UID: \"4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd\") " pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"
Jun 03 19:46:27.922543 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:27.922505    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"
Jun 03 19:46:28.080883 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:28.080839    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"]
Jun 03 19:46:28.087718 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:46:28.087686    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a142ccc_05c8_4327_a1a3_a1dfdf2da3fd.slice/crio-3ff1434e09a2ebf4af1fe9fee2382be1a9f93c064c121308278d190070c07699 WatchSource:0}: Error finding container 3ff1434e09a2ebf4af1fe9fee2382be1a9f93c064c121308278d190070c07699: Status 404 returned error can't find the container with id 3ff1434e09a2ebf4af1fe9fee2382be1a9f93c064c121308278d190070c07699
Jun 03 19:46:28.089664 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:28.089642    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 19:46:28.134585 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:28.134478    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:28.278598 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:28.278564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz" event={"ID":"4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd","Type":"ContainerStarted","Data":"3ff1434e09a2ebf4af1fe9fee2382be1a9f93c064c121308278d190070c07699"}
Jun 03 19:46:28.284802 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:28.284771    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:28.490326 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:28.490232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:28.618415 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:28.618379    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:28.748445 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:28.748413    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:28.871339 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:28.871301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:29.028476 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.028400    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d59cb7674-9w6j2"]
Jun 03 19:46:29.030849 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.030831    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d59cb7674-9w6j2"
Jun 03 19:46:29.033776 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.033743    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 03 19:46:29.033776 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.033768    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 03 19:46:29.034127 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.034103    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 03 19:46:29.035010 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.034985    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 03 19:46:29.035913 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.035848    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fh9kr\""
Jun 03 19:46:29.046828 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.046751    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d59cb7674-9w6j2"]
Jun 03 19:46:29.150701 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.150665    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:29.180568 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.180520    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0caa8eac-7d93-4da6-ba20-8fbcd004daa6-tls-certs\") pod \"kube-auth-proxy-6d59cb7674-9w6j2\" (UID: \"0caa8eac-7d93-4da6-ba20-8fbcd004daa6\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-9w6j2"
Jun 03 19:46:29.180795 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.180587    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cddml\" (UniqueName: \"kubernetes.io/projected/0caa8eac-7d93-4da6-ba20-8fbcd004daa6-kube-api-access-cddml\") pod \"kube-auth-proxy-6d59cb7674-9w6j2\" (UID: \"0caa8eac-7d93-4da6-ba20-8fbcd004daa6\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-9w6j2"
Jun 03 19:46:29.180795 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.180659    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0caa8eac-7d93-4da6-ba20-8fbcd004daa6-tmp\") pod \"kube-auth-proxy-6d59cb7674-9w6j2\" (UID: \"0caa8eac-7d93-4da6-ba20-8fbcd004daa6\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-9w6j2"
Jun 03 19:46:29.235206 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.235107    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:29.282815 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.282117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cddml\" (UniqueName: \"kubernetes.io/projected/0caa8eac-7d93-4da6-ba20-8fbcd004daa6-kube-api-access-cddml\") pod \"kube-auth-proxy-6d59cb7674-9w6j2\" (UID: \"0caa8eac-7d93-4da6-ba20-8fbcd004daa6\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-9w6j2"
Jun 03 19:46:29.282815 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.282195    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0caa8eac-7d93-4da6-ba20-8fbcd004daa6-tmp\") pod \"kube-auth-proxy-6d59cb7674-9w6j2\" (UID: \"0caa8eac-7d93-4da6-ba20-8fbcd004daa6\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-9w6j2"
Jun 03 19:46:29.282815 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.282298    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0caa8eac-7d93-4da6-ba20-8fbcd004daa6-tls-certs\") pod \"kube-auth-proxy-6d59cb7674-9w6j2\" (UID: \"0caa8eac-7d93-4da6-ba20-8fbcd004daa6\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-9w6j2"
Jun 03 19:46:29.285497 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.285466    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0caa8eac-7d93-4da6-ba20-8fbcd004daa6-tmp\") pod \"kube-auth-proxy-6d59cb7674-9w6j2\" (UID: \"0caa8eac-7d93-4da6-ba20-8fbcd004daa6\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-9w6j2"
Jun 03 19:46:29.285994 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.285952    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0caa8eac-7d93-4da6-ba20-8fbcd004daa6-tls-certs\") pod \"kube-auth-proxy-6d59cb7674-9w6j2\" (UID: \"0caa8eac-7d93-4da6-ba20-8fbcd004daa6\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-9w6j2"
Jun 03 19:46:29.295891 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.295813    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cddml\" (UniqueName: \"kubernetes.io/projected/0caa8eac-7d93-4da6-ba20-8fbcd004daa6-kube-api-access-cddml\") pod \"kube-auth-proxy-6d59cb7674-9w6j2\" (UID: \"0caa8eac-7d93-4da6-ba20-8fbcd004daa6\") " pod="openshift-ingress/kube-auth-proxy-6d59cb7674-9w6j2"
Jun 03 19:46:29.330689 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.330646    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:29.346706 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.346666    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d59cb7674-9w6j2"
Jun 03 19:46:29.520382 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.520336    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d59cb7674-9w6j2"]
Jun 03 19:46:29.524044 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:46:29.524012    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0caa8eac_7d93_4da6_ba20_8fbcd004daa6.slice/crio-06879146cccc7d48213b6c9c125b511828788466fe0566344bf5e88f3df581b0 WatchSource:0}: Error finding container 06879146cccc7d48213b6c9c125b511828788466fe0566344bf5e88f3df581b0: Status 404 returned error can't find the container with id 06879146cccc7d48213b6c9c125b511828788466fe0566344bf5e88f3df581b0
Jun 03 19:46:29.540751 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.540644    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:29.863450 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:29.863361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:30.289864 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:30.289830    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:30.294666 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:30.294625    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz" event={"ID":"4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd","Type":"ContainerStarted","Data":"9735bd49672b3d7fcad00af06871c25e3a5fcf1d3fde0c8b58f45826e3e11ce5"}
Jun 03 19:46:30.294861 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:30.294696    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"
Jun 03 19:46:30.296761 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:30.296718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d59cb7674-9w6j2" event={"ID":"0caa8eac-7d93-4da6-ba20-8fbcd004daa6","Type":"ContainerStarted","Data":"06879146cccc7d48213b6c9c125b511828788466fe0566344bf5e88f3df581b0"}
Jun 03 19:46:30.322204 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:30.322140    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz" podStartSLOduration=1.473291262 podStartE2EDuration="3.322122723s" totalImagesPullingTime="1.848831461s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:46:30.319780431 +0000 UTC m=+316.910263825" watchObservedRunningTime="2026-06-03 19:46:30.322122723 +0000 UTC m=+316.912606114"
Jun 03 19:46:33.317068 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:33.317022    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d59cb7674-9w6j2" event={"ID":"0caa8eac-7d93-4da6-ba20-8fbcd004daa6","Type":"ContainerStarted","Data":"2f2fd180f69f86884f3d1ce67eb1e01083766b1f977444d7dbcb29a058170b29"}
Jun 03 19:46:33.336143 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:33.336080    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d59cb7674-9w6j2" podStartSLOduration=1.428128965 podStartE2EDuration="4.336058565s" totalImagesPullingTime="2.9079296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:46:33.335492391 +0000 UTC m=+319.925975785" watchObservedRunningTime="2026-06-03 19:46:33.336058565 +0000 UTC m=+319.926541960"
Jun 03 19:46:39.887191 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:39.887157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:39.992321 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:39.992283    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:40.218582 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:40.218495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:40.342142 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:40.342102    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:41.174574 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:41.174534    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:41.304855 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:41.304813    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-c9655f554-tnznz"
Jun 03 19:46:41.337620 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:41.337588    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:41.481782 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:41.481684    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:46.400955 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:46.400916    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:46.518182 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:46.518150    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:47.952009 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:47.951962    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:48.124212 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:48.124180    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:48.327956 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:48.327920    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:48.625350 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:48.625268    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:48.985911 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:48.985801    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:53.082208 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:53.082166    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:53.155735 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:53.155700    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:53.666150 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:53.666104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:57.942287 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:57.942210    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:58.041043 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:58.041011    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:58.302131 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:58.302085    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:58.440067 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:58.440033    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:58.535856 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:58.535821    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:58.769367 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:58.769329    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6d7b4f9498-z5wcg"]
Jun 03 19:46:58.771819 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:58.771790    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d7b4f9498-z5wcg"
Jun 03 19:46:58.774897 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:58.774855    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9p9nf\""
Jun 03 19:46:58.775046 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:58.774929    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 03 19:46:58.783377 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:58.783349    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d7b4f9498-z5wcg"]
Jun 03 19:46:58.798729 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:58.798695    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:46:58.835834 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:58.835793    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d390e4fe-4664-46ba-823e-93432c0b9dad-redirect-config\") pod \"dashboard-redirect-6d7b4f9498-z5wcg\" (UID: \"d390e4fe-4664-46ba-823e-93432c0b9dad\") " pod="opendatahub/dashboard-redirect-6d7b4f9498-z5wcg"
Jun 03 19:46:58.836056 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:58.835919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hdcn\" (UniqueName: \"kubernetes.io/projected/d390e4fe-4664-46ba-823e-93432c0b9dad-kube-api-access-8hdcn\") pod \"dashboard-redirect-6d7b4f9498-z5wcg\" (UID: \"d390e4fe-4664-46ba-823e-93432c0b9dad\") " pod="opendatahub/dashboard-redirect-6d7b4f9498-z5wcg"
Jun 03 19:46:58.937284 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:58.937252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d390e4fe-4664-46ba-823e-93432c0b9dad-redirect-config\") pod \"dashboard-redirect-6d7b4f9498-z5wcg\" (UID: \"d390e4fe-4664-46ba-823e-93432c0b9dad\") " pod="opendatahub/dashboard-redirect-6d7b4f9498-z5wcg"
Jun 03 19:46:58.937496 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:58.937335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hdcn\" (UniqueName: \"kubernetes.io/projected/d390e4fe-4664-46ba-823e-93432c0b9dad-kube-api-access-8hdcn\") pod \"dashboard-redirect-6d7b4f9498-z5wcg\" (UID: \"d390e4fe-4664-46ba-823e-93432c0b9dad\") " pod="opendatahub/dashboard-redirect-6d7b4f9498-z5wcg"
Jun 03 19:46:58.938068 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:58.938042    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/d390e4fe-4664-46ba-823e-93432c0b9dad-redirect-config\") pod \"dashboard-redirect-6d7b4f9498-z5wcg\" (UID: \"d390e4fe-4664-46ba-823e-93432c0b9dad\") " pod="opendatahub/dashboard-redirect-6d7b4f9498-z5wcg"
Jun 03 19:46:58.946260 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:58.946235    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hdcn\" (UniqueName: \"kubernetes.io/projected/d390e4fe-4664-46ba-823e-93432c0b9dad-kube-api-access-8hdcn\") pod \"dashboard-redirect-6d7b4f9498-z5wcg\" (UID: \"d390e4fe-4664-46ba-823e-93432c0b9dad\") " pod="opendatahub/dashboard-redirect-6d7b4f9498-z5wcg"
Jun 03 19:46:59.083920 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:59.083799    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6d7b4f9498-z5wcg"
Jun 03 19:46:59.251141 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:59.251111    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6d7b4f9498-z5wcg"]
Jun 03 19:46:59.253490 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:46:59.253452    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd390e4fe_4664_46ba_823e_93432c0b9dad.slice/crio-a5b7d23d1c33d7dadb65e66ff2bac76bed5fcac03ef1987634d30738d33d9d61 WatchSource:0}: Error finding container a5b7d23d1c33d7dadb65e66ff2bac76bed5fcac03ef1987634d30738d33d9d61: Status 404 returned error can't find the container with id a5b7d23d1c33d7dadb65e66ff2bac76bed5fcac03ef1987634d30738d33d9d61
Jun 03 19:46:59.431202 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:46:59.431104    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d7b4f9498-z5wcg" event={"ID":"d390e4fe-4664-46ba-823e-93432c0b9dad","Type":"ContainerStarted","Data":"a5b7d23d1c33d7dadb65e66ff2bac76bed5fcac03ef1987634d30738d33d9d61"}
Jun 03 19:47:06.464681 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:47:06.464643    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6d7b4f9498-z5wcg" event={"ID":"d390e4fe-4664-46ba-823e-93432c0b9dad","Type":"ContainerStarted","Data":"458ed243804c77dece653cdc28b4645e333550fed229820f7eb0acf0aed6d50d"}
Jun 03 19:47:06.482377 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:47:06.482318    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6d7b4f9498-z5wcg" podStartSLOduration=2.20838828 podStartE2EDuration="8.482303757s" totalImagesPullingTime="6.273915477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:46:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:47:06.481330172 +0000 UTC m=+353.071813564" watchObservedRunningTime="2026-06-03 19:47:06.482303757 +0000 UTC m=+353.072787149"
Jun 03 19:47:29.768193 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:47:29.768151    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:47:29.871208 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:47:29.871157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:47:30.044581 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:47:30.044474    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:47:38.545238 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:47:38.545195    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:47:59.289762 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:47:59.289723    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:02.717375 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:02.717318    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:03.481140 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:03.481102    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:06.740489 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:06.740444    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:07.110791 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:07.110757    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:08.732085 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:08.732046    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:09.304485 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:09.304451    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pj77m"]
Jun 03 19:48:09.308402 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:09.308377    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pj77m"
Jun 03 19:48:09.313132 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:09.313104    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vdwmj\""
Jun 03 19:48:09.313295 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:09.313162    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jun 03 19:48:09.313295 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:09.313247    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 03 19:48:09.313684 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:09.313666    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 03 19:48:09.321426 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:09.321401    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pj77m"]
Jun 03 19:48:09.393180 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:09.393136    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4scg\" (UniqueName: \"kubernetes.io/projected/798fd56a-c369-4b3e-b9c2-417bc639a36f-kube-api-access-h4scg\") pod \"dns-operator-controller-manager-864dd78c4c-pj77m\" (UID: \"798fd56a-c369-4b3e-b9c2-417bc639a36f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pj77m"
Jun 03 19:48:09.494150 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:09.494096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4scg\" (UniqueName: \"kubernetes.io/projected/798fd56a-c369-4b3e-b9c2-417bc639a36f-kube-api-access-h4scg\") pod \"dns-operator-controller-manager-864dd78c4c-pj77m\" (UID: \"798fd56a-c369-4b3e-b9c2-417bc639a36f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pj77m"
Jun 03 19:48:09.503519 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:09.503487    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4scg\" (UniqueName: \"kubernetes.io/projected/798fd56a-c369-4b3e-b9c2-417bc639a36f-kube-api-access-h4scg\") pod \"dns-operator-controller-manager-864dd78c4c-pj77m\" (UID: \"798fd56a-c369-4b3e-b9c2-417bc639a36f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pj77m"
Jun 03 19:48:09.618922 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:09.618809    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pj77m"
Jun 03 19:48:09.776460 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:09.776431    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-pj77m"]
Jun 03 19:48:09.779339 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:48:09.779303    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798fd56a_c369_4b3e_b9c2_417bc639a36f.slice/crio-0f95ebab10ef394ded8e3d0263c694bbe77ffecf0bf22f64b1830c3d17195323 WatchSource:0}: Error finding container 0f95ebab10ef394ded8e3d0263c694bbe77ffecf0bf22f64b1830c3d17195323: Status 404 returned error can't find the container with id 0f95ebab10ef394ded8e3d0263c694bbe77ffecf0bf22f64b1830c3d17195323
Jun 03 19:48:09.888015 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:09.887928    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:10.012169 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:10.012137    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:10.760001 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:10.759969    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pj77m" event={"ID":"798fd56a-c369-4b3e-b9c2-417bc639a36f","Type":"ContainerStarted","Data":"0f95ebab10ef394ded8e3d0263c694bbe77ffecf0bf22f64b1830c3d17195323"}
Jun 03 19:48:11.740280 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:11.740235    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:12.771517 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:12.771478    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pj77m" event={"ID":"798fd56a-c369-4b3e-b9c2-417bc639a36f","Type":"ContainerStarted","Data":"cefa5f584b526d406ceb5bb6a3bcb32f358233348ca7d89131baf5205f6dc1b3"}
Jun 03 19:48:12.771957 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:12.771626    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pj77m"
Jun 03 19:48:12.790912 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:12.790841    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pj77m" podStartSLOduration=1.6492796539999999 podStartE2EDuration="3.790825018s" totalImagesPullingTime="2.141545364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:48:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:48:12.789492938 +0000 UTC m=+419.379976330" watchObservedRunningTime="2026-06-03 19:48:12.790825018 +0000 UTC m=+419.381308410"
Jun 03 19:48:13.234617 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.234535    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-595bc9c7b-b79dn"]
Jun 03 19:48:13.237965 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.237945    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.252066 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.252028    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-595bc9c7b-b79dn"]
Jun 03 19:48:13.298048 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.298011    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:13.329356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.329316    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5660b728-792a-4ade-ad86-b9cea83c1acf-service-ca\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.329356 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.329354    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fprpb\" (UniqueName: \"kubernetes.io/projected/5660b728-792a-4ade-ad86-b9cea83c1acf-kube-api-access-fprpb\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.329571 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.329373    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5660b728-792a-4ade-ad86-b9cea83c1acf-console-config\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.329571 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.329487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5660b728-792a-4ade-ad86-b9cea83c1acf-console-serving-cert\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.329571 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.329517    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5660b728-792a-4ade-ad86-b9cea83c1acf-trusted-ca-bundle\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.329675 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.329581    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5660b728-792a-4ade-ad86-b9cea83c1acf-oauth-serving-cert\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.329675 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.329623    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5660b728-792a-4ade-ad86-b9cea83c1acf-console-oauth-config\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.430918 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.430848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5660b728-792a-4ade-ad86-b9cea83c1acf-console-serving-cert\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.431065 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.430924    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5660b728-792a-4ade-ad86-b9cea83c1acf-trusted-ca-bundle\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.431065 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.430994    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5660b728-792a-4ade-ad86-b9cea83c1acf-oauth-serving-cert\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.431065 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.431050    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5660b728-792a-4ade-ad86-b9cea83c1acf-console-oauth-config\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.431172 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.431093    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5660b728-792a-4ade-ad86-b9cea83c1acf-service-ca\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.431172 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.431117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fprpb\" (UniqueName: \"kubernetes.io/projected/5660b728-792a-4ade-ad86-b9cea83c1acf-kube-api-access-fprpb\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.431172 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.431143    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5660b728-792a-4ade-ad86-b9cea83c1acf-console-config\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.431917 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.431858    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5660b728-792a-4ade-ad86-b9cea83c1acf-trusted-ca-bundle\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.432029 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.431951    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5660b728-792a-4ade-ad86-b9cea83c1acf-console-config\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.432029 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.431986    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5660b728-792a-4ade-ad86-b9cea83c1acf-oauth-serving-cert\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.432140 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.432044    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5660b728-792a-4ade-ad86-b9cea83c1acf-service-ca\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.433519 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.433495    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5660b728-792a-4ade-ad86-b9cea83c1acf-console-serving-cert\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.433653 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.433633    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5660b728-792a-4ade-ad86-b9cea83c1acf-console-oauth-config\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.451456 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.451424    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fprpb\" (UniqueName: \"kubernetes.io/projected/5660b728-792a-4ade-ad86-b9cea83c1acf-kube-api-access-fprpb\") pod \"console-595bc9c7b-b79dn\" (UID: \"5660b728-792a-4ade-ad86-b9cea83c1acf\") " pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.548574 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.548515    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:13.692453 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.692414    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-595bc9c7b-b79dn"]
Jun 03 19:48:13.694625 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:48:13.694601    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5660b728_792a_4ade_ad86_b9cea83c1acf.slice/crio-90a043bd0ebb100fd9ac565e99c53faeca69f1980c12fd74e949107aa436ac40 WatchSource:0}: Error finding container 90a043bd0ebb100fd9ac565e99c53faeca69f1980c12fd74e949107aa436ac40: Status 404 returned error can't find the container with id 90a043bd0ebb100fd9ac565e99c53faeca69f1980c12fd74e949107aa436ac40
Jun 03 19:48:13.777718 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.777676    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595bc9c7b-b79dn" event={"ID":"5660b728-792a-4ade-ad86-b9cea83c1acf","Type":"ContainerStarted","Data":"79e5cf9399a8ca0e7e96d3c817fbd916ad04d50d356526bd9a974406b8c0561d"}
Jun 03 19:48:13.778165 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.777740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595bc9c7b-b79dn" event={"ID":"5660b728-792a-4ade-ad86-b9cea83c1acf","Type":"ContainerStarted","Data":"90a043bd0ebb100fd9ac565e99c53faeca69f1980c12fd74e949107aa436ac40"}
Jun 03 19:48:13.809563 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.809447    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-595bc9c7b-b79dn" podStartSLOduration=0.809432864 podStartE2EDuration="809.432864ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:48:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:48:13.808188828 +0000 UTC m=+420.398672224" watchObservedRunningTime="2026-06-03 19:48:13.809432864 +0000 UTC m=+420.399916256"
Jun 03 19:48:13.812923 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.812856    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"]
Jun 03 19:48:13.816998 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.816969    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"
Jun 03 19:48:13.819832 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.819807    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mhpgf\""
Jun 03 19:48:13.832172 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.832138    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"]
Jun 03 19:48:13.933894 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.933835    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq7xn\" (UniqueName: \"kubernetes.io/projected/04712e31-88ec-4ca0-bf93-15114de70d66-kube-api-access-bq7xn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gkkcx\" (UID: \"04712e31-88ec-4ca0-bf93-15114de70d66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"
Jun 03 19:48:13.934067 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:13.933899    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04712e31-88ec-4ca0-bf93-15114de70d66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gkkcx\" (UID: \"04712e31-88ec-4ca0-bf93-15114de70d66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"
Jun 03 19:48:14.035186 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:14.035147    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq7xn\" (UniqueName: \"kubernetes.io/projected/04712e31-88ec-4ca0-bf93-15114de70d66-kube-api-access-bq7xn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gkkcx\" (UID: \"04712e31-88ec-4ca0-bf93-15114de70d66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"
Jun 03 19:48:14.035186 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:14.035191    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04712e31-88ec-4ca0-bf93-15114de70d66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gkkcx\" (UID: \"04712e31-88ec-4ca0-bf93-15114de70d66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"
Jun 03 19:48:14.035534 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:14.035518    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04712e31-88ec-4ca0-bf93-15114de70d66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gkkcx\" (UID: \"04712e31-88ec-4ca0-bf93-15114de70d66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"
Jun 03 19:48:14.045639 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:14.045602    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq7xn\" (UniqueName: \"kubernetes.io/projected/04712e31-88ec-4ca0-bf93-15114de70d66-kube-api-access-bq7xn\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gkkcx\" (UID: \"04712e31-88ec-4ca0-bf93-15114de70d66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"
Jun 03 19:48:14.129037 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:14.128945    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"
Jun 03 19:48:14.277529 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:14.277495    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"]
Jun 03 19:48:14.280722 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:48:14.280693    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04712e31_88ec_4ca0_bf93_15114de70d66.slice/crio-5f42aa5de5b474cdd0aaed2aa4b7c7966b9ca5684fe7b37a43bb1a15ff8abb07 WatchSource:0}: Error finding container 5f42aa5de5b474cdd0aaed2aa4b7c7966b9ca5684fe7b37a43bb1a15ff8abb07: Status 404 returned error can't find the container with id 5f42aa5de5b474cdd0aaed2aa4b7c7966b9ca5684fe7b37a43bb1a15ff8abb07
Jun 03 19:48:14.784029 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:14.783993    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx" event={"ID":"04712e31-88ec-4ca0-bf93-15114de70d66","Type":"ContainerStarted","Data":"5f42aa5de5b474cdd0aaed2aa4b7c7966b9ca5684fe7b37a43bb1a15ff8abb07"}
Jun 03 19:48:14.902793 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:14.902741    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:15.004914 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:15.004851    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:20.331425 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:20.331332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:20.470367 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:20.470335    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:20.688393 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:20.688294    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:20.793257 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:20.793216    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:20.815672 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:20.815626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx" event={"ID":"04712e31-88ec-4ca0-bf93-15114de70d66","Type":"ContainerStarted","Data":"61d8708eebd244028f93f03e99d02ca8630422f8241f60d2120636374e9f3f7a"}
Jun 03 19:48:20.815850 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:20.815832    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"
Jun 03 19:48:20.844608 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:20.844550    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx" podStartSLOduration=2.072364627 podStartE2EDuration="7.844524815s" totalImagesPullingTime="5.772160188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:48:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:48:20.841817257 +0000 UTC m=+427.432300649" watchObservedRunningTime="2026-06-03 19:48:20.844524815 +0000 UTC m=+427.435008207"
Jun 03 19:48:22.972040 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:22.972001    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh"]
Jun 03 19:48:22.975447 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:22.975422    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh"
Jun 03 19:48:22.979714 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:22.979195    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xckcv\""
Jun 03 19:48:22.979714 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:22.979510    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jun 03 19:48:22.979714 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:22.979511    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jun 03 19:48:22.982624 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:22.982593    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:22.988887 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:22.988837    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh"]
Jun 03 19:48:23.024297 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.024253    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnwp5\" (UniqueName: \"kubernetes.io/projected/e04f51b2-6a58-408f-b6f1-83046aa3e201-kube-api-access-nnwp5\") pod \"kuadrant-console-plugin-66b5774985-mqqfh\" (UID: \"e04f51b2-6a58-408f-b6f1-83046aa3e201\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh"
Jun 03 19:48:23.024297 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.024295    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e04f51b2-6a58-408f-b6f1-83046aa3e201-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mqqfh\" (UID: \"e04f51b2-6a58-408f-b6f1-83046aa3e201\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh"
Jun 03 19:48:23.024516 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.024335    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e04f51b2-6a58-408f-b6f1-83046aa3e201-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mqqfh\" (UID: \"e04f51b2-6a58-408f-b6f1-83046aa3e201\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh"
Jun 03 19:48:23.125089 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.125047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e04f51b2-6a58-408f-b6f1-83046aa3e201-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mqqfh\" (UID: \"e04f51b2-6a58-408f-b6f1-83046aa3e201\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh"
Jun 03 19:48:23.125287 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.125168    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnwp5\" (UniqueName: \"kubernetes.io/projected/e04f51b2-6a58-408f-b6f1-83046aa3e201-kube-api-access-nnwp5\") pod \"kuadrant-console-plugin-66b5774985-mqqfh\" (UID: \"e04f51b2-6a58-408f-b6f1-83046aa3e201\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh"
Jun 03 19:48:23.125287 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.125201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e04f51b2-6a58-408f-b6f1-83046aa3e201-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mqqfh\" (UID: \"e04f51b2-6a58-408f-b6f1-83046aa3e201\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh"
Jun 03 19:48:23.125287 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:48:23.125173    2563 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jun 03 19:48:23.125520 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:48:23.125342    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04f51b2-6a58-408f-b6f1-83046aa3e201-plugin-serving-cert podName:e04f51b2-6a58-408f-b6f1-83046aa3e201 nodeName:}" failed. No retries permitted until 2026-06-03 19:48:23.625309239 +0000 UTC m=+430.215792611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e04f51b2-6a58-408f-b6f1-83046aa3e201-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-mqqfh" (UID: "e04f51b2-6a58-408f-b6f1-83046aa3e201") : secret "plugin-serving-cert" not found
Jun 03 19:48:23.125847 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.125828    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e04f51b2-6a58-408f-b6f1-83046aa3e201-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mqqfh\" (UID: \"e04f51b2-6a58-408f-b6f1-83046aa3e201\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh"
Jun 03 19:48:23.140011 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.139972    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnwp5\" (UniqueName: \"kubernetes.io/projected/e04f51b2-6a58-408f-b6f1-83046aa3e201-kube-api-access-nnwp5\") pod \"kuadrant-console-plugin-66b5774985-mqqfh\" (UID: \"e04f51b2-6a58-408f-b6f1-83046aa3e201\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh"
Jun 03 19:48:23.455663 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.455620    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:23.548957 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.548917    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:23.549102 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.549010    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:23.554369 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.554333    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:23.630188 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.630129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e04f51b2-6a58-408f-b6f1-83046aa3e201-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mqqfh\" (UID: \"e04f51b2-6a58-408f-b6f1-83046aa3e201\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh"
Jun 03 19:48:23.633012 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.632975    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e04f51b2-6a58-408f-b6f1-83046aa3e201-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mqqfh\" (UID: \"e04f51b2-6a58-408f-b6f1-83046aa3e201\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh"
Jun 03 19:48:23.704378 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.704342    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:23.780833 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.780798    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-pj77m"
Jun 03 19:48:23.810374 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.810338    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:23.834533 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.834505    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-595bc9c7b-b79dn"
Jun 03 19:48:23.890677 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.890637    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh"
Jun 03 19:48:23.895924 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:23.895901    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f79787f74-dqp8n"]
Jun 03 19:48:24.031372 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:24.031289    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:24.053973 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:24.053949    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh"]
Jun 03 19:48:24.056851 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:48:24.056819    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode04f51b2_6a58_408f_b6f1_83046aa3e201.slice/crio-759e2539dbd5c3175417c731e9b0b199ec16d3c042313eed748f7b1632b88fdb WatchSource:0}: Error finding container 759e2539dbd5c3175417c731e9b0b199ec16d3c042313eed748f7b1632b88fdb: Status 404 returned error can't find the container with id 759e2539dbd5c3175417c731e9b0b199ec16d3c042313eed748f7b1632b88fdb
Jun 03 19:48:24.129366 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:24.129331    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:24.231373 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:24.231341    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:24.330149 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:24.330055    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:24.835264 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:24.835217    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh" event={"ID":"e04f51b2-6a58-408f-b6f1-83046aa3e201","Type":"ContainerStarted","Data":"759e2539dbd5c3175417c731e9b0b199ec16d3c042313eed748f7b1632b88fdb"}
Jun 03 19:48:27.837114 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:27.837023    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:27.933687 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:27.933655    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:31.823375 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:31.823338    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"
Jun 03 19:48:33.569786 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:33.569743    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"]
Jun 03 19:48:33.570249 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:33.569953    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx" podUID="04712e31-88ec-4ca0-bf93-15114de70d66" containerName="manager" containerID="cri-o://61d8708eebd244028f93f03e99d02ca8630422f8241f60d2120636374e9f3f7a" gracePeriod=2
Jun 03 19:48:33.579639 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:33.579611    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"]
Jun 03 19:48:33.581400 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:48:33.581354    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"04712e31-88ec-4ca0-bf93-15114de70d66\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-gkkcx\": pods \"kuadrant-operator-controller-manager-8684c9ff49-gkkcx\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"
Jun 03 19:48:33.824729 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:33.824648    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"
Jun 03 19:48:33.827568 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:48:33.827535    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gkkcx\" is forbidden: User \"system:node:ip-10-0-129-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-187.ec2.internal' and this object" podUID="04712e31-88ec-4ca0-bf93-15114de70d66" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"
Jun 03 19:48:33.883652 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:48:33.883600    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gkkcx\" is forbidden: User \"system:node:ip-10-0-129-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-187.ec2.internal' and this object" podUID="04712e31-88ec-4ca0-bf93-15114de70d66" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"
Jun 03 19:48:33.892339 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:33.892304    2563 generic.go:356] "Generic (PLEG): container finished" podID="04712e31-88ec-4ca0-bf93-15114de70d66" containerID="61d8708eebd244028f93f03e99d02ca8630422f8241f60d2120636374e9f3f7a" exitCode=0
Jun 03 19:48:33.892508 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:33.892448    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gkkcx"
Jun 03 19:48:33.892508 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:33.892460    2563 scope.go:117] "RemoveContainer" containerID="61d8708eebd244028f93f03e99d02ca8630422f8241f60d2120636374e9f3f7a"
Jun 03 19:48:33.940189 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:33.940152    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq7xn\" (UniqueName: \"kubernetes.io/projected/04712e31-88ec-4ca0-bf93-15114de70d66-kube-api-access-bq7xn\") pod \"04712e31-88ec-4ca0-bf93-15114de70d66\" (UID: \"04712e31-88ec-4ca0-bf93-15114de70d66\") "
Jun 03 19:48:33.940443 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:33.940204    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04712e31-88ec-4ca0-bf93-15114de70d66-extensions-socket-volume\") pod \"04712e31-88ec-4ca0-bf93-15114de70d66\" (UID: \"04712e31-88ec-4ca0-bf93-15114de70d66\") "
Jun 03 19:48:33.940994 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:33.940939    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04712e31-88ec-4ca0-bf93-15114de70d66-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "04712e31-88ec-4ca0-bf93-15114de70d66" (UID: "04712e31-88ec-4ca0-bf93-15114de70d66"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 19:48:33.943648 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:33.943611    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04712e31-88ec-4ca0-bf93-15114de70d66-kube-api-access-bq7xn" (OuterVolumeSpecName: "kube-api-access-bq7xn") pod "04712e31-88ec-4ca0-bf93-15114de70d66" (UID: "04712e31-88ec-4ca0-bf93-15114de70d66"). InnerVolumeSpecName "kube-api-access-bq7xn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:48:34.041790 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:34.041739    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq7xn\" (UniqueName: \"kubernetes.io/projected/04712e31-88ec-4ca0-bf93-15114de70d66-kube-api-access-bq7xn\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:48:34.041790 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:34.041778    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/04712e31-88ec-4ca0-bf93-15114de70d66-extensions-socket-volume\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:48:34.673196 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:34.673154    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:34.770241 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:34.770198    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:35.881783 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:35.881746    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04712e31-88ec-4ca0-bf93-15114de70d66" path="/var/lib/kubelet/pods/04712e31-88ec-4ca0-bf93-15114de70d66/volumes"
Jun 03 19:48:38.280827 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:38.280788    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:38.361560 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:38.361523    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:38.477640 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:38.477605    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:38.579379 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:38.579290    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:42.067184 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:42.067137    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:42.125605 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:42.125572    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:46.637248 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:46.637200    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:46.735816 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:46.735783    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:48:48.885562 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:48.885393    2563 scope.go:117] "RemoveContainer" containerID="61d8708eebd244028f93f03e99d02ca8630422f8241f60d2120636374e9f3f7a"
Jun 03 19:48:48.885847 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:48:48.885803    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61d8708eebd244028f93f03e99d02ca8630422f8241f60d2120636374e9f3f7a\": container with ID starting with 61d8708eebd244028f93f03e99d02ca8630422f8241f60d2120636374e9f3f7a not found: ID does not exist" containerID="61d8708eebd244028f93f03e99d02ca8630422f8241f60d2120636374e9f3f7a"
Jun 03 19:48:48.885912 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:48.885836    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d8708eebd244028f93f03e99d02ca8630422f8241f60d2120636374e9f3f7a"} err="failed to get container status \"61d8708eebd244028f93f03e99d02ca8630422f8241f60d2120636374e9f3f7a\": rpc error: code = NotFound desc = could not find container \"61d8708eebd244028f93f03e99d02ca8630422f8241f60d2120636374e9f3f7a\": container with ID starting with 61d8708eebd244028f93f03e99d02ca8630422f8241f60d2120636374e9f3f7a not found: ID does not exist"
Jun 03 19:48:48.919070 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:48.919027    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f79787f74-dqp8n" podUID="5421efc8-00fd-496e-bc96-c91dca3d2ac5" containerName="console" containerID="cri-o://5530b48d5b543bf47e1a227f9d493e76bd8a14a246449612919c4eda889740a2" gracePeriod=15
Jun 03 19:48:49.257574 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.257538    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:48:49.299111 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.299078    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kfff\" (UniqueName: \"kubernetes.io/projected/5421efc8-00fd-496e-bc96-c91dca3d2ac5-kube-api-access-8kfff\") pod \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") "
Jun 03 19:48:49.299294 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.299122    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-service-ca\") pod \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") "
Jun 03 19:48:49.299294 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.299155    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-config\") pod \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") "
Jun 03 19:48:49.299294 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.299180    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-oauth-serving-cert\") pod \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") "
Jun 03 19:48:49.299294 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.299234    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-trusted-ca-bundle\") pod \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") "
Jun 03 19:48:49.299294 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.299281    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-serving-cert\") pod \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") "
Jun 03 19:48:49.299583 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.299321    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-oauth-config\") pod \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\" (UID: \"5421efc8-00fd-496e-bc96-c91dca3d2ac5\") "
Jun 03 19:48:49.299716 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.299667    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-service-ca" (OuterVolumeSpecName: "service-ca") pod "5421efc8-00fd-496e-bc96-c91dca3d2ac5" (UID: "5421efc8-00fd-496e-bc96-c91dca3d2ac5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:48:49.299941 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.299709    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-config" (OuterVolumeSpecName: "console-config") pod "5421efc8-00fd-496e-bc96-c91dca3d2ac5" (UID: "5421efc8-00fd-496e-bc96-c91dca3d2ac5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:48:49.299941 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.299779    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5421efc8-00fd-496e-bc96-c91dca3d2ac5" (UID: "5421efc8-00fd-496e-bc96-c91dca3d2ac5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:48:49.299941 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.299800    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5421efc8-00fd-496e-bc96-c91dca3d2ac5" (UID: "5421efc8-00fd-496e-bc96-c91dca3d2ac5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:48:49.302123 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.302082    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5421efc8-00fd-496e-bc96-c91dca3d2ac5-kube-api-access-8kfff" (OuterVolumeSpecName: "kube-api-access-8kfff") pod "5421efc8-00fd-496e-bc96-c91dca3d2ac5" (UID: "5421efc8-00fd-496e-bc96-c91dca3d2ac5"). InnerVolumeSpecName "kube-api-access-8kfff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:48:49.302123 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.302106    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5421efc8-00fd-496e-bc96-c91dca3d2ac5" (UID: "5421efc8-00fd-496e-bc96-c91dca3d2ac5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:48:49.302310 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.302184    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5421efc8-00fd-496e-bc96-c91dca3d2ac5" (UID: "5421efc8-00fd-496e-bc96-c91dca3d2ac5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:48:49.400484 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.400450    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kfff\" (UniqueName: \"kubernetes.io/projected/5421efc8-00fd-496e-bc96-c91dca3d2ac5-kube-api-access-8kfff\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:48:49.400484 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.400485    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-service-ca\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:48:49.400692 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.400501    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-config\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:48:49.400692 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.400513    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-oauth-serving-cert\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:48:49.400692 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.400526    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5421efc8-00fd-496e-bc96-c91dca3d2ac5-trusted-ca-bundle\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:48:49.400692 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.400550    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-serving-cert\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:48:49.400692 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.400562    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5421efc8-00fd-496e-bc96-c91dca3d2ac5-console-oauth-config\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:48:49.401767 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.401744    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"]
Jun 03 19:48:49.402142 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.402128    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5421efc8-00fd-496e-bc96-c91dca3d2ac5" containerName="console"
Jun 03 19:48:49.402185 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.402144    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5421efc8-00fd-496e-bc96-c91dca3d2ac5" containerName="console"
Jun 03 19:48:49.402185 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.402174    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04712e31-88ec-4ca0-bf93-15114de70d66" containerName="manager"
Jun 03 19:48:49.402185 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.402179    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="04712e31-88ec-4ca0-bf93-15114de70d66" containerName="manager"
Jun 03 19:48:49.402276 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.402238    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5421efc8-00fd-496e-bc96-c91dca3d2ac5" containerName="console"
Jun 03 19:48:49.402276 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.402250    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="04712e31-88ec-4ca0-bf93-15114de70d66" containerName="manager"
Jun 03 19:48:49.404443 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.404427    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"
Jun 03 19:48:49.407464 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.407439    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mhpgf\""
Jun 03 19:48:49.421169 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.421135    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"]
Jun 03 19:48:49.501922 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.501854    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-c2hl4\" (UID: \"d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"
Jun 03 19:48:49.502095 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.501927    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95pn7\" (UniqueName: \"kubernetes.io/projected/d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1-kube-api-access-95pn7\") pod \"kuadrant-operator-controller-manager-86878c769f-c2hl4\" (UID: \"d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"
Jun 03 19:48:49.602658 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.602618    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-c2hl4\" (UID: \"d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"
Jun 03 19:48:49.602658 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.602662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95pn7\" (UniqueName: \"kubernetes.io/projected/d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1-kube-api-access-95pn7\") pod \"kuadrant-operator-controller-manager-86878c769f-c2hl4\" (UID: \"d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"
Jun 03 19:48:49.603104 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.603072    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-c2hl4\" (UID: \"d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"
Jun 03 19:48:49.612298 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.612273    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95pn7\" (UniqueName: \"kubernetes.io/projected/d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1-kube-api-access-95pn7\") pod \"kuadrant-operator-controller-manager-86878c769f-c2hl4\" (UID: \"d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"
Jun 03 19:48:49.714787 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.714747    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"
Jun 03 19:48:49.859271 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.859244    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"]
Jun 03 19:48:49.862067 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:48:49.862036    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3cf1c8f_5fef_467c_ad2e_0cf6e40accb1.slice/crio-0ff6766bd547bd7b812bd045a1f3d5e70f3d9587a58fef8bf18424aba9745bdb WatchSource:0}: Error finding container 0ff6766bd547bd7b812bd045a1f3d5e70f3d9587a58fef8bf18424aba9745bdb: Status 404 returned error can't find the container with id 0ff6766bd547bd7b812bd045a1f3d5e70f3d9587a58fef8bf18424aba9745bdb
Jun 03 19:48:49.976709 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.976656    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh" event={"ID":"e04f51b2-6a58-408f-b6f1-83046aa3e201","Type":"ContainerStarted","Data":"4be23e4f42b81a459c6ca49cbfb51a021f4120483f0abdded7ecd0d6b403e214"}
Jun 03 19:48:49.978537 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.978505    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4" event={"ID":"d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1","Type":"ContainerStarted","Data":"820c928a045aed8351a75533de1701227620efc0a5bb5cc77289834cddefb310"}
Jun 03 19:48:49.978648 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.978562    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4" event={"ID":"d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1","Type":"ContainerStarted","Data":"0ff6766bd547bd7b812bd045a1f3d5e70f3d9587a58fef8bf18424aba9745bdb"}
Jun 03 19:48:49.978648 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.978592    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"
Jun 03 19:48:49.979826 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.979803    2563 generic.go:356] "Generic (PLEG): container finished" podID="5421efc8-00fd-496e-bc96-c91dca3d2ac5" containerID="5530b48d5b543bf47e1a227f9d493e76bd8a14a246449612919c4eda889740a2" exitCode=0
Jun 03 19:48:49.979907 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.979844    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f79787f74-dqp8n" event={"ID":"5421efc8-00fd-496e-bc96-c91dca3d2ac5","Type":"ContainerDied","Data":"5530b48d5b543bf47e1a227f9d493e76bd8a14a246449612919c4eda889740a2"}
Jun 03 19:48:49.979907 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.979854    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f79787f74-dqp8n"
Jun 03 19:48:49.979907 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.979902    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f79787f74-dqp8n" event={"ID":"5421efc8-00fd-496e-bc96-c91dca3d2ac5","Type":"ContainerDied","Data":"27cf4e1cb4a866eace1d3a39320d410e193f7d49b3c6a01d3d03041fe728a209"}
Jun 03 19:48:49.980021 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.979924    2563 scope.go:117] "RemoveContainer" containerID="5530b48d5b543bf47e1a227f9d493e76bd8a14a246449612919c4eda889740a2"
Jun 03 19:48:49.988683 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.988663    2563 scope.go:117] "RemoveContainer" containerID="5530b48d5b543bf47e1a227f9d493e76bd8a14a246449612919c4eda889740a2"
Jun 03 19:48:49.989038 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:48:49.989015    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5530b48d5b543bf47e1a227f9d493e76bd8a14a246449612919c4eda889740a2\": container with ID starting with 5530b48d5b543bf47e1a227f9d493e76bd8a14a246449612919c4eda889740a2 not found: ID does not exist" containerID="5530b48d5b543bf47e1a227f9d493e76bd8a14a246449612919c4eda889740a2"
Jun 03 19:48:49.989126 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:49.989049    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5530b48d5b543bf47e1a227f9d493e76bd8a14a246449612919c4eda889740a2"} err="failed to get container status \"5530b48d5b543bf47e1a227f9d493e76bd8a14a246449612919c4eda889740a2\": rpc error: code = NotFound desc = could not find container \"5530b48d5b543bf47e1a227f9d493e76bd8a14a246449612919c4eda889740a2\": container with ID starting with 5530b48d5b543bf47e1a227f9d493e76bd8a14a246449612919c4eda889740a2 not found: ID does not exist"
Jun 03 19:48:50.014539 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:50.014418    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mqqfh" podStartSLOduration=2.790701241 podStartE2EDuration="28.014381876s" totalImagesPullingTime="25.223680635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:48:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:48:49.995564872 +0000 UTC m=+456.586048263" watchObservedRunningTime="2026-06-03 19:48:50.014381876 +0000 UTC m=+456.604865268"
Jun 03 19:48:50.016005 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:50.015929    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f79787f74-dqp8n"]
Jun 03 19:48:50.025169 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:50.025130    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f79787f74-dqp8n"]
Jun 03 19:48:50.045599 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:50.045524    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4" podStartSLOduration=1.045503023 podStartE2EDuration="1.045503023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:48:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:48:50.043452813 +0000 UTC m=+456.633936206" watchObservedRunningTime="2026-06-03 19:48:50.045503023 +0000 UTC m=+456.635986417"
Jun 03 19:48:51.881621 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:48:51.881586    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5421efc8-00fd-496e-bc96-c91dca3d2ac5" path="/var/lib/kubelet/pods/5421efc8-00fd-496e-bc96-c91dca3d2ac5/volumes"
Jun 03 19:49:00.988506 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:00.988472    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"
Jun 03 19:49:05.350484 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:05.350444    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:49:05.414627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:05.414595    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:49:08.597741 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:08.597697    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:49:20.003718 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:20.003679    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:49:20.101177 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:20.101137    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:49:20.202208 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:20.202169    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:49:20.804453 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:20.804405    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-452g6"]
Jun 03 19:49:20.843392 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:20.843362    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:49:20.895413 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:20.895371    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-452g6"]
Jun 03 19:49:20.895604 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:20.895504    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-452g6"
Jun 03 19:49:20.898603 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:20.898575    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6mh4m\""
Jun 03 19:49:20.918980 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:20.918942    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:49:20.955633 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:20.955596    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-rvks4"]
Jun 03 19:49:20.964261 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:20.964236    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rvks4"
Jun 03 19:49:20.970309 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:20.970276    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rvks4"]
Jun 03 19:49:20.985210 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:20.985176    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44bh5\" (UniqueName: \"kubernetes.io/projected/627ed4d3-3adf-4e20-a9f6-c203a9e0e47f-kube-api-access-44bh5\") pod \"authorino-75d556bd77-rvks4\" (UID: \"627ed4d3-3adf-4e20-a9f6-c203a9e0e47f\") " pod="kuadrant-system/authorino-75d556bd77-rvks4"
Jun 03 19:49:21.086747 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:21.086655    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmfss\" (UniqueName: \"kubernetes.io/projected/adfa9686-2e1d-47cd-960c-3931d6bbce64-kube-api-access-vmfss\") pod \"authorino-58cd955675-452g6\" (UID: \"adfa9686-2e1d-47cd-960c-3931d6bbce64\") " pod="kuadrant-system/authorino-58cd955675-452g6"
Jun 03 19:49:21.087149 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:21.086769    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44bh5\" (UniqueName: \"kubernetes.io/projected/627ed4d3-3adf-4e20-a9f6-c203a9e0e47f-kube-api-access-44bh5\") pod \"authorino-75d556bd77-rvks4\" (UID: \"627ed4d3-3adf-4e20-a9f6-c203a9e0e47f\") " pod="kuadrant-system/authorino-75d556bd77-rvks4"
Jun 03 19:49:21.096474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:21.096446    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44bh5\" (UniqueName: \"kubernetes.io/projected/627ed4d3-3adf-4e20-a9f6-c203a9e0e47f-kube-api-access-44bh5\") pod \"authorino-75d556bd77-rvks4\" (UID: \"627ed4d3-3adf-4e20-a9f6-c203a9e0e47f\") " pod="kuadrant-system/authorino-75d556bd77-rvks4"
Jun 03 19:49:21.187772 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:21.187733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmfss\" (UniqueName: \"kubernetes.io/projected/adfa9686-2e1d-47cd-960c-3931d6bbce64-kube-api-access-vmfss\") pod \"authorino-58cd955675-452g6\" (UID: \"adfa9686-2e1d-47cd-960c-3931d6bbce64\") " pod="kuadrant-system/authorino-58cd955675-452g6"
Jun 03 19:49:21.197638 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:21.197603    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmfss\" (UniqueName: \"kubernetes.io/projected/adfa9686-2e1d-47cd-960c-3931d6bbce64-kube-api-access-vmfss\") pod \"authorino-58cd955675-452g6\" (UID: \"adfa9686-2e1d-47cd-960c-3931d6bbce64\") " pod="kuadrant-system/authorino-58cd955675-452g6"
Jun 03 19:49:21.206222 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:21.206193    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-452g6"
Jun 03 19:49:21.275269 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:21.275215    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rvks4"
Jun 03 19:49:21.374551 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:21.374418    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-452g6"]
Jun 03 19:49:21.378152 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:49:21.378116    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadfa9686_2e1d_47cd_960c_3931d6bbce64.slice/crio-45908196e0894cf048729cf7bf0a49393317f52b06044240413f3d4c43f3fe69 WatchSource:0}: Error finding container 45908196e0894cf048729cf7bf0a49393317f52b06044240413f3d4c43f3fe69: Status 404 returned error can't find the container with id 45908196e0894cf048729cf7bf0a49393317f52b06044240413f3d4c43f3fe69
Jun 03 19:49:21.429093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:21.429065    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rvks4"]
Jun 03 19:49:21.431001 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:49:21.430967    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod627ed4d3_3adf_4e20_a9f6_c203a9e0e47f.slice/crio-07b3d5264fb7b63a6feb48f04ed1409fbd93fd05ac96a1a7a2560015c24baee4 WatchSource:0}: Error finding container 07b3d5264fb7b63a6feb48f04ed1409fbd93fd05ac96a1a7a2560015c24baee4: Status 404 returned error can't find the container with id 07b3d5264fb7b63a6feb48f04ed1409fbd93fd05ac96a1a7a2560015c24baee4
Jun 03 19:49:22.146665 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:22.146554    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rvks4" event={"ID":"627ed4d3-3adf-4e20-a9f6-c203a9e0e47f","Type":"ContainerStarted","Data":"07b3d5264fb7b63a6feb48f04ed1409fbd93fd05ac96a1a7a2560015c24baee4"}
Jun 03 19:49:22.149611 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:22.149556    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-452g6" event={"ID":"adfa9686-2e1d-47cd-960c-3931d6bbce64","Type":"ContainerStarted","Data":"45908196e0894cf048729cf7bf0a49393317f52b06044240413f3d4c43f3fe69"}
Jun 03 19:49:25.167160 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:25.167043    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-452g6" event={"ID":"adfa9686-2e1d-47cd-960c-3931d6bbce64","Type":"ContainerStarted","Data":"95208b0672b43ee894aaccb3f532cf121833768e3321a235194a79cb5e108296"}
Jun 03 19:49:25.168571 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:25.168538    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rvks4" event={"ID":"627ed4d3-3adf-4e20-a9f6-c203a9e0e47f","Type":"ContainerStarted","Data":"960405c78940219d6eb24afca5fa403bedda0fe645588d6ee5091a577415446a"}
Jun 03 19:49:25.184501 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:25.184446    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-452g6" podStartSLOduration=1.7355145840000001 podStartE2EDuration="5.184427649s" totalImagesPullingTime="3.448913065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:49:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:49:25.183523795 +0000 UTC m=+491.774007188" watchObservedRunningTime="2026-06-03 19:49:25.184427649 +0000 UTC m=+491.774911040"
Jun 03 19:49:25.200589 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:25.200525    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-rvks4" podStartSLOduration=1.818924044 podStartE2EDuration="5.200507901s" totalImagesPullingTime="3.381583857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:49:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:49:25.199440013 +0000 UTC m=+491.789923408" watchObservedRunningTime="2026-06-03 19:49:25.200507901 +0000 UTC m=+491.790991293"
Jun 03 19:49:25.224652 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:25.224612    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-452g6"]
Jun 03 19:49:27.178729 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:27.178681    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-452g6" podUID="adfa9686-2e1d-47cd-960c-3931d6bbce64" containerName="authorino" containerID="cri-o://95208b0672b43ee894aaccb3f532cf121833768e3321a235194a79cb5e108296" gracePeriod=30
Jun 03 19:49:27.437185 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:27.437109    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-452g6"
Jun 03 19:49:27.559582 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:27.559543    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmfss\" (UniqueName: \"kubernetes.io/projected/adfa9686-2e1d-47cd-960c-3931d6bbce64-kube-api-access-vmfss\") pod \"adfa9686-2e1d-47cd-960c-3931d6bbce64\" (UID: \"adfa9686-2e1d-47cd-960c-3931d6bbce64\") "
Jun 03 19:49:27.561831 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:27.561795    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adfa9686-2e1d-47cd-960c-3931d6bbce64-kube-api-access-vmfss" (OuterVolumeSpecName: "kube-api-access-vmfss") pod "adfa9686-2e1d-47cd-960c-3931d6bbce64" (UID: "adfa9686-2e1d-47cd-960c-3931d6bbce64"). InnerVolumeSpecName "kube-api-access-vmfss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:49:27.660447 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:27.660405    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmfss\" (UniqueName: \"kubernetes.io/projected/adfa9686-2e1d-47cd-960c-3931d6bbce64-kube-api-access-vmfss\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:49:28.184520 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:28.184419    2563 generic.go:356] "Generic (PLEG): container finished" podID="adfa9686-2e1d-47cd-960c-3931d6bbce64" containerID="95208b0672b43ee894aaccb3f532cf121833768e3321a235194a79cb5e108296" exitCode=0
Jun 03 19:49:28.184520 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:28.184462    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-452g6"
Jun 03 19:49:28.184520 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:28.184505    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-452g6" event={"ID":"adfa9686-2e1d-47cd-960c-3931d6bbce64","Type":"ContainerDied","Data":"95208b0672b43ee894aaccb3f532cf121833768e3321a235194a79cb5e108296"}
Jun 03 19:49:28.185114 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:28.184561    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-452g6" event={"ID":"adfa9686-2e1d-47cd-960c-3931d6bbce64","Type":"ContainerDied","Data":"45908196e0894cf048729cf7bf0a49393317f52b06044240413f3d4c43f3fe69"}
Jun 03 19:49:28.185114 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:28.184586    2563 scope.go:117] "RemoveContainer" containerID="95208b0672b43ee894aaccb3f532cf121833768e3321a235194a79cb5e108296"
Jun 03 19:49:28.193152 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:28.193133    2563 scope.go:117] "RemoveContainer" containerID="95208b0672b43ee894aaccb3f532cf121833768e3321a235194a79cb5e108296"
Jun 03 19:49:28.193502 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:49:28.193478    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95208b0672b43ee894aaccb3f532cf121833768e3321a235194a79cb5e108296\": container with ID starting with 95208b0672b43ee894aaccb3f532cf121833768e3321a235194a79cb5e108296 not found: ID does not exist" containerID="95208b0672b43ee894aaccb3f532cf121833768e3321a235194a79cb5e108296"
Jun 03 19:49:28.193569 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:28.193512    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95208b0672b43ee894aaccb3f532cf121833768e3321a235194a79cb5e108296"} err="failed to get container status \"95208b0672b43ee894aaccb3f532cf121833768e3321a235194a79cb5e108296\": rpc error: code = NotFound desc = could not find container \"95208b0672b43ee894aaccb3f532cf121833768e3321a235194a79cb5e108296\": container with ID starting with 95208b0672b43ee894aaccb3f532cf121833768e3321a235194a79cb5e108296 not found: ID does not exist"
Jun 03 19:49:28.204018 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:28.203985    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-452g6"]
Jun 03 19:49:28.210746 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:28.210720    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-452g6"]
Jun 03 19:49:29.880741 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:29.880706    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adfa9686-2e1d-47cd-960c-3931d6bbce64" path="/var/lib/kubelet/pods/adfa9686-2e1d-47cd-960c-3931d6bbce64/volumes"
Jun 03 19:49:35.495442 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:35.495405    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:49:35.594253 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:35.594220    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:49:40.442534 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:40.442499    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:49:52.687484 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:52.687429    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:49:52.776148 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:52.776110    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:49:52.912085 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:52.912046    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:49:55.054495 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:55.054463    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:49:55.120801 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:49:55.120766    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:50:17.237750 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:17.237714    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:50:17.338562 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:17.338525    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:50:17.600653 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:17.600618    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:50:17.601069 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:17.601056    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adfa9686-2e1d-47cd-960c-3931d6bbce64" containerName="authorino"
Jun 03 19:50:17.601124 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:17.601072    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="adfa9686-2e1d-47cd-960c-3931d6bbce64" containerName="authorino"
Jun 03 19:50:17.601162 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:17.601135    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="adfa9686-2e1d-47cd-960c-3931d6bbce64" containerName="authorino"
Jun 03 19:50:17.605545 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:17.605520    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:50:17.608409 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:17.608387    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 03 19:50:17.608559 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:17.608493    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-7r4bs\""
Jun 03 19:50:17.608559 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:17.608493    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 03 19:50:17.609959 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:17.609936    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 03 19:50:17.612589 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:17.612564    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:50:17.729802 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:17.729765    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qpbp\" (UniqueName: \"kubernetes.io/projected/bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e-kube-api-access-2qpbp\") pod \"maas-keycloak-0\" (UID: \"bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:50:17.830649 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:17.830601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qpbp\" (UniqueName: \"kubernetes.io/projected/bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e-kube-api-access-2qpbp\") pod \"maas-keycloak-0\" (UID: \"bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:50:17.840601 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:17.840572    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qpbp\" (UniqueName: \"kubernetes.io/projected/bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e-kube-api-access-2qpbp\") pod \"maas-keycloak-0\" (UID: \"bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:50:17.917080 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:17.916983    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:50:18.059348 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:18.059321    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:50:18.061855 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:50:18.061825    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc1a1f4_be0f_4a2c_977b_6153fdd5de6e.slice/crio-e7837654446b1967256f357e10d57b28658f2d852500ff6d3b340bc96c0bd020 WatchSource:0}: Error finding container e7837654446b1967256f357e10d57b28658f2d852500ff6d3b340bc96c0bd020: Status 404 returned error can't find the container with id e7837654446b1967256f357e10d57b28658f2d852500ff6d3b340bc96c0bd020
Jun 03 19:50:18.433731 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:18.433684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e","Type":"ContainerStarted","Data":"e7837654446b1967256f357e10d57b28658f2d852500ff6d3b340bc96c0bd020"}
Jun 03 19:50:23.474754 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:23.473229    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e","Type":"ContainerStarted","Data":"376c3b34ff6fca41de9fd96ece83001379ad614ec78428d8010b02a8d70b1673"}
Jun 03 19:50:23.494676 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:23.494618    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.618691377 podStartE2EDuration="6.494601453s" totalImagesPullingTime="4.875910076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:50:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:50:23.493429952 +0000 UTC m=+550.083913371" watchObservedRunningTime="2026-06-03 19:50:23.494601453 +0000 UTC m=+550.085084872"
Jun 03 19:50:23.917397 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:23.917360    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:50:23.919000 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:23.918948    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused"
Jun 03 19:50:24.917865 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:24.917815    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused"
Jun 03 19:50:25.918090 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:25.918037    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused"
Jun 03 19:50:26.917936 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:26.917861    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused"
Jun 03 19:50:27.917721 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:27.917676    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:50:27.918237 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:27.918038    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused"
Jun 03 19:50:28.918210 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:28.918153    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused"
Jun 03 19:50:29.918672 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:29.918233    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused"
Jun 03 19:50:30.917723 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:30.917664    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused"
Jun 03 19:50:31.918020 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:31.917965    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused"
Jun 03 19:50:32.918266 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:32.918211    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused"
Jun 03 19:50:33.918013 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:33.917943    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused"
Jun 03 19:50:34.918124 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:34.918079    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused"
Jun 03 19:50:35.917830 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:35.917787    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.33:9000/health/started\": dial tcp 10.134.0.33:9000: connect: connection refused"
Jun 03 19:50:37.057167 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:37.057122    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:50:37.078392 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:37.078334    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 19:50:47.065112 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:47.065077    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:50:47.715254 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:47.715215    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:50:47.874330 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:47.874295    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:50:47.943343 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:47.943302    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hzrpv"]
Jun 03 19:50:47.951019 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:47.950990    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hzrpv"
Jun 03 19:50:47.955222 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:47.955190    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hzrpv"]
Jun 03 19:50:48.045314 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.045278    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4dg8\" (UniqueName: \"kubernetes.io/projected/c066242f-b386-4ab3-b6f1-90a4f695816b-kube-api-access-m4dg8\") pod \"authorino-5d4b67c446-hzrpv\" (UID: \"c066242f-b386-4ab3-b6f1-90a4f695816b\") " pod="kuadrant-system/authorino-5d4b67c446-hzrpv"
Jun 03 19:50:48.146362 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.146313    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4dg8\" (UniqueName: \"kubernetes.io/projected/c066242f-b386-4ab3-b6f1-90a4f695816b-kube-api-access-m4dg8\") pod \"authorino-5d4b67c446-hzrpv\" (UID: \"c066242f-b386-4ab3-b6f1-90a4f695816b\") " pod="kuadrant-system/authorino-5d4b67c446-hzrpv"
Jun 03 19:50:48.155301 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.155275    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4dg8\" (UniqueName: \"kubernetes.io/projected/c066242f-b386-4ab3-b6f1-90a4f695816b-kube-api-access-m4dg8\") pod \"authorino-5d4b67c446-hzrpv\" (UID: \"c066242f-b386-4ab3-b6f1-90a4f695816b\") " pod="kuadrant-system/authorino-5d4b67c446-hzrpv"
Jun 03 19:50:48.186638 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.186600    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hzrpv"]
Jun 03 19:50:48.186916 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.186902    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hzrpv"
Jun 03 19:50:48.213319 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.213280    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f688fcf7c-n7rnb"]
Jun 03 19:50:48.215738 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.215720    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f688fcf7c-n7rnb"
Jun 03 19:50:48.224541 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.224499    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f688fcf7c-n7rnb"]
Jun 03 19:50:48.301259 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.301176    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f688fcf7c-n7rnb"]
Jun 03 19:50:48.301532 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:50:48.301508    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-fkn5m], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-f688fcf7c-n7rnb" podUID="3f3370e6-00d6-4278-978a-5feb0f54bb3e"
Jun 03 19:50:48.327449 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.327407    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c4bbd8c4f-pmpmt"]
Jun 03 19:50:48.330708 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.330681    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c4bbd8c4f-pmpmt"
Jun 03 19:50:48.330890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.330711    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hzrpv"]
Jun 03 19:50:48.333602 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.333578    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jun 03 19:50:48.334749 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:50:48.334725    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc066242f_b386_4ab3_b6f1_90a4f695816b.slice/crio-45faf722ae1fbdbb05c83947824fe5b0129bb0448f6088096620d3e40ef11b68 WatchSource:0}: Error finding container 45faf722ae1fbdbb05c83947824fe5b0129bb0448f6088096620d3e40ef11b68: Status 404 returned error can't find the container with id 45faf722ae1fbdbb05c83947824fe5b0129bb0448f6088096620d3e40ef11b68
Jun 03 19:50:48.340169 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.340140    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c4bbd8c4f-pmpmt"]
Jun 03 19:50:48.347632 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.347541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkn5m\" (UniqueName: \"kubernetes.io/projected/3f3370e6-00d6-4278-978a-5feb0f54bb3e-kube-api-access-fkn5m\") pod \"authorino-f688fcf7c-n7rnb\" (UID: \"3f3370e6-00d6-4278-978a-5feb0f54bb3e\") " pod="kuadrant-system/authorino-f688fcf7c-n7rnb"
Jun 03 19:50:48.449107 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.449061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78jpq\" (UniqueName: \"kubernetes.io/projected/e2182bf8-82c9-49bc-ab92-2074ea6bb405-kube-api-access-78jpq\") pod \"authorino-5c4bbd8c4f-pmpmt\" (UID: \"e2182bf8-82c9-49bc-ab92-2074ea6bb405\") " pod="kuadrant-system/authorino-5c4bbd8c4f-pmpmt"
Jun 03 19:50:48.449304 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.449124    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkn5m\" (UniqueName: \"kubernetes.io/projected/3f3370e6-00d6-4278-978a-5feb0f54bb3e-kube-api-access-fkn5m\") pod \"authorino-f688fcf7c-n7rnb\" (UID: \"3f3370e6-00d6-4278-978a-5feb0f54bb3e\") " pod="kuadrant-system/authorino-f688fcf7c-n7rnb"
Jun 03 19:50:48.449304 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.449165    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e2182bf8-82c9-49bc-ab92-2074ea6bb405-tls-cert\") pod \"authorino-5c4bbd8c4f-pmpmt\" (UID: \"e2182bf8-82c9-49bc-ab92-2074ea6bb405\") " pod="kuadrant-system/authorino-5c4bbd8c4f-pmpmt"
Jun 03 19:50:48.457770 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.457744    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkn5m\" (UniqueName: \"kubernetes.io/projected/3f3370e6-00d6-4278-978a-5feb0f54bb3e-kube-api-access-fkn5m\") pod \"authorino-f688fcf7c-n7rnb\" (UID: \"3f3370e6-00d6-4278-978a-5feb0f54bb3e\") " pod="kuadrant-system/authorino-f688fcf7c-n7rnb"
Jun 03 19:50:48.549840 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.549791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e2182bf8-82c9-49bc-ab92-2074ea6bb405-tls-cert\") pod \"authorino-5c4bbd8c4f-pmpmt\" (UID: \"e2182bf8-82c9-49bc-ab92-2074ea6bb405\") " pod="kuadrant-system/authorino-5c4bbd8c4f-pmpmt"
Jun 03 19:50:48.550057 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.549922    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78jpq\" (UniqueName: \"kubernetes.io/projected/e2182bf8-82c9-49bc-ab92-2074ea6bb405-kube-api-access-78jpq\") pod \"authorino-5c4bbd8c4f-pmpmt\" (UID: \"e2182bf8-82c9-49bc-ab92-2074ea6bb405\") " pod="kuadrant-system/authorino-5c4bbd8c4f-pmpmt"
Jun 03 19:50:48.552512 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.552461    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e2182bf8-82c9-49bc-ab92-2074ea6bb405-tls-cert\") pod \"authorino-5c4bbd8c4f-pmpmt\" (UID: \"e2182bf8-82c9-49bc-ab92-2074ea6bb405\") " pod="kuadrant-system/authorino-5c4bbd8c4f-pmpmt"
Jun 03 19:50:48.559140 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.559118    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78jpq\" (UniqueName: \"kubernetes.io/projected/e2182bf8-82c9-49bc-ab92-2074ea6bb405-kube-api-access-78jpq\") pod \"authorino-5c4bbd8c4f-pmpmt\" (UID: \"e2182bf8-82c9-49bc-ab92-2074ea6bb405\") " pod="kuadrant-system/authorino-5c4bbd8c4f-pmpmt"
Jun 03 19:50:48.622552 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.622515    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hzrpv" event={"ID":"c066242f-b386-4ab3-b6f1-90a4f695816b","Type":"ContainerStarted","Data":"45faf722ae1fbdbb05c83947824fe5b0129bb0448f6088096620d3e40ef11b68"}
Jun 03 19:50:48.622552 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.622556    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f688fcf7c-n7rnb"
Jun 03 19:50:48.634560 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.634522    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f688fcf7c-n7rnb"
Jun 03 19:50:48.651004 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.650963    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c4bbd8c4f-pmpmt"
Jun 03 19:50:48.751927 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.751893    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkn5m\" (UniqueName: \"kubernetes.io/projected/3f3370e6-00d6-4278-978a-5feb0f54bb3e-kube-api-access-fkn5m\") pod \"3f3370e6-00d6-4278-978a-5feb0f54bb3e\" (UID: \"3f3370e6-00d6-4278-978a-5feb0f54bb3e\") "
Jun 03 19:50:48.754681 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.754654    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f3370e6-00d6-4278-978a-5feb0f54bb3e-kube-api-access-fkn5m" (OuterVolumeSpecName: "kube-api-access-fkn5m") pod "3f3370e6-00d6-4278-978a-5feb0f54bb3e" (UID: "3f3370e6-00d6-4278-978a-5feb0f54bb3e"). InnerVolumeSpecName "kube-api-access-fkn5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:50:48.797252 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.797226    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c4bbd8c4f-pmpmt"]
Jun 03 19:50:48.799788 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:50:48.799755    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2182bf8_82c9_49bc_ab92_2074ea6bb405.slice/crio-fb366e4ceb5b0741f0bcce9f51791c4d3381ef363fcdc09196363772e5576011 WatchSource:0}: Error finding container fb366e4ceb5b0741f0bcce9f51791c4d3381ef363fcdc09196363772e5576011: Status 404 returned error can't find the container with id fb366e4ceb5b0741f0bcce9f51791c4d3381ef363fcdc09196363772e5576011
Jun 03 19:50:48.853556 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:48.853521    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkn5m\" (UniqueName: \"kubernetes.io/projected/3f3370e6-00d6-4278-978a-5feb0f54bb3e-kube-api-access-fkn5m\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:50:49.628678 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:49.628643    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hzrpv" event={"ID":"c066242f-b386-4ab3-b6f1-90a4f695816b","Type":"ContainerStarted","Data":"5fe86ec52e30cc9c53faff53aced14a274c19f483b6d6d119a35791084bb95f0"}
Jun 03 19:50:49.629104 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:49.628674    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-hzrpv" podUID="c066242f-b386-4ab3-b6f1-90a4f695816b" containerName="authorino" containerID="cri-o://5fe86ec52e30cc9c53faff53aced14a274c19f483b6d6d119a35791084bb95f0" gracePeriod=30
Jun 03 19:50:49.630333 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:49.630308    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c4bbd8c4f-pmpmt" event={"ID":"e2182bf8-82c9-49bc-ab92-2074ea6bb405","Type":"ContainerStarted","Data":"3fa183da77205e0e7168c9852b4d4f73c51525ad9978471f244d274ac2fd76d9"}
Jun 03 19:50:49.630443 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:49.630347    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c4bbd8c4f-pmpmt" event={"ID":"e2182bf8-82c9-49bc-ab92-2074ea6bb405","Type":"ContainerStarted","Data":"fb366e4ceb5b0741f0bcce9f51791c4d3381ef363fcdc09196363772e5576011"}
Jun 03 19:50:49.630443 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:49.630315    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f688fcf7c-n7rnb"
Jun 03 19:50:49.644680 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:49.644634    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-hzrpv" podStartSLOduration=2.280293648 podStartE2EDuration="2.644617505s" totalImagesPullingTime="364.323857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:50:49.64369409 +0000 UTC m=+576.234177482" watchObservedRunningTime="2026-06-03 19:50:49.644617505 +0000 UTC m=+576.235100897"
Jun 03 19:50:49.662246 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:49.662188    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c4bbd8c4f-pmpmt" podStartSLOduration=1.366784145 podStartE2EDuration="1.662170652s" totalImagesPullingTime="295.386507ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:50:49.660732418 +0000 UTC m=+576.251215810" watchObservedRunningTime="2026-06-03 19:50:49.662170652 +0000 UTC m=+576.252654042"
Jun 03 19:50:49.687820 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:49.687788    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rvks4"]
Jun 03 19:50:49.688009 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:49.687973    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-rvks4" podUID="627ed4d3-3adf-4e20-a9f6-c203a9e0e47f" containerName="authorino" containerID="cri-o://960405c78940219d6eb24afca5fa403bedda0fe645588d6ee5091a577415446a" gracePeriod=30
Jun 03 19:50:49.714551 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:49.714514    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:50:49.729944 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:49.729905    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f688fcf7c-n7rnb"]
Jun 03 19:50:49.734792 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:49.734759    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f688fcf7c-n7rnb"]
Jun 03 19:50:49.776732 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:49.776691    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:50:49.881374 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:49.881292    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f3370e6-00d6-4278-978a-5feb0f54bb3e" path="/var/lib/kubelet/pods/3f3370e6-00d6-4278-978a-5feb0f54bb3e/volumes"
Jun 03 19:50:49.948256 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:49.948227    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hzrpv"
Jun 03 19:50:49.951620 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:49.951595    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rvks4"
Jun 03 19:50:50.064722 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.064674    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4dg8\" (UniqueName: \"kubernetes.io/projected/c066242f-b386-4ab3-b6f1-90a4f695816b-kube-api-access-m4dg8\") pod \"c066242f-b386-4ab3-b6f1-90a4f695816b\" (UID: \"c066242f-b386-4ab3-b6f1-90a4f695816b\") "
Jun 03 19:50:50.064946 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.064841    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44bh5\" (UniqueName: \"kubernetes.io/projected/627ed4d3-3adf-4e20-a9f6-c203a9e0e47f-kube-api-access-44bh5\") pod \"627ed4d3-3adf-4e20-a9f6-c203a9e0e47f\" (UID: \"627ed4d3-3adf-4e20-a9f6-c203a9e0e47f\") "
Jun 03 19:50:50.067158 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.067120    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c066242f-b386-4ab3-b6f1-90a4f695816b-kube-api-access-m4dg8" (OuterVolumeSpecName: "kube-api-access-m4dg8") pod "c066242f-b386-4ab3-b6f1-90a4f695816b" (UID: "c066242f-b386-4ab3-b6f1-90a4f695816b"). InnerVolumeSpecName "kube-api-access-m4dg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:50:50.067274 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.067162    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/627ed4d3-3adf-4e20-a9f6-c203a9e0e47f-kube-api-access-44bh5" (OuterVolumeSpecName: "kube-api-access-44bh5") pod "627ed4d3-3adf-4e20-a9f6-c203a9e0e47f" (UID: "627ed4d3-3adf-4e20-a9f6-c203a9e0e47f"). InnerVolumeSpecName "kube-api-access-44bh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:50:50.166486 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.166457    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44bh5\" (UniqueName: \"kubernetes.io/projected/627ed4d3-3adf-4e20-a9f6-c203a9e0e47f-kube-api-access-44bh5\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:50:50.166486 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.166485    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4dg8\" (UniqueName: \"kubernetes.io/projected/c066242f-b386-4ab3-b6f1-90a4f695816b-kube-api-access-m4dg8\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:50:50.636474 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.636440    2563 generic.go:356] "Generic (PLEG): container finished" podID="c066242f-b386-4ab3-b6f1-90a4f695816b" containerID="5fe86ec52e30cc9c53faff53aced14a274c19f483b6d6d119a35791084bb95f0" exitCode=0
Jun 03 19:50:50.636968 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.636483    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hzrpv"
Jun 03 19:50:50.636968 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.636483    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hzrpv" event={"ID":"c066242f-b386-4ab3-b6f1-90a4f695816b","Type":"ContainerDied","Data":"5fe86ec52e30cc9c53faff53aced14a274c19f483b6d6d119a35791084bb95f0"}
Jun 03 19:50:50.636968 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.636537    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hzrpv" event={"ID":"c066242f-b386-4ab3-b6f1-90a4f695816b","Type":"ContainerDied","Data":"45faf722ae1fbdbb05c83947824fe5b0129bb0448f6088096620d3e40ef11b68"}
Jun 03 19:50:50.636968 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.636556    2563 scope.go:117] "RemoveContainer" containerID="5fe86ec52e30cc9c53faff53aced14a274c19f483b6d6d119a35791084bb95f0"
Jun 03 19:50:50.638057 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.638035    2563 generic.go:356] "Generic (PLEG): container finished" podID="627ed4d3-3adf-4e20-a9f6-c203a9e0e47f" containerID="960405c78940219d6eb24afca5fa403bedda0fe645588d6ee5091a577415446a" exitCode=0
Jun 03 19:50:50.638176 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.638081    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rvks4"
Jun 03 19:50:50.638176 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.638084    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rvks4" event={"ID":"627ed4d3-3adf-4e20-a9f6-c203a9e0e47f","Type":"ContainerDied","Data":"960405c78940219d6eb24afca5fa403bedda0fe645588d6ee5091a577415446a"}
Jun 03 19:50:50.638176 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.638137    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rvks4" event={"ID":"627ed4d3-3adf-4e20-a9f6-c203a9e0e47f","Type":"ContainerDied","Data":"07b3d5264fb7b63a6feb48f04ed1409fbd93fd05ac96a1a7a2560015c24baee4"}
Jun 03 19:50:50.645857 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.645831    2563 scope.go:117] "RemoveContainer" containerID="5fe86ec52e30cc9c53faff53aced14a274c19f483b6d6d119a35791084bb95f0"
Jun 03 19:50:50.646249 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:50:50.646225    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fe86ec52e30cc9c53faff53aced14a274c19f483b6d6d119a35791084bb95f0\": container with ID starting with 5fe86ec52e30cc9c53faff53aced14a274c19f483b6d6d119a35791084bb95f0 not found: ID does not exist" containerID="5fe86ec52e30cc9c53faff53aced14a274c19f483b6d6d119a35791084bb95f0"
Jun 03 19:50:50.646344 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.646259    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fe86ec52e30cc9c53faff53aced14a274c19f483b6d6d119a35791084bb95f0"} err="failed to get container status \"5fe86ec52e30cc9c53faff53aced14a274c19f483b6d6d119a35791084bb95f0\": rpc error: code = NotFound desc = could not find container \"5fe86ec52e30cc9c53faff53aced14a274c19f483b6d6d119a35791084bb95f0\": container with ID starting with 5fe86ec52e30cc9c53faff53aced14a274c19f483b6d6d119a35791084bb95f0 not found: ID does not exist"
Jun 03 19:50:50.646344 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.646276    2563 scope.go:117] "RemoveContainer" containerID="960405c78940219d6eb24afca5fa403bedda0fe645588d6ee5091a577415446a"
Jun 03 19:50:50.654991 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.654967    2563 scope.go:117] "RemoveContainer" containerID="960405c78940219d6eb24afca5fa403bedda0fe645588d6ee5091a577415446a"
Jun 03 19:50:50.655320 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:50:50.655296    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"960405c78940219d6eb24afca5fa403bedda0fe645588d6ee5091a577415446a\": container with ID starting with 960405c78940219d6eb24afca5fa403bedda0fe645588d6ee5091a577415446a not found: ID does not exist" containerID="960405c78940219d6eb24afca5fa403bedda0fe645588d6ee5091a577415446a"
Jun 03 19:50:50.655403 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.655329    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"960405c78940219d6eb24afca5fa403bedda0fe645588d6ee5091a577415446a"} err="failed to get container status \"960405c78940219d6eb24afca5fa403bedda0fe645588d6ee5091a577415446a\": rpc error: code = NotFound desc = could not find container \"960405c78940219d6eb24afca5fa403bedda0fe645588d6ee5091a577415446a\": container with ID starting with 960405c78940219d6eb24afca5fa403bedda0fe645588d6ee5091a577415446a not found: ID does not exist"
Jun 03 19:50:50.662599 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.662564    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rvks4"]
Jun 03 19:50:50.666626 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.666598    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rvks4"]
Jun 03 19:50:50.678942 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.678912    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hzrpv"]
Jun 03 19:50:50.682815 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:50.682786    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hzrpv"]
Jun 03 19:50:51.881584 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:51.881551    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="627ed4d3-3adf-4e20-a9f6-c203a9e0e47f" path="/var/lib/kubelet/pods/627ed4d3-3adf-4e20-a9f6-c203a9e0e47f/volumes"
Jun 03 19:50:51.881973 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:51.881857    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c066242f-b386-4ab3-b6f1-90a4f695816b" path="/var/lib/kubelet/pods/c066242f-b386-4ab3-b6f1-90a4f695816b/volumes"
Jun 03 19:50:52.858140 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:52.858100    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65b59b4d78-p8tn2"]
Jun 03 19:50:52.858479 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:52.858466    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c066242f-b386-4ab3-b6f1-90a4f695816b" containerName="authorino"
Jun 03 19:50:52.858522 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:52.858481    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c066242f-b386-4ab3-b6f1-90a4f695816b" containerName="authorino"
Jun 03 19:50:52.858522 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:52.858497    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="627ed4d3-3adf-4e20-a9f6-c203a9e0e47f" containerName="authorino"
Jun 03 19:50:52.858522 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:52.858503    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="627ed4d3-3adf-4e20-a9f6-c203a9e0e47f" containerName="authorino"
Jun 03 19:50:52.858612 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:52.858552    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c066242f-b386-4ab3-b6f1-90a4f695816b" containerName="authorino"
Jun 03 19:50:52.858612 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:52.858565    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="627ed4d3-3adf-4e20-a9f6-c203a9e0e47f" containerName="authorino"
Jun 03 19:50:52.861355 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:52.861332    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65b59b4d78-p8tn2"
Jun 03 19:50:52.864709 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:52.864689    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w84g9\""
Jun 03 19:50:52.865822 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:52.865809    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 03 19:50:52.872977 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:52.872948    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65b59b4d78-p8tn2"]
Jun 03 19:50:52.989683 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:52.989633    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bncrc\" (UniqueName: \"kubernetes.io/projected/abe1cdeb-9694-4857-a0a9-f24590e7fce2-kube-api-access-bncrc\") pod \"maas-controller-65b59b4d78-p8tn2\" (UID: \"abe1cdeb-9694-4857-a0a9-f24590e7fce2\") " pod="opendatahub/maas-controller-65b59b4d78-p8tn2"
Jun 03 19:50:53.022001 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:53.021954    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6ddc96b6cd-nkhkm"]
Jun 03 19:50:53.024827 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:53.024801    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ddc96b6cd-nkhkm"
Jun 03 19:50:53.036033 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:53.036001    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ddc96b6cd-nkhkm"]
Jun 03 19:50:53.090834 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:53.090794    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bncrc\" (UniqueName: \"kubernetes.io/projected/abe1cdeb-9694-4857-a0a9-f24590e7fce2-kube-api-access-bncrc\") pod \"maas-controller-65b59b4d78-p8tn2\" (UID: \"abe1cdeb-9694-4857-a0a9-f24590e7fce2\") " pod="opendatahub/maas-controller-65b59b4d78-p8tn2"
Jun 03 19:50:53.100918 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:53.100854    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bncrc\" (UniqueName: \"kubernetes.io/projected/abe1cdeb-9694-4857-a0a9-f24590e7fce2-kube-api-access-bncrc\") pod \"maas-controller-65b59b4d78-p8tn2\" (UID: \"abe1cdeb-9694-4857-a0a9-f24590e7fce2\") " pod="opendatahub/maas-controller-65b59b4d78-p8tn2"
Jun 03 19:50:53.173930 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:53.173805    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65b59b4d78-p8tn2"
Jun 03 19:50:53.191389 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:53.191351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr4ch\" (UniqueName: \"kubernetes.io/projected/dc7e0cb2-3022-48a7-a020-cf23a588df53-kube-api-access-jr4ch\") pod \"maas-controller-6ddc96b6cd-nkhkm\" (UID: \"dc7e0cb2-3022-48a7-a020-cf23a588df53\") " pod="opendatahub/maas-controller-6ddc96b6cd-nkhkm"
Jun 03 19:50:53.292410 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:53.292374    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr4ch\" (UniqueName: \"kubernetes.io/projected/dc7e0cb2-3022-48a7-a020-cf23a588df53-kube-api-access-jr4ch\") pod \"maas-controller-6ddc96b6cd-nkhkm\" (UID: \"dc7e0cb2-3022-48a7-a020-cf23a588df53\") " pod="opendatahub/maas-controller-6ddc96b6cd-nkhkm"
Jun 03 19:50:53.303723 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:53.303669    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr4ch\" (UniqueName: \"kubernetes.io/projected/dc7e0cb2-3022-48a7-a020-cf23a588df53-kube-api-access-jr4ch\") pod \"maas-controller-6ddc96b6cd-nkhkm\" (UID: \"dc7e0cb2-3022-48a7-a020-cf23a588df53\") " pod="opendatahub/maas-controller-6ddc96b6cd-nkhkm"
Jun 03 19:50:53.322693 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:53.322660    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65b59b4d78-p8tn2"]
Jun 03 19:50:53.323340 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:50:53.323313    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe1cdeb_9694_4857_a0a9_f24590e7fce2.slice/crio-003ddee623d5febe07237658c97a645465807778144f0c44301839c1ae9f744f WatchSource:0}: Error finding container 003ddee623d5febe07237658c97a645465807778144f0c44301839c1ae9f744f: Status 404 returned error can't find the container with id 003ddee623d5febe07237658c97a645465807778144f0c44301839c1ae9f744f
Jun 03 19:50:53.336154 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:53.336116    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ddc96b6cd-nkhkm"
Jun 03 19:50:53.486779 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:53.486750    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ddc96b6cd-nkhkm"]
Jun 03 19:50:53.488710 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:50:53.488680    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7e0cb2_3022_48a7_a020_cf23a588df53.slice/crio-bd9dce098480ffc2a64526046e80bb8d86f9f617c84887328674d450a8ee0f6f WatchSource:0}: Error finding container bd9dce098480ffc2a64526046e80bb8d86f9f617c84887328674d450a8ee0f6f: Status 404 returned error can't find the container with id bd9dce098480ffc2a64526046e80bb8d86f9f617c84887328674d450a8ee0f6f
Jun 03 19:50:53.655285 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:53.655242    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65b59b4d78-p8tn2" event={"ID":"abe1cdeb-9694-4857-a0a9-f24590e7fce2","Type":"ContainerStarted","Data":"003ddee623d5febe07237658c97a645465807778144f0c44301839c1ae9f744f"}
Jun 03 19:50:53.656502 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:53.656481    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ddc96b6cd-nkhkm" event={"ID":"dc7e0cb2-3022-48a7-a020-cf23a588df53","Type":"ContainerStarted","Data":"bd9dce098480ffc2a64526046e80bb8d86f9f617c84887328674d450a8ee0f6f"}
Jun 03 19:50:56.227937 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:56.227899    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:50:56.326071 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:56.325978    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:50:56.680318 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:56.680178    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ddc96b6cd-nkhkm" event={"ID":"dc7e0cb2-3022-48a7-a020-cf23a588df53","Type":"ContainerStarted","Data":"85ff4ef861727ed254da82a19050e4441779118f837a25aa6639924590e8d76f"}
Jun 03 19:50:56.680525 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:56.680333    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6ddc96b6cd-nkhkm"
Jun 03 19:50:56.682043 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:56.682005    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65b59b4d78-p8tn2" event={"ID":"abe1cdeb-9694-4857-a0a9-f24590e7fce2","Type":"ContainerStarted","Data":"2fc09ac75be6e2bed953cc3d5f0174a30244fc54defde46477bef4ab097bf9ac"}
Jun 03 19:50:56.682208 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:56.682137    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65b59b4d78-p8tn2"
Jun 03 19:50:56.707429 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:56.707370    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6ddc96b6cd-nkhkm" podStartSLOduration=1.146594208 podStartE2EDuration="3.707352858s" totalImagesPullingTime="2.56075865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:50:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:50:56.705822516 +0000 UTC m=+583.296305934" watchObservedRunningTime="2026-06-03 19:50:56.707352858 +0000 UTC m=+583.297836287"
Jun 03 19:50:56.728180 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:50:56.728114    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65b59b4d78-p8tn2" podStartSLOduration=2.012967338 podStartE2EDuration="4.728098608s" totalImagesPullingTime="2.71513127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:50:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:50:56.726430451 +0000 UTC m=+583.316913843" watchObservedRunningTime="2026-06-03 19:50:56.728098608 +0000 UTC m=+583.318581997"
Jun 03 19:51:07.693106 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:07.693073    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65b59b4d78-p8tn2"
Jun 03 19:51:07.693493 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:07.693150    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6ddc96b6cd-nkhkm"
Jun 03 19:51:07.765842 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:07.765802    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65b59b4d78-p8tn2"]
Jun 03 19:51:07.766081 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:07.766058    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-65b59b4d78-p8tn2" podUID="abe1cdeb-9694-4857-a0a9-f24590e7fce2" containerName="manager" containerID="cri-o://2fc09ac75be6e2bed953cc3d5f0174a30244fc54defde46477bef4ab097bf9ac" gracePeriod=30
Jun 03 19:51:08.013887 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:08.013844    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65b59b4d78-p8tn2"
Jun 03 19:51:08.020374 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:08.020348    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bncrc\" (UniqueName: \"kubernetes.io/projected/abe1cdeb-9694-4857-a0a9-f24590e7fce2-kube-api-access-bncrc\") pod \"abe1cdeb-9694-4857-a0a9-f24590e7fce2\" (UID: \"abe1cdeb-9694-4857-a0a9-f24590e7fce2\") "
Jun 03 19:51:08.022662 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:08.022622    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe1cdeb-9694-4857-a0a9-f24590e7fce2-kube-api-access-bncrc" (OuterVolumeSpecName: "kube-api-access-bncrc") pod "abe1cdeb-9694-4857-a0a9-f24590e7fce2" (UID: "abe1cdeb-9694-4857-a0a9-f24590e7fce2"). InnerVolumeSpecName "kube-api-access-bncrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:51:08.121178 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:08.121131    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bncrc\" (UniqueName: \"kubernetes.io/projected/abe1cdeb-9694-4857-a0a9-f24590e7fce2-kube-api-access-bncrc\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:51:08.740043 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:08.740008    2563 generic.go:356] "Generic (PLEG): container finished" podID="abe1cdeb-9694-4857-a0a9-f24590e7fce2" containerID="2fc09ac75be6e2bed953cc3d5f0174a30244fc54defde46477bef4ab097bf9ac" exitCode=0
Jun 03 19:51:08.740447 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:08.740054    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65b59b4d78-p8tn2"
Jun 03 19:51:08.740447 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:08.740093    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65b59b4d78-p8tn2" event={"ID":"abe1cdeb-9694-4857-a0a9-f24590e7fce2","Type":"ContainerDied","Data":"2fc09ac75be6e2bed953cc3d5f0174a30244fc54defde46477bef4ab097bf9ac"}
Jun 03 19:51:08.740447 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:08.740150    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65b59b4d78-p8tn2" event={"ID":"abe1cdeb-9694-4857-a0a9-f24590e7fce2","Type":"ContainerDied","Data":"003ddee623d5febe07237658c97a645465807778144f0c44301839c1ae9f744f"}
Jun 03 19:51:08.740447 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:08.740181    2563 scope.go:117] "RemoveContainer" containerID="2fc09ac75be6e2bed953cc3d5f0174a30244fc54defde46477bef4ab097bf9ac"
Jun 03 19:51:08.749145 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:08.749125    2563 scope.go:117] "RemoveContainer" containerID="2fc09ac75be6e2bed953cc3d5f0174a30244fc54defde46477bef4ab097bf9ac"
Jun 03 19:51:08.749456 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:51:08.749440    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fc09ac75be6e2bed953cc3d5f0174a30244fc54defde46477bef4ab097bf9ac\": container with ID starting with 2fc09ac75be6e2bed953cc3d5f0174a30244fc54defde46477bef4ab097bf9ac not found: ID does not exist" containerID="2fc09ac75be6e2bed953cc3d5f0174a30244fc54defde46477bef4ab097bf9ac"
Jun 03 19:51:08.749508 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:08.749464    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc09ac75be6e2bed953cc3d5f0174a30244fc54defde46477bef4ab097bf9ac"} err="failed to get container status \"2fc09ac75be6e2bed953cc3d5f0174a30244fc54defde46477bef4ab097bf9ac\": rpc error: code = NotFound desc = could not find container \"2fc09ac75be6e2bed953cc3d5f0174a30244fc54defde46477bef4ab097bf9ac\": container with ID starting with 2fc09ac75be6e2bed953cc3d5f0174a30244fc54defde46477bef4ab097bf9ac not found: ID does not exist"
Jun 03 19:51:08.762756 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:08.762720    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-65b59b4d78-p8tn2"]
Jun 03 19:51:08.767327 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:08.767292    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-65b59b4d78-p8tn2"]
Jun 03 19:51:09.881792 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:09.881741    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abe1cdeb-9694-4857-a0a9-f24590e7fce2" path="/var/lib/kubelet/pods/abe1cdeb-9694-4857-a0a9-f24590e7fce2/volumes"
Jun 03 19:51:13.859271 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:13.859243    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 19:51:13.859754 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:13.859435    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 19:51:16.379175 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:16.379141    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:51:27.297357 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.297274    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:51:27.403318 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.403284    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-669fb6bd94-nr5p5"]
Jun 03 19:51:27.403680 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.403665    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe1cdeb-9694-4857-a0a9-f24590e7fce2" containerName="manager"
Jun 03 19:51:27.403744 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.403682    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe1cdeb-9694-4857-a0a9-f24590e7fce2" containerName="manager"
Jun 03 19:51:27.403744 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.403741    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="abe1cdeb-9694-4857-a0a9-f24590e7fce2" containerName="manager"
Jun 03 19:51:27.405612 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.405594    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-669fb6bd94-nr5p5"
Jun 03 19:51:27.408682 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.408662    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jun 03 19:51:27.410806 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.410788    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-64wxm\""
Jun 03 19:51:27.424612 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.424577    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-669fb6bd94-nr5p5"]
Jun 03 19:51:27.498590 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.498558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7b17776-ab2a-4ebf-afdf-bc4842e3bfe8-maas-api-tls\") pod \"maas-api-669fb6bd94-nr5p5\" (UID: \"b7b17776-ab2a-4ebf-afdf-bc4842e3bfe8\") " pod="opendatahub/maas-api-669fb6bd94-nr5p5"
Jun 03 19:51:27.498794 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.498615    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwgzm\" (UniqueName: \"kubernetes.io/projected/b7b17776-ab2a-4ebf-afdf-bc4842e3bfe8-kube-api-access-qwgzm\") pod \"maas-api-669fb6bd94-nr5p5\" (UID: \"b7b17776-ab2a-4ebf-afdf-bc4842e3bfe8\") " pod="opendatahub/maas-api-669fb6bd94-nr5p5"
Jun 03 19:51:27.578128 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.578037    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:51:27.599484 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.599452    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7b17776-ab2a-4ebf-afdf-bc4842e3bfe8-maas-api-tls\") pod \"maas-api-669fb6bd94-nr5p5\" (UID: \"b7b17776-ab2a-4ebf-afdf-bc4842e3bfe8\") " pod="opendatahub/maas-api-669fb6bd94-nr5p5"
Jun 03 19:51:27.599651 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.599518    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwgzm\" (UniqueName: \"kubernetes.io/projected/b7b17776-ab2a-4ebf-afdf-bc4842e3bfe8-kube-api-access-qwgzm\") pod \"maas-api-669fb6bd94-nr5p5\" (UID: \"b7b17776-ab2a-4ebf-afdf-bc4842e3bfe8\") " pod="opendatahub/maas-api-669fb6bd94-nr5p5"
Jun 03 19:51:27.602164 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.602142    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7b17776-ab2a-4ebf-afdf-bc4842e3bfe8-maas-api-tls\") pod \"maas-api-669fb6bd94-nr5p5\" (UID: \"b7b17776-ab2a-4ebf-afdf-bc4842e3bfe8\") " pod="opendatahub/maas-api-669fb6bd94-nr5p5"
Jun 03 19:51:27.613478 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.613445    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwgzm\" (UniqueName: \"kubernetes.io/projected/b7b17776-ab2a-4ebf-afdf-bc4842e3bfe8-kube-api-access-qwgzm\") pod \"maas-api-669fb6bd94-nr5p5\" (UID: \"b7b17776-ab2a-4ebf-afdf-bc4842e3bfe8\") " pod="opendatahub/maas-api-669fb6bd94-nr5p5"
Jun 03 19:51:27.716562 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.716508    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-669fb6bd94-nr5p5"
Jun 03 19:51:27.891640 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:27.891603    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-669fb6bd94-nr5p5"]
Jun 03 19:51:27.893386 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:51:27.893356    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b17776_ab2a_4ebf_afdf_bc4842e3bfe8.slice/crio-5f8f0fe6a83b3dab70088cd92f4ce50e82845fab84df55a23e4376eb8a7b9774 WatchSource:0}: Error finding container 5f8f0fe6a83b3dab70088cd92f4ce50e82845fab84df55a23e4376eb8a7b9774: Status 404 returned error can't find the container with id 5f8f0fe6a83b3dab70088cd92f4ce50e82845fab84df55a23e4376eb8a7b9774
Jun 03 19:51:28.082350 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:28.082313    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:51:28.173108 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:28.173021    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-k6dp4"]
Jun 03 19:51:28.176071 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:28.176051    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-k6dp4"
Jun 03 19:51:28.180222 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:28.180191    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-cqplj\""
Jun 03 19:51:28.180507 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:28.180479    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jun 03 19:51:28.207530 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:28.207497    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-k6dp4"]
Jun 03 19:51:28.263683 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:28.263648    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:51:28.306042 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:28.306008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n86bp\" (UniqueName: \"kubernetes.io/projected/727344d2-b658-450b-8aa3-34ea3f160c38-kube-api-access-n86bp\") pod \"payload-processing-7c6c859784-k6dp4\" (UID: \"727344d2-b658-450b-8aa3-34ea3f160c38\") " pod="openshift-ingress/payload-processing-7c6c859784-k6dp4"
Jun 03 19:51:28.407100 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:28.407058    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n86bp\" (UniqueName: \"kubernetes.io/projected/727344d2-b658-450b-8aa3-34ea3f160c38-kube-api-access-n86bp\") pod \"payload-processing-7c6c859784-k6dp4\" (UID: \"727344d2-b658-450b-8aa3-34ea3f160c38\") " pod="openshift-ingress/payload-processing-7c6c859784-k6dp4"
Jun 03 19:51:28.421154 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:28.421123    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n86bp\" (UniqueName: \"kubernetes.io/projected/727344d2-b658-450b-8aa3-34ea3f160c38-kube-api-access-n86bp\") pod \"payload-processing-7c6c859784-k6dp4\" (UID: \"727344d2-b658-450b-8aa3-34ea3f160c38\") " pod="openshift-ingress/payload-processing-7c6c859784-k6dp4"
Jun 03 19:51:28.487563 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:28.487463    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-k6dp4"
Jun 03 19:51:28.680210 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:28.680130    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-k6dp4"]
Jun 03 19:51:28.683285 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:51:28.683249    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod727344d2_b658_450b_8aa3_34ea3f160c38.slice/crio-3bff8eed66341c47027e32080c71b933a37e30abf6761033f8447df68d980e73 WatchSource:0}: Error finding container 3bff8eed66341c47027e32080c71b933a37e30abf6761033f8447df68d980e73: Status 404 returned error can't find the container with id 3bff8eed66341c47027e32080c71b933a37e30abf6761033f8447df68d980e73
Jun 03 19:51:28.685601 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:28.685578    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 19:51:28.836590 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:28.836548    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-k6dp4" event={"ID":"727344d2-b658-450b-8aa3-34ea3f160c38","Type":"ContainerStarted","Data":"3bff8eed66341c47027e32080c71b933a37e30abf6761033f8447df68d980e73"}
Jun 03 19:51:28.837755 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:28.837725    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-669fb6bd94-nr5p5" event={"ID":"b7b17776-ab2a-4ebf-afdf-bc4842e3bfe8","Type":"ContainerStarted","Data":"5f8f0fe6a83b3dab70088cd92f4ce50e82845fab84df55a23e4376eb8a7b9774"}
Jun 03 19:51:29.847278 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:29.847174    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-669fb6bd94-nr5p5" event={"ID":"b7b17776-ab2a-4ebf-afdf-bc4842e3bfe8","Type":"ContainerStarted","Data":"44aab74ab858b7d3ede2b0fdfe9a3c260b2356c4c43436b6f378429def79ba19"}
Jun 03 19:51:29.847655 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:29.847454    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-669fb6bd94-nr5p5"
Jun 03 19:51:29.868410 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:29.868340    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-669fb6bd94-nr5p5" podStartSLOduration=1.236710594 podStartE2EDuration="2.868314228s" totalImagesPullingTime="1.631603634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:51:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:51:29.865995436 +0000 UTC m=+616.456478829" watchObservedRunningTime="2026-06-03 19:51:29.868314228 +0000 UTC m=+616.458797621"
Jun 03 19:51:31.859049 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:31.859008    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-k6dp4" event={"ID":"727344d2-b658-450b-8aa3-34ea3f160c38","Type":"ContainerStarted","Data":"158d6ea713f9ec8efca10a6e07357581f70ebf5c164f504ec8eb133e54892919"}
Jun 03 19:51:31.859532 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:31.859184    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-k6dp4"
Jun 03 19:51:31.876037 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:31.875983    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-k6dp4" podStartSLOduration=1.276161956 podStartE2EDuration="3.875964803s" totalImagesPullingTime="2.599802847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:51:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:51:31.875148559 +0000 UTC m=+618.465631963" watchObservedRunningTime="2026-06-03 19:51:31.875964803 +0000 UTC m=+618.466448195"
Jun 03 19:51:35.858031 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:35.857996    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-669fb6bd94-nr5p5"
Jun 03 19:51:37.685019 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:37.684978    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:51:37.685472 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:37.685214    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak" containerID="cri-o://376c3b34ff6fca41de9fd96ece83001379ad614ec78428d8010b02a8d70b1673" gracePeriod=30
Jun 03 19:51:39.737700 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.737675    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:51:39.810614 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.810577    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qpbp\" (UniqueName: \"kubernetes.io/projected/bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e-kube-api-access-2qpbp\") pod \"bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e\" (UID: \"bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e\") "
Jun 03 19:51:39.813016 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.812988    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e-kube-api-access-2qpbp" (OuterVolumeSpecName: "kube-api-access-2qpbp") pod "bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" (UID: "bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e"). InnerVolumeSpecName "kube-api-access-2qpbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:51:39.900211 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.900178    2563 generic.go:356] "Generic (PLEG): container finished" podID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerID="376c3b34ff6fca41de9fd96ece83001379ad614ec78428d8010b02a8d70b1673" exitCode=143
Jun 03 19:51:39.900366 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.900227    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:51:39.900366 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.900235    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e","Type":"ContainerDied","Data":"376c3b34ff6fca41de9fd96ece83001379ad614ec78428d8010b02a8d70b1673"}
Jun 03 19:51:39.900366 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.900275    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e","Type":"ContainerDied","Data":"e7837654446b1967256f357e10d57b28658f2d852500ff6d3b340bc96c0bd020"}
Jun 03 19:51:39.900366 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.900296    2563 scope.go:117] "RemoveContainer" containerID="376c3b34ff6fca41de9fd96ece83001379ad614ec78428d8010b02a8d70b1673"
Jun 03 19:51:39.910394 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.910365    2563 scope.go:117] "RemoveContainer" containerID="376c3b34ff6fca41de9fd96ece83001379ad614ec78428d8010b02a8d70b1673"
Jun 03 19:51:39.910766 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:51:39.910744    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"376c3b34ff6fca41de9fd96ece83001379ad614ec78428d8010b02a8d70b1673\": container with ID starting with 376c3b34ff6fca41de9fd96ece83001379ad614ec78428d8010b02a8d70b1673 not found: ID does not exist" containerID="376c3b34ff6fca41de9fd96ece83001379ad614ec78428d8010b02a8d70b1673"
Jun 03 19:51:39.910903 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.910775    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"376c3b34ff6fca41de9fd96ece83001379ad614ec78428d8010b02a8d70b1673"} err="failed to get container status \"376c3b34ff6fca41de9fd96ece83001379ad614ec78428d8010b02a8d70b1673\": rpc error: code = NotFound desc = could not find container \"376c3b34ff6fca41de9fd96ece83001379ad614ec78428d8010b02a8d70b1673\": container with ID starting with 376c3b34ff6fca41de9fd96ece83001379ad614ec78428d8010b02a8d70b1673 not found: ID does not exist"
Jun 03 19:51:39.911261 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.911240    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qpbp\" (UniqueName: \"kubernetes.io/projected/bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e-kube-api-access-2qpbp\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:51:39.918128 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.918099    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:51:39.925208 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.925179    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:51:39.946977 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.946944    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:51:39.947332 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.947318    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak"
Jun 03 19:51:39.947379 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.947334    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak"
Jun 03 19:51:39.947419 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.947406    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" containerName="keycloak"
Jun 03 19:51:39.951752 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.951733    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:51:39.954862 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.954836    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 03 19:51:39.955022 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.954904    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\""
Jun 03 19:51:39.955022 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.954909    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 03 19:51:39.955190 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.955174    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 03 19:51:39.955260 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.955178    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-7r4bs\""
Jun 03 19:51:39.962830 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:39.962805    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:51:40.113385 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:40.113326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f09855d5-9d71-4741-a9f1-a80fe9873f00-test-realms\") pod \"maas-keycloak-0\" (UID: \"f09855d5-9d71-4741-a9f1-a80fe9873f00\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:51:40.113555 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:40.113468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4vl8\" (UniqueName: \"kubernetes.io/projected/f09855d5-9d71-4741-a9f1-a80fe9873f00-kube-api-access-b4vl8\") pod \"maas-keycloak-0\" (UID: \"f09855d5-9d71-4741-a9f1-a80fe9873f00\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:51:40.214829 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:40.214741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4vl8\" (UniqueName: \"kubernetes.io/projected/f09855d5-9d71-4741-a9f1-a80fe9873f00-kube-api-access-b4vl8\") pod \"maas-keycloak-0\" (UID: \"f09855d5-9d71-4741-a9f1-a80fe9873f00\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:51:40.214829 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:40.214793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f09855d5-9d71-4741-a9f1-a80fe9873f00-test-realms\") pod \"maas-keycloak-0\" (UID: \"f09855d5-9d71-4741-a9f1-a80fe9873f00\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:51:40.215532 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:40.215512    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/f09855d5-9d71-4741-a9f1-a80fe9873f00-test-realms\") pod \"maas-keycloak-0\" (UID: \"f09855d5-9d71-4741-a9f1-a80fe9873f00\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:51:40.224708 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:40.224681    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4vl8\" (UniqueName: \"kubernetes.io/projected/f09855d5-9d71-4741-a9f1-a80fe9873f00-kube-api-access-b4vl8\") pod \"maas-keycloak-0\" (UID: \"f09855d5-9d71-4741-a9f1-a80fe9873f00\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 19:51:40.263132 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:40.263093    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:51:40.409620 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:40.409577    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 19:51:40.412289 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:51:40.412261    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf09855d5_9d71_4741_a9f1_a80fe9873f00.slice/crio-3a0083e2ab164747707998b69fef15d7165be5a88baee9186b9c599cefa89be5 WatchSource:0}: Error finding container 3a0083e2ab164747707998b69fef15d7165be5a88baee9186b9c599cefa89be5: Status 404 returned error can't find the container with id 3a0083e2ab164747707998b69fef15d7165be5a88baee9186b9c599cefa89be5
Jun 03 19:51:40.908639 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:40.908607    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f09855d5-9d71-4741-a9f1-a80fe9873f00","Type":"ContainerStarted","Data":"f4a94a6aaf258ce94a4400ccd0851d746ff42ebfd79a44c5cb7f2dc12ee9d095"}
Jun 03 19:51:40.909122 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:40.908698    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f09855d5-9d71-4741-a9f1-a80fe9873f00","Type":"ContainerStarted","Data":"3a0083e2ab164747707998b69fef15d7165be5a88baee9186b9c599cefa89be5"}
Jun 03 19:51:40.928131 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:40.928077    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.566995747 podStartE2EDuration="1.928059041s" totalImagesPullingTime="361.063294ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:51:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:51:40.926859292 +0000 UTC m=+627.517342695" watchObservedRunningTime="2026-06-03 19:51:40.928059041 +0000 UTC m=+627.518542446"
Jun 03 19:51:41.263528 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:41.263483    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:51:41.265232 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:41.265190    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f09855d5-9d71-4741-a9f1-a80fe9873f00" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 03 19:51:41.885417 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:41.885369    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e" path="/var/lib/kubelet/pods/bdc1a1f4-be0f-4a2c-977b-6153fdd5de6e/volumes"
Jun 03 19:51:42.263999 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:42.263947    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f09855d5-9d71-4741-a9f1-a80fe9873f00" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 03 19:51:42.866492 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:42.866440    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-k6dp4"
Jun 03 19:51:43.264744 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:43.264687    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f09855d5-9d71-4741-a9f1-a80fe9873f00" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 03 19:51:44.264214 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:44.264164    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f09855d5-9d71-4741-a9f1-a80fe9873f00" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 03 19:51:45.263802 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:45.263742    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f09855d5-9d71-4741-a9f1-a80fe9873f00" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 03 19:51:46.263955 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:46.263905    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f09855d5-9d71-4741-a9f1-a80fe9873f00" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 03 19:51:47.264689 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:47.264624    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f09855d5-9d71-4741-a9f1-a80fe9873f00" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 03 19:51:48.264427 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:48.264374    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f09855d5-9d71-4741-a9f1-a80fe9873f00" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 03 19:51:49.264583 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:49.264511    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f09855d5-9d71-4741-a9f1-a80fe9873f00" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 03 19:51:50.263964 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:50.263910    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:51:50.264374 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:50.264338    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f09855d5-9d71-4741-a9f1-a80fe9873f00" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 03 19:51:51.264439 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:51.264391    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f09855d5-9d71-4741-a9f1-a80fe9873f00" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 03 19:51:52.264677 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:52.264629    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f09855d5-9d71-4741-a9f1-a80fe9873f00" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 03 19:51:53.263889 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:53.263810    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f09855d5-9d71-4741-a9f1-a80fe9873f00" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 03 19:51:54.264566 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:54.264499    2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f09855d5-9d71-4741-a9f1-a80fe9873f00" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 03 19:51:55.393945 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:55.393903    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:51:55.411762 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:51:55.411715    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f09855d5-9d71-4741-a9f1-a80fe9873f00" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 19:52:05.398721 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:05.398651    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f09855d5-9d71-4741-a9f1-a80fe9873f00" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 19:52:15.400023 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:15.399971    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 19:52:26.102737 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:26.102685    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-98cc774b9-nnj69"]
Jun 03 19:52:26.107981 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:26.107952    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-98cc774b9-nnj69"
Jun 03 19:52:26.110897 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:26.110850    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\""
Jun 03 19:52:26.116089 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:26.116056    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-98cc774b9-nnj69"]
Jun 03 19:52:26.266316 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:26.266279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2b8d699-331e-43d6-8996-f3b4f4da2c10-tls-cert\") pod \"authorino-98cc774b9-nnj69\" (UID: \"a2b8d699-331e-43d6-8996-f3b4f4da2c10\") " pod="kuadrant-system/authorino-98cc774b9-nnj69"
Jun 03 19:52:26.266520 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:26.266339    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a2b8d699-331e-43d6-8996-f3b4f4da2c10-oidc-ca\") pod \"authorino-98cc774b9-nnj69\" (UID: \"a2b8d699-331e-43d6-8996-f3b4f4da2c10\") " pod="kuadrant-system/authorino-98cc774b9-nnj69"
Jun 03 19:52:26.266520 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:26.266419    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8shls\" (UniqueName: \"kubernetes.io/projected/a2b8d699-331e-43d6-8996-f3b4f4da2c10-kube-api-access-8shls\") pod \"authorino-98cc774b9-nnj69\" (UID: \"a2b8d699-331e-43d6-8996-f3b4f4da2c10\") " pod="kuadrant-system/authorino-98cc774b9-nnj69"
Jun 03 19:52:26.367960 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:26.367838    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2b8d699-331e-43d6-8996-f3b4f4da2c10-tls-cert\") pod \"authorino-98cc774b9-nnj69\" (UID: \"a2b8d699-331e-43d6-8996-f3b4f4da2c10\") " pod="kuadrant-system/authorino-98cc774b9-nnj69"
Jun 03 19:52:26.367960 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:26.367907    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a2b8d699-331e-43d6-8996-f3b4f4da2c10-oidc-ca\") pod \"authorino-98cc774b9-nnj69\" (UID: \"a2b8d699-331e-43d6-8996-f3b4f4da2c10\") " pod="kuadrant-system/authorino-98cc774b9-nnj69"
Jun 03 19:52:26.367960 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:26.367932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8shls\" (UniqueName: \"kubernetes.io/projected/a2b8d699-331e-43d6-8996-f3b4f4da2c10-kube-api-access-8shls\") pod \"authorino-98cc774b9-nnj69\" (UID: \"a2b8d699-331e-43d6-8996-f3b4f4da2c10\") " pod="kuadrant-system/authorino-98cc774b9-nnj69"
Jun 03 19:52:26.368711 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:26.368686    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a2b8d699-331e-43d6-8996-f3b4f4da2c10-oidc-ca\") pod \"authorino-98cc774b9-nnj69\" (UID: \"a2b8d699-331e-43d6-8996-f3b4f4da2c10\") " pod="kuadrant-system/authorino-98cc774b9-nnj69"
Jun 03 19:52:26.370755 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:26.370723    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2b8d699-331e-43d6-8996-f3b4f4da2c10-tls-cert\") pod \"authorino-98cc774b9-nnj69\" (UID: \"a2b8d699-331e-43d6-8996-f3b4f4da2c10\") " pod="kuadrant-system/authorino-98cc774b9-nnj69"
Jun 03 19:52:26.377376 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:26.377349    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8shls\" (UniqueName: \"kubernetes.io/projected/a2b8d699-331e-43d6-8996-f3b4f4da2c10-kube-api-access-8shls\") pod \"authorino-98cc774b9-nnj69\" (UID: \"a2b8d699-331e-43d6-8996-f3b4f4da2c10\") " pod="kuadrant-system/authorino-98cc774b9-nnj69"
Jun 03 19:52:26.419376 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:26.419333    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-98cc774b9-nnj69"
Jun 03 19:52:26.559655 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:26.559620    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-98cc774b9-nnj69"]
Jun 03 19:52:26.562474 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:52:26.562446    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2b8d699_331e_43d6_8996_f3b4f4da2c10.slice/crio-c3a0bf52a35a00650460334b678394212e4a2867ad3bda05e547b18467d3cd5a WatchSource:0}: Error finding container c3a0bf52a35a00650460334b678394212e4a2867ad3bda05e547b18467d3cd5a: Status 404 returned error can't find the container with id c3a0bf52a35a00650460334b678394212e4a2867ad3bda05e547b18467d3cd5a
Jun 03 19:52:27.189818 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:27.189713    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-98cc774b9-nnj69" event={"ID":"a2b8d699-331e-43d6-8996-f3b4f4da2c10","Type":"ContainerStarted","Data":"16e9c098b995254a2681bbe85ae26be94f50747c823af2ada9f352a2a8ea18fe"}
Jun 03 19:52:27.189818 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:27.189779    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-98cc774b9-nnj69" event={"ID":"a2b8d699-331e-43d6-8996-f3b4f4da2c10","Type":"ContainerStarted","Data":"c3a0bf52a35a00650460334b678394212e4a2867ad3bda05e547b18467d3cd5a"}
Jun 03 19:52:27.213424 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:27.213347    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-98cc774b9-nnj69" podStartSLOduration=0.884314454 podStartE2EDuration="1.213322117s" totalImagesPullingTime="329.007663ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:52:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:52:27.211289115 +0000 UTC m=+673.801772507" watchObservedRunningTime="2026-06-03 19:52:27.213322117 +0000 UTC m=+673.803805509"
Jun 03 19:52:27.248261 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:27.248220    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c4bbd8c4f-pmpmt"]
Jun 03 19:52:27.249093 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:27.249047    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5c4bbd8c4f-pmpmt" podUID="e2182bf8-82c9-49bc-ab92-2074ea6bb405" containerName="authorino" containerID="cri-o://3fa183da77205e0e7168c9852b4d4f73c51525ad9978471f244d274ac2fd76d9" gracePeriod=30
Jun 03 19:52:27.536539 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:27.536496    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c4bbd8c4f-pmpmt"
Jun 03 19:52:27.682348 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:27.682321    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e2182bf8-82c9-49bc-ab92-2074ea6bb405-tls-cert\") pod \"e2182bf8-82c9-49bc-ab92-2074ea6bb405\" (UID: \"e2182bf8-82c9-49bc-ab92-2074ea6bb405\") "
Jun 03 19:52:27.682544 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:27.682433    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78jpq\" (UniqueName: \"kubernetes.io/projected/e2182bf8-82c9-49bc-ab92-2074ea6bb405-kube-api-access-78jpq\") pod \"e2182bf8-82c9-49bc-ab92-2074ea6bb405\" (UID: \"e2182bf8-82c9-49bc-ab92-2074ea6bb405\") "
Jun 03 19:52:27.682544 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:27.682416    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:52:27.684660 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:27.684623    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2182bf8-82c9-49bc-ab92-2074ea6bb405-kube-api-access-78jpq" (OuterVolumeSpecName: "kube-api-access-78jpq") pod "e2182bf8-82c9-49bc-ab92-2074ea6bb405" (UID: "e2182bf8-82c9-49bc-ab92-2074ea6bb405"). InnerVolumeSpecName "kube-api-access-78jpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:52:27.694811 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:27.694771    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2182bf8-82c9-49bc-ab92-2074ea6bb405-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e2182bf8-82c9-49bc-ab92-2074ea6bb405" (UID: "e2182bf8-82c9-49bc-ab92-2074ea6bb405"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:52:27.778089 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:27.777996    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:52:27.783205 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:27.783170    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78jpq\" (UniqueName: \"kubernetes.io/projected/e2182bf8-82c9-49bc-ab92-2074ea6bb405-kube-api-access-78jpq\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:52:27.783205 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:27.783203    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e2182bf8-82c9-49bc-ab92-2074ea6bb405-tls-cert\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:52:28.195756 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:28.195661    2563 generic.go:356] "Generic (PLEG): container finished" podID="e2182bf8-82c9-49bc-ab92-2074ea6bb405" containerID="3fa183da77205e0e7168c9852b4d4f73c51525ad9978471f244d274ac2fd76d9" exitCode=0
Jun 03 19:52:28.195756 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:28.195707    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c4bbd8c4f-pmpmt"
Jun 03 19:52:28.195756 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:28.195744    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c4bbd8c4f-pmpmt" event={"ID":"e2182bf8-82c9-49bc-ab92-2074ea6bb405","Type":"ContainerDied","Data":"3fa183da77205e0e7168c9852b4d4f73c51525ad9978471f244d274ac2fd76d9"}
Jun 03 19:52:28.196358 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:28.195778    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c4bbd8c4f-pmpmt" event={"ID":"e2182bf8-82c9-49bc-ab92-2074ea6bb405","Type":"ContainerDied","Data":"fb366e4ceb5b0741f0bcce9f51791c4d3381ef363fcdc09196363772e5576011"}
Jun 03 19:52:28.196358 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:28.195795    2563 scope.go:117] "RemoveContainer" containerID="3fa183da77205e0e7168c9852b4d4f73c51525ad9978471f244d274ac2fd76d9"
Jun 03 19:52:28.204993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:28.204853    2563 scope.go:117] "RemoveContainer" containerID="3fa183da77205e0e7168c9852b4d4f73c51525ad9978471f244d274ac2fd76d9"
Jun 03 19:52:28.205226 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:52:28.205201    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fa183da77205e0e7168c9852b4d4f73c51525ad9978471f244d274ac2fd76d9\": container with ID starting with 3fa183da77205e0e7168c9852b4d4f73c51525ad9978471f244d274ac2fd76d9 not found: ID does not exist" containerID="3fa183da77205e0e7168c9852b4d4f73c51525ad9978471f244d274ac2fd76d9"
Jun 03 19:52:28.205272 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:28.205239    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fa183da77205e0e7168c9852b4d4f73c51525ad9978471f244d274ac2fd76d9"} err="failed to get container status \"3fa183da77205e0e7168c9852b4d4f73c51525ad9978471f244d274ac2fd76d9\": rpc error: code = NotFound desc = could not find container \"3fa183da77205e0e7168c9852b4d4f73c51525ad9978471f244d274ac2fd76d9\": container with ID starting with 3fa183da77205e0e7168c9852b4d4f73c51525ad9978471f244d274ac2fd76d9 not found: ID does not exist"
Jun 03 19:52:28.224558 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:28.224513    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c4bbd8c4f-pmpmt"]
Jun 03 19:52:28.230443 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:28.230415    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c4bbd8c4f-pmpmt"]
Jun 03 19:52:29.881579 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:29.881541    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2182bf8-82c9-49bc-ab92-2074ea6bb405" path="/var/lib/kubelet/pods/e2182bf8-82c9-49bc-ab92-2074ea6bb405/volumes"
Jun 03 19:52:32.312937 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:32.312894    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:52:48.259119 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.259077    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"]
Jun 03 19:52:48.259741 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.259717    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2182bf8-82c9-49bc-ab92-2074ea6bb405" containerName="authorino"
Jun 03 19:52:48.259787 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.259746    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2182bf8-82c9-49bc-ab92-2074ea6bb405" containerName="authorino"
Jun 03 19:52:48.259899 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.259861    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2182bf8-82c9-49bc-ab92-2074ea6bb405" containerName="authorino"
Jun 03 19:52:48.264936 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.264911    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.269263 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.269229    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jun 03 19:52:48.269414 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.269333    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 03 19:52:48.269414 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.269345    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 03 19:52:48.269539 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.269417    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dj52g\""
Jun 03 19:52:48.274660 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.274632    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"]
Jun 03 19:52:48.291285 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.291255    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:52:48.375254 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.375205    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72e6841a-c050-407c-b463-997074cf2c88-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.375439 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.375266    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72e6841a-c050-407c-b463-997074cf2c88-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.375439 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.375340    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/72e6841a-c050-407c-b463-997074cf2c88-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.375439 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.375390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72e6841a-c050-407c-b463-997074cf2c88-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.375439 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.375432    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72e6841a-c050-407c-b463-997074cf2c88-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.375579 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.375448    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r26fg\" (UniqueName: \"kubernetes.io/projected/72e6841a-c050-407c-b463-997074cf2c88-kube-api-access-r26fg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.476286 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.476247    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72e6841a-c050-407c-b463-997074cf2c88-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.476286 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.476286    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r26fg\" (UniqueName: \"kubernetes.io/projected/72e6841a-c050-407c-b463-997074cf2c88-kube-api-access-r26fg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.476563 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.476349    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72e6841a-c050-407c-b463-997074cf2c88-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.476563 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.476377    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72e6841a-c050-407c-b463-997074cf2c88-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.476563 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.476399    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/72e6841a-c050-407c-b463-997074cf2c88-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.476563 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.476420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72e6841a-c050-407c-b463-997074cf2c88-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.476842 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.476802    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72e6841a-c050-407c-b463-997074cf2c88-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.476842 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.476831    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72e6841a-c050-407c-b463-997074cf2c88-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.477032 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.476886    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/72e6841a-c050-407c-b463-997074cf2c88-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.478836 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.478814    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72e6841a-c050-407c-b463-997074cf2c88-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.479032 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.479016    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72e6841a-c050-407c-b463-997074cf2c88-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.485010 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.484982    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r26fg\" (UniqueName: \"kubernetes.io/projected/72e6841a-c050-407c-b463-997074cf2c88-kube-api-access-r26fg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hwplh\" (UID: \"72e6841a-c050-407c-b463-997074cf2c88\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.576950 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.576822    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:48.729005 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:48.728902    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"]
Jun 03 19:52:48.731834 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:52:48.731802    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72e6841a_c050_407c_b463_997074cf2c88.slice/crio-ef27020baec35a6ac48e490023966d22e575ccbbf52b23b9a68afae528641e7d WatchSource:0}: Error finding container ef27020baec35a6ac48e490023966d22e575ccbbf52b23b9a68afae528641e7d: Status 404 returned error can't find the container with id ef27020baec35a6ac48e490023966d22e575ccbbf52b23b9a68afae528641e7d
Jun 03 19:52:49.303699 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:49.303637    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh" event={"ID":"72e6841a-c050-407c-b463-997074cf2c88","Type":"ContainerStarted","Data":"ef27020baec35a6ac48e490023966d22e575ccbbf52b23b9a68afae528641e7d"}
Jun 03 19:52:52.323108 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:52.323072    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh" event={"ID":"72e6841a-c050-407c-b463-997074cf2c88","Type":"ContainerStarted","Data":"ff61d07c5ac351f4ff8c9b996ad0066969d231b5dbf3fb6066456b45d98835d3"}
Jun 03 19:52:53.329708 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:53.329663    2563 generic.go:356] "Generic (PLEG): container finished" podID="72e6841a-c050-407c-b463-997074cf2c88" containerID="ff61d07c5ac351f4ff8c9b996ad0066969d231b5dbf3fb6066456b45d98835d3" exitCode=0
Jun 03 19:52:53.329708 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:53.329701    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh" event={"ID":"72e6841a-c050-407c-b463-997074cf2c88","Type":"ContainerDied","Data":"ff61d07c5ac351f4ff8c9b996ad0066969d231b5dbf3fb6066456b45d98835d3"}
Jun 03 19:52:55.343396 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:55.343351    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh" event={"ID":"72e6841a-c050-407c-b463-997074cf2c88","Type":"ContainerStarted","Data":"e2ab3d34a55c9a6ae9ecaed625fbe898b5bfe458d485e3c0d89685940f252c66"}
Jun 03 19:52:55.374209 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:55.374149    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh" podStartSLOduration=1.9290031829999998 podStartE2EDuration="7.374131276s" totalImagesPullingTime="4.110182457s" totalInitContainerRuntime="1.334945636s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:52:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:52:55.371592455 +0000 UTC m=+701.962075848" watchObservedRunningTime="2026-06-03 19:52:55.374131276 +0000 UTC m=+701.964614668"
Jun 03 19:52:58.577578 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:58.577487    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:58.577578 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:58.577552    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:58.590108 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:58.590077    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:52:59.374600 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:52:59.374565    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hwplh"
Jun 03 19:53:04.468225 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:04.468189    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:53:12.382620 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:12.382576    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:53:14.534933 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:14.534895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:53:30.947100 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:30.947063    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"]
Jun 03 19:53:30.950652 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:30.950627    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:30.953832 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:30.953808    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jun 03 19:53:30.959493 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:30.959465    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"]
Jun 03 19:53:30.989812 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:30.989772    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63c0c65b-ddff-43cf-b9de-f68f374c9ade-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:30.989812 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:30.989810    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/63c0c65b-ddff-43cf-b9de-f68f374c9ade-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:30.990100 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:30.989835    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63c0c65b-ddff-43cf-b9de-f68f374c9ade-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:30.990100 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:30.989952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xffz\" (UniqueName: \"kubernetes.io/projected/63c0c65b-ddff-43cf-b9de-f68f374c9ade-kube-api-access-6xffz\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:30.990100 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:30.989982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63c0c65b-ddff-43cf-b9de-f68f374c9ade-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:30.990100 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:30.990015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63c0c65b-ddff-43cf-b9de-f68f374c9ade-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:30.993703 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:30.993676    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:53:31.090580 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:31.090532    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63c0c65b-ddff-43cf-b9de-f68f374c9ade-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:31.090580 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:31.090584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/63c0c65b-ddff-43cf-b9de-f68f374c9ade-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:31.090849 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:31.090609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63c0c65b-ddff-43cf-b9de-f68f374c9ade-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:31.090849 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:31.090640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xffz\" (UniqueName: \"kubernetes.io/projected/63c0c65b-ddff-43cf-b9de-f68f374c9ade-kube-api-access-6xffz\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:31.090849 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:31.090673    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63c0c65b-ddff-43cf-b9de-f68f374c9ade-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:31.090849 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:31.090709    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63c0c65b-ddff-43cf-b9de-f68f374c9ade-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:31.091164 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:31.091131    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/63c0c65b-ddff-43cf-b9de-f68f374c9ade-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:31.091164 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:31.091150    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63c0c65b-ddff-43cf-b9de-f68f374c9ade-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:31.091340 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:31.091218    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63c0c65b-ddff-43cf-b9de-f68f374c9ade-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:31.093106 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:31.093085    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63c0c65b-ddff-43cf-b9de-f68f374c9ade-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:31.093395 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:31.093375    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63c0c65b-ddff-43cf-b9de-f68f374c9ade-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:31.100365 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:31.100335    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xffz\" (UniqueName: \"kubernetes.io/projected/63c0c65b-ddff-43cf-b9de-f68f374c9ade-kube-api-access-6xffz\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv\" (UID: \"63c0c65b-ddff-43cf-b9de-f68f374c9ade\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:31.263472 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:31.263420    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:31.412693 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:31.412666    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"]
Jun 03 19:53:31.414588 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:53:31.414557    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c0c65b_ddff_43cf_b9de_f68f374c9ade.slice/crio-e3f9708dbd881cba78a7fe6de84417459a70e0d95277f374838bfd86f0a9d802 WatchSource:0}: Error finding container e3f9708dbd881cba78a7fe6de84417459a70e0d95277f374838bfd86f0a9d802: Status 404 returned error can't find the container with id e3f9708dbd881cba78a7fe6de84417459a70e0d95277f374838bfd86f0a9d802
Jun 03 19:53:31.521307 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:31.521209    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv" event={"ID":"63c0c65b-ddff-43cf-b9de-f68f374c9ade","Type":"ContainerStarted","Data":"f9c1a1ce97a377245d1b692de3317d06b3416b5c69cd0f2bb018f84c86739212"}
Jun 03 19:53:31.521307 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:31.521262    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv" event={"ID":"63c0c65b-ddff-43cf-b9de-f68f374c9ade","Type":"ContainerStarted","Data":"e3f9708dbd881cba78a7fe6de84417459a70e0d95277f374838bfd86f0a9d802"}
Jun 03 19:53:33.532428 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:33.532390    2563 generic.go:356] "Generic (PLEG): container finished" podID="63c0c65b-ddff-43cf-b9de-f68f374c9ade" containerID="f9c1a1ce97a377245d1b692de3317d06b3416b5c69cd0f2bb018f84c86739212" exitCode=0
Jun 03 19:53:33.532802 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:33.532464    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv" event={"ID":"63c0c65b-ddff-43cf-b9de-f68f374c9ade","Type":"ContainerDied","Data":"f9c1a1ce97a377245d1b692de3317d06b3416b5c69cd0f2bb018f84c86739212"}
Jun 03 19:53:34.539832 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:34.539796    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv" event={"ID":"63c0c65b-ddff-43cf-b9de-f68f374c9ade","Type":"ContainerStarted","Data":"2e922220938eb437adacb314cbb37564998e6b8d075161bc6975f684e2395605"}
Jun 03 19:53:34.561987 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:34.561932    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv" podStartSLOduration=3.020152678 podStartE2EDuration="4.561915011s" totalImagesPullingTime="212.900685ms" totalInitContainerRuntime="1.328861648s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:53:34.561409012 +0000 UTC m=+741.151892403" watchObservedRunningTime="2026-06-03 19:53:34.561915011 +0000 UTC m=+741.152398402"
Jun 03 19:53:41.264045 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:41.264004    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:41.264465 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:41.264072    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:41.278812 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:41.278774    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:41.586553 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:41.586457    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv"
Jun 03 19:53:54.755029 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:54.754990    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"]
Jun 03 19:53:54.759533 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:54.759506    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:54.762342 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:54.762318    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jun 03 19:53:54.769792 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:54.769764    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"]
Jun 03 19:53:54.798642 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:54.798585    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:53:54.917803 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:54.917760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8228a9a-23a0-4883-9f9a-043710c7c5c9-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:54.917996 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:54.917821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8228a9a-23a0-4883-9f9a-043710c7c5c9-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:54.917996 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:54.917891    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk424\" (UniqueName: \"kubernetes.io/projected/f8228a9a-23a0-4883-9f9a-043710c7c5c9-kube-api-access-vk424\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:54.917996 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:54.917941    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8228a9a-23a0-4883-9f9a-043710c7c5c9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:54.917996 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:54.917962    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8228a9a-23a0-4883-9f9a-043710c7c5c9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:54.917996 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:54.917978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f8228a9a-23a0-4883-9f9a-043710c7c5c9-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:55.018512 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:55.018422    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8228a9a-23a0-4883-9f9a-043710c7c5c9-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:55.018512 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:55.018471    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk424\" (UniqueName: \"kubernetes.io/projected/f8228a9a-23a0-4883-9f9a-043710c7c5c9-kube-api-access-vk424\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:55.018721 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:55.018523    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8228a9a-23a0-4883-9f9a-043710c7c5c9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:55.018721 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:55.018552    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8228a9a-23a0-4883-9f9a-043710c7c5c9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:55.018721 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:55.018575    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f8228a9a-23a0-4883-9f9a-043710c7c5c9-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:55.018721 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:55.018662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8228a9a-23a0-4883-9f9a-043710c7c5c9-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:55.018969 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:55.018916    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8228a9a-23a0-4883-9f9a-043710c7c5c9-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:55.019029 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:55.018968    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8228a9a-23a0-4883-9f9a-043710c7c5c9-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:55.019081 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:55.019029    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f8228a9a-23a0-4883-9f9a-043710c7c5c9-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:55.021027 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:55.021005    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8228a9a-23a0-4883-9f9a-043710c7c5c9-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:55.021278 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:55.021261    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8228a9a-23a0-4883-9f9a-043710c7c5c9-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:55.028129 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:55.028099    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk424\" (UniqueName: \"kubernetes.io/projected/f8228a9a-23a0-4883-9f9a-043710c7c5c9-kube-api-access-vk424\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l6vjc\" (UID: \"f8228a9a-23a0-4883-9f9a-043710c7c5c9\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:55.071588 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:55.071540    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:53:55.216607 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:55.216580    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"]
Jun 03 19:53:55.218641 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:53:55.218612    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8228a9a_23a0_4883_9f9a_043710c7c5c9.slice/crio-50cdef0390fb6bc11dd20b8ef05c9e2643c246bdcf6454a6f5d738a0973169d5 WatchSource:0}: Error finding container 50cdef0390fb6bc11dd20b8ef05c9e2643c246bdcf6454a6f5d738a0973169d5: Status 404 returned error can't find the container with id 50cdef0390fb6bc11dd20b8ef05c9e2643c246bdcf6454a6f5d738a0973169d5
Jun 03 19:53:55.656346 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:55.656249    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc" event={"ID":"f8228a9a-23a0-4883-9f9a-043710c7c5c9","Type":"ContainerStarted","Data":"48170adbb7ddaf29abbf4cd626308a4c541d1fae3651d0c94dbeb1ecf11152c7"}
Jun 03 19:53:55.656346 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:55.656293    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc" event={"ID":"f8228a9a-23a0-4883-9f9a-043710c7c5c9","Type":"ContainerStarted","Data":"50cdef0390fb6bc11dd20b8ef05c9e2643c246bdcf6454a6f5d738a0973169d5"}
Jun 03 19:53:56.663275 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:56.663237    2563 generic.go:356] "Generic (PLEG): container finished" podID="f8228a9a-23a0-4883-9f9a-043710c7c5c9" containerID="48170adbb7ddaf29abbf4cd626308a4c541d1fae3651d0c94dbeb1ecf11152c7" exitCode=0
Jun 03 19:53:56.663666 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:56.663328    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc" event={"ID":"f8228a9a-23a0-4883-9f9a-043710c7c5c9","Type":"ContainerDied","Data":"48170adbb7ddaf29abbf4cd626308a4c541d1fae3651d0c94dbeb1ecf11152c7"}
Jun 03 19:53:57.670759 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:57.670681    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc" event={"ID":"f8228a9a-23a0-4883-9f9a-043710c7c5c9","Type":"ContainerStarted","Data":"ac970e1fc7d6f4e87cad4bfd93689071f6b5c6f1b72bae8125bd7860eaaa4770"}
Jun 03 19:53:57.691007 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:53:57.690954    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc" podStartSLOduration=2.178115851 podStartE2EDuration="3.690938746s" totalImagesPullingTime="212.339563ms" totalInitContainerRuntime="1.300483332s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:53:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:53:57.688978201 +0000 UTC m=+764.279461592" watchObservedRunningTime="2026-06-03 19:53:57.690938746 +0000 UTC m=+764.281422137"
Jun 03 19:54:05.072336 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:05.072284    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:54:05.072859 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:05.072354    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:54:05.085337 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:05.085308    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:54:05.730575 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:05.730547    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l6vjc"
Jun 03 19:54:40.243277 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:40.243192    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:54:54.938659 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:54.938620    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68956b5fb-d8fvd"]
Jun 03 19:54:54.942287 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:54.942266    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68956b5fb-d8fvd"
Jun 03 19:54:54.953154 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:54.953125    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68956b5fb-d8fvd"]
Jun 03 19:54:54.989611 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:54.989567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hblg\" (UniqueName: \"kubernetes.io/projected/5b8686b2-0be5-4792-abe7-11553d94e7f7-kube-api-access-4hblg\") pod \"authorino-68956b5fb-d8fvd\" (UID: \"5b8686b2-0be5-4792-abe7-11553d94e7f7\") " pod="kuadrant-system/authorino-68956b5fb-d8fvd"
Jun 03 19:54:54.989790 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:54.989685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b8686b2-0be5-4792-abe7-11553d94e7f7-tls-cert\") pod \"authorino-68956b5fb-d8fvd\" (UID: \"5b8686b2-0be5-4792-abe7-11553d94e7f7\") " pod="kuadrant-system/authorino-68956b5fb-d8fvd"
Jun 03 19:54:54.989790 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:54.989730    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5b8686b2-0be5-4792-abe7-11553d94e7f7-oidc-ca\") pod \"authorino-68956b5fb-d8fvd\" (UID: \"5b8686b2-0be5-4792-abe7-11553d94e7f7\") " pod="kuadrant-system/authorino-68956b5fb-d8fvd"
Jun 03 19:54:55.091062 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:55.091024    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b8686b2-0be5-4792-abe7-11553d94e7f7-tls-cert\") pod \"authorino-68956b5fb-d8fvd\" (UID: \"5b8686b2-0be5-4792-abe7-11553d94e7f7\") " pod="kuadrant-system/authorino-68956b5fb-d8fvd"
Jun 03 19:54:55.091251 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:55.091095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5b8686b2-0be5-4792-abe7-11553d94e7f7-oidc-ca\") pod \"authorino-68956b5fb-d8fvd\" (UID: \"5b8686b2-0be5-4792-abe7-11553d94e7f7\") " pod="kuadrant-system/authorino-68956b5fb-d8fvd"
Jun 03 19:54:55.091251 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:55.091150    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hblg\" (UniqueName: \"kubernetes.io/projected/5b8686b2-0be5-4792-abe7-11553d94e7f7-kube-api-access-4hblg\") pod \"authorino-68956b5fb-d8fvd\" (UID: \"5b8686b2-0be5-4792-abe7-11553d94e7f7\") " pod="kuadrant-system/authorino-68956b5fb-d8fvd"
Jun 03 19:54:55.091794 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:55.091766    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/5b8686b2-0be5-4792-abe7-11553d94e7f7-oidc-ca\") pod \"authorino-68956b5fb-d8fvd\" (UID: \"5b8686b2-0be5-4792-abe7-11553d94e7f7\") " pod="kuadrant-system/authorino-68956b5fb-d8fvd"
Jun 03 19:54:55.093913 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:55.093889    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b8686b2-0be5-4792-abe7-11553d94e7f7-tls-cert\") pod \"authorino-68956b5fb-d8fvd\" (UID: \"5b8686b2-0be5-4792-abe7-11553d94e7f7\") " pod="kuadrant-system/authorino-68956b5fb-d8fvd"
Jun 03 19:54:55.100106 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:55.100083    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hblg\" (UniqueName: \"kubernetes.io/projected/5b8686b2-0be5-4792-abe7-11553d94e7f7-kube-api-access-4hblg\") pod \"authorino-68956b5fb-d8fvd\" (UID: \"5b8686b2-0be5-4792-abe7-11553d94e7f7\") " pod="kuadrant-system/authorino-68956b5fb-d8fvd"
Jun 03 19:54:55.252808 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:55.252766    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68956b5fb-d8fvd"
Jun 03 19:54:55.398101 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:55.398071    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68956b5fb-d8fvd"]
Jun 03 19:54:55.400093 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:54:55.400063    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b8686b2_0be5_4792_abe7_11553d94e7f7.slice/crio-e5a0b7c97edfad0f7d0e34ea4583107311b6c80889436ce2233416a870f4e1e7 WatchSource:0}: Error finding container e5a0b7c97edfad0f7d0e34ea4583107311b6c80889436ce2233416a870f4e1e7: Status 404 returned error can't find the container with id e5a0b7c97edfad0f7d0e34ea4583107311b6c80889436ce2233416a870f4e1e7
Jun 03 19:54:55.981499 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:55.981405    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68956b5fb-d8fvd" event={"ID":"5b8686b2-0be5-4792-abe7-11553d94e7f7","Type":"ContainerStarted","Data":"896619f19a52ea9b63aa6061629d462a22e097a9329c85349ffdd794f0e66cbd"}
Jun 03 19:54:55.981499 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:55.981461    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68956b5fb-d8fvd" event={"ID":"5b8686b2-0be5-4792-abe7-11553d94e7f7","Type":"ContainerStarted","Data":"e5a0b7c97edfad0f7d0e34ea4583107311b6c80889436ce2233416a870f4e1e7"}
Jun 03 19:54:56.014893 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.014825    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68956b5fb-d8fvd" podStartSLOduration=1.726573497 podStartE2EDuration="2.014805509s" totalImagesPullingTime="288.232012ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:54:56.006812527 +0000 UTC m=+822.597295920" watchObservedRunningTime="2026-06-03 19:54:56.014805509 +0000 UTC m=+822.605289003"
Jun 03 19:54:56.083573 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.083528    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-98cc774b9-nnj69"]
Jun 03 19:54:56.084081 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.084045    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-98cc774b9-nnj69" podUID="a2b8d699-331e-43d6-8996-f3b4f4da2c10" containerName="authorino" containerID="cri-o://16e9c098b995254a2681bbe85ae26be94f50747c823af2ada9f352a2a8ea18fe" gracePeriod=30
Jun 03 19:54:56.354700 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.354665    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-98cc774b9-nnj69"
Jun 03 19:54:56.407408 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.407361    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8shls\" (UniqueName: \"kubernetes.io/projected/a2b8d699-331e-43d6-8996-f3b4f4da2c10-kube-api-access-8shls\") pod \"a2b8d699-331e-43d6-8996-f3b4f4da2c10\" (UID: \"a2b8d699-331e-43d6-8996-f3b4f4da2c10\") "
Jun 03 19:54:56.407605 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.407460    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a2b8d699-331e-43d6-8996-f3b4f4da2c10-oidc-ca\") pod \"a2b8d699-331e-43d6-8996-f3b4f4da2c10\" (UID: \"a2b8d699-331e-43d6-8996-f3b4f4da2c10\") "
Jun 03 19:54:56.407682 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.407653    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2b8d699-331e-43d6-8996-f3b4f4da2c10-tls-cert\") pod \"a2b8d699-331e-43d6-8996-f3b4f4da2c10\" (UID: \"a2b8d699-331e-43d6-8996-f3b4f4da2c10\") "
Jun 03 19:54:56.410319 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.410276    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2b8d699-331e-43d6-8996-f3b4f4da2c10-kube-api-access-8shls" (OuterVolumeSpecName: "kube-api-access-8shls") pod "a2b8d699-331e-43d6-8996-f3b4f4da2c10" (UID: "a2b8d699-331e-43d6-8996-f3b4f4da2c10"). InnerVolumeSpecName "kube-api-access-8shls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:54:56.413078 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.413041    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2b8d699-331e-43d6-8996-f3b4f4da2c10-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "a2b8d699-331e-43d6-8996-f3b4f4da2c10" (UID: "a2b8d699-331e-43d6-8996-f3b4f4da2c10"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 19:54:56.419627 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.419595    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2b8d699-331e-43d6-8996-f3b4f4da2c10-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a2b8d699-331e-43d6-8996-f3b4f4da2c10" (UID: "a2b8d699-331e-43d6-8996-f3b4f4da2c10"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 19:54:56.508989 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.508853    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2b8d699-331e-43d6-8996-f3b4f4da2c10-tls-cert\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:54:56.508989 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.508925    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8shls\" (UniqueName: \"kubernetes.io/projected/a2b8d699-331e-43d6-8996-f3b4f4da2c10-kube-api-access-8shls\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:54:56.508989 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.508937    2563 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a2b8d699-331e-43d6-8996-f3b4f4da2c10-oidc-ca\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:54:56.788368 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.788274    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:54:56.883656 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.883619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:54:56.988038 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.987997    2563 generic.go:356] "Generic (PLEG): container finished" podID="a2b8d699-331e-43d6-8996-f3b4f4da2c10" containerID="16e9c098b995254a2681bbe85ae26be94f50747c823af2ada9f352a2a8ea18fe" exitCode=0
Jun 03 19:54:56.988038 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.988038    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-98cc774b9-nnj69"
Jun 03 19:54:56.988542 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.988084    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-98cc774b9-nnj69" event={"ID":"a2b8d699-331e-43d6-8996-f3b4f4da2c10","Type":"ContainerDied","Data":"16e9c098b995254a2681bbe85ae26be94f50747c823af2ada9f352a2a8ea18fe"}
Jun 03 19:54:56.988542 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.988125    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-98cc774b9-nnj69" event={"ID":"a2b8d699-331e-43d6-8996-f3b4f4da2c10","Type":"ContainerDied","Data":"c3a0bf52a35a00650460334b678394212e4a2867ad3bda05e547b18467d3cd5a"}
Jun 03 19:54:56.988542 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.988143    2563 scope.go:117] "RemoveContainer" containerID="16e9c098b995254a2681bbe85ae26be94f50747c823af2ada9f352a2a8ea18fe"
Jun 03 19:54:56.997883 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.997849    2563 scope.go:117] "RemoveContainer" containerID="16e9c098b995254a2681bbe85ae26be94f50747c823af2ada9f352a2a8ea18fe"
Jun 03 19:54:56.998202 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:54:56.998182    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16e9c098b995254a2681bbe85ae26be94f50747c823af2ada9f352a2a8ea18fe\": container with ID starting with 16e9c098b995254a2681bbe85ae26be94f50747c823af2ada9f352a2a8ea18fe not found: ID does not exist" containerID="16e9c098b995254a2681bbe85ae26be94f50747c823af2ada9f352a2a8ea18fe"
Jun 03 19:54:56.998261 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:56.998213    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16e9c098b995254a2681bbe85ae26be94f50747c823af2ada9f352a2a8ea18fe"} err="failed to get container status \"16e9c098b995254a2681bbe85ae26be94f50747c823af2ada9f352a2a8ea18fe\": rpc error: code = NotFound desc = could not find container \"16e9c098b995254a2681bbe85ae26be94f50747c823af2ada9f352a2a8ea18fe\": container with ID starting with 16e9c098b995254a2681bbe85ae26be94f50747c823af2ada9f352a2a8ea18fe not found: ID does not exist"
Jun 03 19:54:57.010582 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:57.010545    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-98cc774b9-nnj69"]
Jun 03 19:54:57.015134 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:57.015104    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-98cc774b9-nnj69"]
Jun 03 19:54:57.872360 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:57.872321    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:54:57.882219 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:57.882189    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2b8d699-331e-43d6-8996-f3b4f4da2c10" path="/var/lib/kubelet/pods/a2b8d699-331e-43d6-8996-f3b4f4da2c10/volumes"
Jun 03 19:54:57.968785 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:54:57.968747    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:56:13.899810 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:13.899778    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 19:56:13.901075 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:13.901054    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 19:56:23.703079 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:23.703038    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6ddc96b6cd-nkhkm"]
Jun 03 19:56:23.703672 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:23.703320    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6ddc96b6cd-nkhkm" podUID="dc7e0cb2-3022-48a7-a020-cf23a588df53" containerName="manager" containerID="cri-o://85ff4ef861727ed254da82a19050e4441779118f837a25aa6639924590e8d76f" gracePeriod=30
Jun 03 19:56:23.964456 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:23.964382    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ddc96b6cd-nkhkm"
Jun 03 19:56:24.074709 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:24.074663    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr4ch\" (UniqueName: \"kubernetes.io/projected/dc7e0cb2-3022-48a7-a020-cf23a588df53-kube-api-access-jr4ch\") pod \"dc7e0cb2-3022-48a7-a020-cf23a588df53\" (UID: \"dc7e0cb2-3022-48a7-a020-cf23a588df53\") "
Jun 03 19:56:24.077051 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:24.077011    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc7e0cb2-3022-48a7-a020-cf23a588df53-kube-api-access-jr4ch" (OuterVolumeSpecName: "kube-api-access-jr4ch") pod "dc7e0cb2-3022-48a7-a020-cf23a588df53" (UID: "dc7e0cb2-3022-48a7-a020-cf23a588df53"). InnerVolumeSpecName "kube-api-access-jr4ch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 19:56:24.176142 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:24.176102    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr4ch\" (UniqueName: \"kubernetes.io/projected/dc7e0cb2-3022-48a7-a020-cf23a588df53-kube-api-access-jr4ch\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 19:56:24.450047 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:24.450015    2563 generic.go:356] "Generic (PLEG): container finished" podID="dc7e0cb2-3022-48a7-a020-cf23a588df53" containerID="85ff4ef861727ed254da82a19050e4441779118f837a25aa6639924590e8d76f" exitCode=0
Jun 03 19:56:24.450248 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:24.450058    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ddc96b6cd-nkhkm"
Jun 03 19:56:24.450248 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:24.450078    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ddc96b6cd-nkhkm" event={"ID":"dc7e0cb2-3022-48a7-a020-cf23a588df53","Type":"ContainerDied","Data":"85ff4ef861727ed254da82a19050e4441779118f837a25aa6639924590e8d76f"}
Jun 03 19:56:24.450248 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:24.450118    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ddc96b6cd-nkhkm" event={"ID":"dc7e0cb2-3022-48a7-a020-cf23a588df53","Type":"ContainerDied","Data":"bd9dce098480ffc2a64526046e80bb8d86f9f617c84887328674d450a8ee0f6f"}
Jun 03 19:56:24.450248 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:24.450140    2563 scope.go:117] "RemoveContainer" containerID="85ff4ef861727ed254da82a19050e4441779118f837a25aa6639924590e8d76f"
Jun 03 19:56:24.459736 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:24.459715    2563 scope.go:117] "RemoveContainer" containerID="85ff4ef861727ed254da82a19050e4441779118f837a25aa6639924590e8d76f"
Jun 03 19:56:24.460137 ip-10-0-129-187 kubenswrapper[2563]: E0603 19:56:24.460108    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85ff4ef861727ed254da82a19050e4441779118f837a25aa6639924590e8d76f\": container with ID starting with 85ff4ef861727ed254da82a19050e4441779118f837a25aa6639924590e8d76f not found: ID does not exist" containerID="85ff4ef861727ed254da82a19050e4441779118f837a25aa6639924590e8d76f"
Jun 03 19:56:24.460261 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:24.460144    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85ff4ef861727ed254da82a19050e4441779118f837a25aa6639924590e8d76f"} err="failed to get container status \"85ff4ef861727ed254da82a19050e4441779118f837a25aa6639924590e8d76f\": rpc error: code = NotFound desc = could not find container \"85ff4ef861727ed254da82a19050e4441779118f837a25aa6639924590e8d76f\": container with ID starting with 85ff4ef861727ed254da82a19050e4441779118f837a25aa6639924590e8d76f not found: ID does not exist"
Jun 03 19:56:24.472978 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:24.472943    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6ddc96b6cd-nkhkm"]
Jun 03 19:56:24.477309 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:24.477282    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6ddc96b6cd-nkhkm"]
Jun 03 19:56:25.253890 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:25.253846    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6ddc96b6cd-mgvbz"]
Jun 03 19:56:25.254339 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:25.254269    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc7e0cb2-3022-48a7-a020-cf23a588df53" containerName="manager"
Jun 03 19:56:25.254339 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:25.254283    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc7e0cb2-3022-48a7-a020-cf23a588df53" containerName="manager"
Jun 03 19:56:25.254339 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:25.254297    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2b8d699-331e-43d6-8996-f3b4f4da2c10" containerName="authorino"
Jun 03 19:56:25.254339 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:25.254302    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2b8d699-331e-43d6-8996-f3b4f4da2c10" containerName="authorino"
Jun 03 19:56:25.254473 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:25.254369    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2b8d699-331e-43d6-8996-f3b4f4da2c10" containerName="authorino"
Jun 03 19:56:25.254473 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:25.254378    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc7e0cb2-3022-48a7-a020-cf23a588df53" containerName="manager"
Jun 03 19:56:25.259554 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:25.259521    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ddc96b6cd-mgvbz"
Jun 03 19:56:25.262819 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:25.262779    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w84g9\""
Jun 03 19:56:25.262993 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:25.262773    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 03 19:56:25.266667 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:25.266638    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ddc96b6cd-mgvbz"]
Jun 03 19:56:25.387083 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:25.387044    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl9cm\" (UniqueName: \"kubernetes.io/projected/a4992a48-94b1-48a2-b9ce-21ccfb0ce861-kube-api-access-tl9cm\") pod \"maas-controller-6ddc96b6cd-mgvbz\" (UID: \"a4992a48-94b1-48a2-b9ce-21ccfb0ce861\") " pod="opendatahub/maas-controller-6ddc96b6cd-mgvbz"
Jun 03 19:56:25.488397 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:25.488351    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl9cm\" (UniqueName: \"kubernetes.io/projected/a4992a48-94b1-48a2-b9ce-21ccfb0ce861-kube-api-access-tl9cm\") pod \"maas-controller-6ddc96b6cd-mgvbz\" (UID: \"a4992a48-94b1-48a2-b9ce-21ccfb0ce861\") " pod="opendatahub/maas-controller-6ddc96b6cd-mgvbz"
Jun 03 19:56:25.498273 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:25.498239    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl9cm\" (UniqueName: \"kubernetes.io/projected/a4992a48-94b1-48a2-b9ce-21ccfb0ce861-kube-api-access-tl9cm\") pod \"maas-controller-6ddc96b6cd-mgvbz\" (UID: \"a4992a48-94b1-48a2-b9ce-21ccfb0ce861\") " pod="opendatahub/maas-controller-6ddc96b6cd-mgvbz"
Jun 03 19:56:25.573340 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:25.573231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ddc96b6cd-mgvbz"
Jun 03 19:56:25.718643 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:25.718615    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ddc96b6cd-mgvbz"]
Jun 03 19:56:25.720859 ip-10-0-129-187 kubenswrapper[2563]: W0603 19:56:25.720820    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4992a48_94b1_48a2_b9ce_21ccfb0ce861.slice/crio-414724f57901dcf922d8ff4133bcb017ae0cacc8c55dd03a618642be126b2166 WatchSource:0}: Error finding container 414724f57901dcf922d8ff4133bcb017ae0cacc8c55dd03a618642be126b2166: Status 404 returned error can't find the container with id 414724f57901dcf922d8ff4133bcb017ae0cacc8c55dd03a618642be126b2166
Jun 03 19:56:25.882041 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:25.881951    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc7e0cb2-3022-48a7-a020-cf23a588df53" path="/var/lib/kubelet/pods/dc7e0cb2-3022-48a7-a020-cf23a588df53/volumes"
Jun 03 19:56:26.464591 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:26.464556    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ddc96b6cd-mgvbz" event={"ID":"a4992a48-94b1-48a2-b9ce-21ccfb0ce861","Type":"ContainerStarted","Data":"c905dd88016dd9d7dce1288ad67f79a83492abc99079662e4e1303d6e5f7f7d5"}
Jun 03 19:56:26.465119 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:26.464610    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ddc96b6cd-mgvbz" event={"ID":"a4992a48-94b1-48a2-b9ce-21ccfb0ce861","Type":"ContainerStarted","Data":"414724f57901dcf922d8ff4133bcb017ae0cacc8c55dd03a618642be126b2166"}
Jun 03 19:56:26.465119 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:26.464700    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6ddc96b6cd-mgvbz"
Jun 03 19:56:26.481813 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:26.481749    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6ddc96b6cd-mgvbz" podStartSLOduration=0.878265631 podStartE2EDuration="1.481730484s" totalImagesPullingTime="603.464853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 19:56:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 19:56:26.48102087 +0000 UTC m=+913.071504286" watchObservedRunningTime="2026-06-03 19:56:26.481730484 +0000 UTC m=+913.072213877"
Jun 03 19:56:37.475712 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:37.475666    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6ddc96b6cd-mgvbz"
Jun 03 19:56:53.529484 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:56:53.529451    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:57:07.097769 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:57:07.097720    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:57:07.185267 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:57:07.185230    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:57:15.456339 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:57:15.456297    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:57:21.772014 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:57:21.771967    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:57:21.878329 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:57:21.878286    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:57:53.879553 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:57:53.879464    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:57:53.970696 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:57:53.970648    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:58:17.710856 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:58:17.710816    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:58:19.449619 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:58:19.449587    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:58:19.506365 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:58:19.506318    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:58:23.846689 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:58:23.846651    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:58:23.953442 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:58:23.953405    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:58:24.084435 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:58:24.084404    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:58:24.251232 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:58:24.251177    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:58:24.348548 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:58:24.348496    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:58:40.737609 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:58:40.737573    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:58:40.846782 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:58:40.846741    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:58:40.958135 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:58:40.958100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:58:46.867204 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:58:46.867166    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:58:46.995483 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:58:46.995430    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:58:55.016702 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:58:55.016645    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:58:55.117164 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:58:55.117129    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:58:55.213582 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:58:55.213547    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:58:55.315906 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:58:55.315790    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:59:11.732463 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:59:11.732420    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:59:11.849917 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:59:11.849854    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:59:11.965475 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:59:11.965439    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:59:17.944234 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:59:17.944196    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 19:59:18.046208 ip-10-0-129-187 kubenswrapper[2563]: I0603 19:59:18.046169    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 20:01:13.932172 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:01:13.932132    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 20:01:13.935238 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:01:13.935213    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 20:05:46.601140 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:05:46.601108    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 20:05:47.710040 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:05:47.709999    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 20:06:13.964889 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:13.964851    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 20:06:13.969715 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:13.969686    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 20:06:47.045143 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:47.045034    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"]
Jun 03 20:06:47.045701 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:47.045340    2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4" podUID="d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1" containerName="manager" containerID="cri-o://820c928a045aed8351a75533de1701227620efc0a5bb5cc77289834cddefb310" gracePeriod=10
Jun 03 20:06:47.643006 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:47.642912    2563 generic.go:356] "Generic (PLEG): container finished" podID="d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1" containerID="820c928a045aed8351a75533de1701227620efc0a5bb5cc77289834cddefb310" exitCode=0
Jun 03 20:06:47.643006 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:47.642960    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4" event={"ID":"d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1","Type":"ContainerDied","Data":"820c928a045aed8351a75533de1701227620efc0a5bb5cc77289834cddefb310"}
Jun 03 20:06:48.004224 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:48.004198    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"
Jun 03 20:06:48.067650 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:48.067612    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1-extensions-socket-volume\") pod \"d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1\" (UID: \"d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1\") "
Jun 03 20:06:48.068050 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:48.067659    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95pn7\" (UniqueName: \"kubernetes.io/projected/d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1-kube-api-access-95pn7\") pod \"d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1\" (UID: \"d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1\") "
Jun 03 20:06:48.068050 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:48.068042    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1" (UID: "d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 20:06:48.070197 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:48.070168    2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1-kube-api-access-95pn7" (OuterVolumeSpecName: "kube-api-access-95pn7") pod "d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1" (UID: "d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1"). InnerVolumeSpecName "kube-api-access-95pn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 20:06:48.168435 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:48.168338    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1-extensions-socket-volume\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 20:06:48.168435 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:48.168370    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95pn7\" (UniqueName: \"kubernetes.io/projected/d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1-kube-api-access-95pn7\") on node \"ip-10-0-129-187.ec2.internal\" DevicePath \"\""
Jun 03 20:06:48.649073 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:48.649035    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4" event={"ID":"d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1","Type":"ContainerDied","Data":"0ff6766bd547bd7b812bd045a1f3d5e70f3d9587a58fef8bf18424aba9745bdb"}
Jun 03 20:06:48.649073 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:48.649073    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"
Jun 03 20:06:48.649319 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:48.649098    2563 scope.go:117] "RemoveContainer" containerID="820c928a045aed8351a75533de1701227620efc0a5bb5cc77289834cddefb310"
Jun 03 20:06:48.674546 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:48.674510    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"]
Jun 03 20:06:48.677996 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:48.677966    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-c2hl4"]
Jun 03 20:06:49.881772 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:06:49.881735    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1" path="/var/lib/kubelet/pods/d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1/volumes"
Jun 03 20:10:53.791450 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:10:53.791407    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 20:11:13.999310 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:11:13.999276    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 20:11:14.003319 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:11:14.003297    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 20:11:29.040279 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:11:29.040245    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 20:11:29.140998 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:11:29.140963    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 20:16:14.031213 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:16:14.031183    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 20:16:14.036297 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:16:14.036273    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s7kdk_a2642983-5f96-4da4-b20d-f7864ba449e7/ovn-acl-logging/0.log"
Jun 03 20:16:59.731436 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:16:59.731340    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 20:17:09.316630 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:17:09.316597    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 20:17:33.659149 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:17:33.659110    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 20:17:46.943938 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:17:46.943892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 20:17:55.733957 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:17:55.733921    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68956b5fb-d8fvd_5b8686b2-0be5-4792-abe7-11553d94e7f7/authorino/0.log"
Jun 03 20:18:01.455029 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:01.454988    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d7b4f9498-z5wcg_d390e4fe-4664-46ba-823e-93432c0b9dad/nginx/0.log"
Jun 03 20:18:01.876007 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:01.875968    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-669fb6bd94-nr5p5_b7b17776-ab2a-4ebf-afdf-bc4842e3bfe8/maas-api/0.log"
Jun 03 20:18:02.299750 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:02.299696    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6ddc96b6cd-mgvbz_a4992a48-94b1-48a2-b9ce-21ccfb0ce861/manager/0.log"
Jun 03 20:18:02.947737 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:02.947710    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5584b5f9cd-sltwk_36158627-79f8-4a63-9235-1e2b6ea31253/copy-manifests/0.log"
Jun 03 20:18:02.960981 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:02.960938    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5584b5f9cd-sltwk_36158627-79f8-4a63-9235-1e2b6ea31253/manager/0.log"
Jun 03 20:18:04.411191 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:04.411154    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68956b5fb-d8fvd_5b8686b2-0be5-4792-abe7-11553d94e7f7/authorino/0.log"
Jun 03 20:18:04.652049 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:04.652018    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-pj77m_798fd56a-c369-4b3e-b9c2-417bc639a36f/manager/0.log"
Jun 03 20:18:04.770985 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:04.770957    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mqqfh_e04f51b2-6a58-408f-b6f1-83046aa3e201/kuadrant-console-plugin/0.log"
Jun 03 20:18:05.993675 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:05.993637    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d59cb7674-9w6j2_0caa8eac-7d93-4da6-ba20-8fbcd004daa6/kube-auth-proxy/0.log"
Jun 03 20:18:06.223547 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:06.223507    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-k6dp4_727344d2-b658-450b-8aa3-34ea3f160c38/payload-processing/0.log"
Jun 03 20:18:06.805822 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:06.805783    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-hwplh_72e6841a-c050-407c-b463-997074cf2c88/storage-initializer/0.log"
Jun 03 20:18:06.812624 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:06.812592    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-hwplh_72e6841a-c050-407c-b463-997074cf2c88/main/0.log"
Jun 03 20:18:07.170023 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:07.169930    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv_63c0c65b-ddff-43cf-b9de-f68f374c9ade/main/0.log"
Jun 03 20:18:07.176601 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:07.176571    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-dqmvv_63c0c65b-ddff-43cf-b9de-f68f374c9ade/storage-initializer/0.log"
Jun 03 20:18:07.288587 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:07.288559    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-l6vjc_f8228a9a-23a0-4883-9f9a-043710c7c5c9/storage-initializer/0.log"
Jun 03 20:18:07.296810 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:07.296777    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-l6vjc_f8228a9a-23a0-4883-9f9a-043710c7c5c9/main/0.log"
Jun 03 20:18:11.162168 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:11.162130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 20:18:11.260926 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:11.260866    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log" limit=1024
Jun 03 20:18:14.372671 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:14.372638    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6b7zc_4aa79bf3-8eb3-4175-8706-2ddf3cfba37b/global-pull-secret-syncer/0.log"
Jun 03 20:18:14.497114 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:14.497075    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rdmnt_abc93e0d-584f-4984-a573-a50352a3ee23/konnectivity-agent/0.log"
Jun 03 20:18:14.589801 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:14.589768    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-187.ec2.internal_3479ce4a7d1e982e2ed221c321b93971/haproxy/0.log"
Jun 03 20:18:20.080773 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:20.080735    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68956b5fb-d8fvd_5b8686b2-0be5-4792-abe7-11553d94e7f7/authorino/0.log"
Jun 03 20:18:20.149677 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:20.149650    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-pj77m_798fd56a-c369-4b3e-b9c2-417bc639a36f/manager/0.log"
Jun 03 20:18:20.174413 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:20.174383    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mqqfh_e04f51b2-6a58-408f-b6f1-83046aa3e201/kuadrant-console-plugin/0.log"
Jun 03 20:18:22.076126 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.076093    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02697ff8-adb8-4464-a774-cecd719976fe/alertmanager/0.log"
Jun 03 20:18:22.103716 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.103684    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02697ff8-adb8-4464-a774-cecd719976fe/config-reloader/0.log"
Jun 03 20:18:22.129315 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.129285    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02697ff8-adb8-4464-a774-cecd719976fe/kube-rbac-proxy-web/0.log"
Jun 03 20:18:22.150614 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.150580    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02697ff8-adb8-4464-a774-cecd719976fe/kube-rbac-proxy/0.log"
Jun 03 20:18:22.170596 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.170560    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02697ff8-adb8-4464-a774-cecd719976fe/kube-rbac-proxy-metric/0.log"
Jun 03 20:18:22.190709 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.190672    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02697ff8-adb8-4464-a774-cecd719976fe/prom-label-proxy/0.log"
Jun 03 20:18:22.212210 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.212181    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_02697ff8-adb8-4464-a774-cecd719976fe/init-config-reloader/0.log"
Jun 03 20:18:22.546797 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.546769    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8vkd_16fc5500-a86e-4f91-93ac-d969440ff199/node-exporter/0.log"
Jun 03 20:18:22.569012 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.568986    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8vkd_16fc5500-a86e-4f91-93ac-d969440ff199/kube-rbac-proxy/0.log"
Jun 03 20:18:22.599072 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.599045    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f8vkd_16fc5500-a86e-4f91-93ac-d969440ff199/init-textfile/0.log"
Jun 03 20:18:22.741478 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.741416    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2hb6m_60d136a9-cd54-410f-9a88-f57aac175267/kube-rbac-proxy-main/0.log"
Jun 03 20:18:22.764689 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.764662    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2hb6m_60d136a9-cd54-410f-9a88-f57aac175267/kube-rbac-proxy-self/0.log"
Jun 03 20:18:22.787837 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.787809    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2hb6m_60d136a9-cd54-410f-9a88-f57aac175267/openshift-state-metrics/0.log"
Jun 03 20:18:22.829733 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.829643    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e494e0fd-7f9c-46ee-aba2-8acae486536f/prometheus/0.log"
Jun 03 20:18:22.849724 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.849696    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e494e0fd-7f9c-46ee-aba2-8acae486536f/config-reloader/0.log"
Jun 03 20:18:22.872187 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.872157    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e494e0fd-7f9c-46ee-aba2-8acae486536f/thanos-sidecar/0.log"
Jun 03 20:18:22.896700 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.896672    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e494e0fd-7f9c-46ee-aba2-8acae486536f/kube-rbac-proxy-web/0.log"
Jun 03 20:18:22.917272 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.917243    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e494e0fd-7f9c-46ee-aba2-8acae486536f/kube-rbac-proxy/0.log"
Jun 03 20:18:22.937534 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.937508    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e494e0fd-7f9c-46ee-aba2-8acae486536f/kube-rbac-proxy-thanos/0.log"
Jun 03 20:18:22.963437 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:22.963407    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e494e0fd-7f9c-46ee-aba2-8acae486536f/init-config-reloader/0.log"
Jun 03 20:18:23.166254 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:23.166177    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-689ff59ffc-j9jq2_61c6a7f6-ba7a-4e94-bbbf-e5969c125194/telemeter-client/0.log"
Jun 03 20:18:23.190330 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:23.190297    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-689ff59ffc-j9jq2_61c6a7f6-ba7a-4e94-bbbf-e5969c125194/reload/0.log"
Jun 03 20:18:23.215592 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:23.215560    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-689ff59ffc-j9jq2_61c6a7f6-ba7a-4e94-bbbf-e5969c125194/kube-rbac-proxy/0.log"
Jun 03 20:18:23.247055 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:23.247025    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66c8bc895-wsjns_299aec1a-df97-4222-9751-08ffad78f8b7/thanos-query/0.log"
Jun 03 20:18:23.275393 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:23.275359    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66c8bc895-wsjns_299aec1a-df97-4222-9751-08ffad78f8b7/kube-rbac-proxy-web/0.log"
Jun 03 20:18:23.300184 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:23.300156    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66c8bc895-wsjns_299aec1a-df97-4222-9751-08ffad78f8b7/kube-rbac-proxy/0.log"
Jun 03 20:18:23.324372 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:23.324344    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66c8bc895-wsjns_299aec1a-df97-4222-9751-08ffad78f8b7/prom-label-proxy/0.log"
Jun 03 20:18:23.350751 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:23.350722    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66c8bc895-wsjns_299aec1a-df97-4222-9751-08ffad78f8b7/kube-rbac-proxy-rules/0.log"
Jun 03 20:18:23.375469 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:23.375438    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66c8bc895-wsjns_299aec1a-df97-4222-9751-08ffad78f8b7/kube-rbac-proxy-metrics/0.log"
Jun 03 20:18:25.917016 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:25.916985    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-595bc9c7b-b79dn_5660b728-792a-4ade-ad86-b9cea83c1acf/console/0.log"
Jun 03 20:18:26.419136 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.419105    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"]
Jun 03 20:18:26.419516 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.419502    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1" containerName="manager"
Jun 03 20:18:26.419516 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.419517    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1" containerName="manager"
Jun 03 20:18:26.419633 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.419585    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3cf1c8f-5fef-467c-ad2e-0cf6e40accb1" containerName="manager"
Jun 03 20:18:26.422545 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.422525    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:26.425466 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.425443    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xpf8j\"/\"kube-root-ca.crt\""
Jun 03 20:18:26.425585 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.425444    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xpf8j\"/\"openshift-service-ca.crt\""
Jun 03 20:18:26.426686 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.426669    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xpf8j\"/\"default-dockercfg-xw5kt\""
Jun 03 20:18:26.430274 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.430246    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"]
Jun 03 20:18:26.560683 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.560640    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f092e6d6-a13c-4c8b-a02c-ae411138f904-lib-modules\") pod \"perf-node-gather-daemonset-mdr8z\" (UID: \"f092e6d6-a13c-4c8b-a02c-ae411138f904\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:26.560683 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.560691    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f092e6d6-a13c-4c8b-a02c-ae411138f904-proc\") pod \"perf-node-gather-daemonset-mdr8z\" (UID: \"f092e6d6-a13c-4c8b-a02c-ae411138f904\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:26.560989 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.560710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f092e6d6-a13c-4c8b-a02c-ae411138f904-podres\") pod \"perf-node-gather-daemonset-mdr8z\" (UID: \"f092e6d6-a13c-4c8b-a02c-ae411138f904\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:26.560989 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.560836    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f092e6d6-a13c-4c8b-a02c-ae411138f904-sys\") pod \"perf-node-gather-daemonset-mdr8z\" (UID: \"f092e6d6-a13c-4c8b-a02c-ae411138f904\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:26.560989 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.560946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27tdc\" (UniqueName: \"kubernetes.io/projected/f092e6d6-a13c-4c8b-a02c-ae411138f904-kube-api-access-27tdc\") pod \"perf-node-gather-daemonset-mdr8z\" (UID: \"f092e6d6-a13c-4c8b-a02c-ae411138f904\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:26.662123 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.662082    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f092e6d6-a13c-4c8b-a02c-ae411138f904-lib-modules\") pod \"perf-node-gather-daemonset-mdr8z\" (UID: \"f092e6d6-a13c-4c8b-a02c-ae411138f904\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:26.662123 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.662129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f092e6d6-a13c-4c8b-a02c-ae411138f904-proc\") pod \"perf-node-gather-daemonset-mdr8z\" (UID: \"f092e6d6-a13c-4c8b-a02c-ae411138f904\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:26.662386 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.662144    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f092e6d6-a13c-4c8b-a02c-ae411138f904-podres\") pod \"perf-node-gather-daemonset-mdr8z\" (UID: \"f092e6d6-a13c-4c8b-a02c-ae411138f904\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:26.662386 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.662179    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f092e6d6-a13c-4c8b-a02c-ae411138f904-sys\") pod \"perf-node-gather-daemonset-mdr8z\" (UID: \"f092e6d6-a13c-4c8b-a02c-ae411138f904\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:26.662386 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.662241    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27tdc\" (UniqueName: \"kubernetes.io/projected/f092e6d6-a13c-4c8b-a02c-ae411138f904-kube-api-access-27tdc\") pod \"perf-node-gather-daemonset-mdr8z\" (UID: \"f092e6d6-a13c-4c8b-a02c-ae411138f904\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:26.662386 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.662238    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f092e6d6-a13c-4c8b-a02c-ae411138f904-proc\") pod \"perf-node-gather-daemonset-mdr8z\" (UID: \"f092e6d6-a13c-4c8b-a02c-ae411138f904\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:26.662386 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.662283    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f092e6d6-a13c-4c8b-a02c-ae411138f904-sys\") pod \"perf-node-gather-daemonset-mdr8z\" (UID: \"f092e6d6-a13c-4c8b-a02c-ae411138f904\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:26.662386 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.662298    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f092e6d6-a13c-4c8b-a02c-ae411138f904-lib-modules\") pod \"perf-node-gather-daemonset-mdr8z\" (UID: \"f092e6d6-a13c-4c8b-a02c-ae411138f904\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:26.662386 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.662323    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f092e6d6-a13c-4c8b-a02c-ae411138f904-podres\") pod \"perf-node-gather-daemonset-mdr8z\" (UID: \"f092e6d6-a13c-4c8b-a02c-ae411138f904\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:26.671268 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.671197    2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27tdc\" (UniqueName: \"kubernetes.io/projected/f092e6d6-a13c-4c8b-a02c-ae411138f904-kube-api-access-27tdc\") pod \"perf-node-gather-daemonset-mdr8z\" (UID: \"f092e6d6-a13c-4c8b-a02c-ae411138f904\") " pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:26.734578 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.734538    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:26.875131 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:26.875051    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"]
Jun 03 20:18:26.877978 ip-10-0-129-187 kubenswrapper[2563]: W0603 20:18:26.877953    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf092e6d6_a13c_4c8b_a02c_ae411138f904.slice/crio-1df63ac24a016ecbb8a0638a60bc8a6a33dcc5548504ce8416897465e5bdabb4 WatchSource:0}: Error finding container 1df63ac24a016ecbb8a0638a60bc8a6a33dcc5548504ce8416897465e5bdabb4: Status 404 returned error can't find the container with id 1df63ac24a016ecbb8a0638a60bc8a6a33dcc5548504ce8416897465e5bdabb4
Jun 03 20:18:27.181253 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:27.181158    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z" event={"ID":"f092e6d6-a13c-4c8b-a02c-ae411138f904","Type":"ContainerStarted","Data":"26964dbce3a53323b4886c29a0f9cd8c426d7d69e9ec94ac36811eefda33edfd"}
Jun 03 20:18:27.181253 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:27.181212    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z" event={"ID":"f092e6d6-a13c-4c8b-a02c-ae411138f904","Type":"ContainerStarted","Data":"1df63ac24a016ecbb8a0638a60bc8a6a33dcc5548504ce8416897465e5bdabb4"}
Jun 03 20:18:27.181682 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:27.181295    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:27.897676 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:27.897644    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hsc5x_f3306040-9145-4417-a279-c983d77434c0/dns/0.log"
Jun 03 20:18:27.919352 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:27.919324    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hsc5x_f3306040-9145-4417-a279-c983d77434c0/kube-rbac-proxy/0.log"
Jun 03 20:18:28.060542 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:28.060507    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j6mcb_52b2344c-97b7-4445-86e4-4cc46b5683f5/dns-node-resolver/0.log"
Jun 03 20:18:28.661729 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:28.661698    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5rjh2_b2d54a40-d9b9-4483-aff6-1d4d4ce412a3/node-ca/0.log"
Jun 03 20:18:29.883123 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:29.883092    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d59cb7674-9w6j2_0caa8eac-7d93-4da6-ba20-8fbcd004daa6/kube-auth-proxy/0.log"
Jun 03 20:18:30.011483 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:30.011452    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-k6dp4_727344d2-b658-450b-8aa3-34ea3f160c38/payload-processing/0.log"
Jun 03 20:18:30.647448 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:30.647417    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7smss_96455c83-4d2f-4c9c-b4c4-ff13857828ba/serve-healthcheck-canary/0.log"
Jun 03 20:18:31.370309 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:31.370279    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6wlf_5cd48d95-606d-4b68-94d3-df4cfb1ae654/kube-rbac-proxy/0.log"
Jun 03 20:18:31.391506 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:31.391482    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6wlf_5cd48d95-606d-4b68-94d3-df4cfb1ae654/exporter/0.log"
Jun 03 20:18:31.412146 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:31.412111    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r6wlf_5cd48d95-606d-4b68-94d3-df4cfb1ae654/extractor/0.log"
Jun 03 20:18:33.198325 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:33.198293    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z"
Jun 03 20:18:33.216542 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:33.216478    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xpf8j/perf-node-gather-daemonset-mdr8z" podStartSLOduration=7.216464345 podStartE2EDuration="7.216464345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 20:18:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 20:18:27.19761194 +0000 UTC m=+2233.788095331" watchObservedRunningTime="2026-06-03 20:18:33.216464345 +0000 UTC m=+2239.806947737"
Jun 03 20:18:33.676675 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:33.676642    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6d7b4f9498-z5wcg_d390e4fe-4664-46ba-823e-93432c0b9dad/nginx/0.log"
Jun 03 20:18:33.879276 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:33.879245    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-669fb6bd94-nr5p5_b7b17776-ab2a-4ebf-afdf-bc4842e3bfe8/maas-api/0.log"
Jun 03 20:18:34.002758 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:34.002720    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6ddc96b6cd-mgvbz_a4992a48-94b1-48a2-b9ce-21ccfb0ce861/manager/0.log"
Jun 03 20:18:34.285541 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:34.285459    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5584b5f9cd-sltwk_36158627-79f8-4a63-9235-1e2b6ea31253/manager/0.log"
Jun 03 20:18:34.305914 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:34.305861    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5584b5f9cd-sltwk_36158627-79f8-4a63-9235-1e2b6ea31253/copy-manifests/0.log"
Jun 03 20:18:36.153837 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:36.153805    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-c9655f554-tnznz_4a142ccc-05c8-4327-a1a3-a1dfdf2da3fd/manager/0.log"
Jun 03 20:18:36.183018 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:36.182985    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lz67f_3a29082d-9ec0-44d4-b0c7-d085dc1cce31/openshift-lws-operator/0.log"
Jun 03 20:18:40.225525 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:40.225491    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d59cb7674-9w6j2_0caa8eac-7d93-4da6-ba20-8fbcd004daa6/kube-auth-proxy/0.log"
Jun 03 20:18:40.340917 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:40.340844    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-k6dp4_727344d2-b658-450b-8aa3-34ea3f160c38/payload-processing/0.log"
Jun 03 20:18:41.658318 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:41.658286    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d59cb7674-9w6j2_0caa8eac-7d93-4da6-ba20-8fbcd004daa6/kube-auth-proxy/0.log"
Jun 03 20:18:41.768836 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:41.768801    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-k6dp4_727344d2-b658-450b-8aa3-34ea3f160c38/payload-processing/0.log"
Jun 03 20:18:43.588096 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:43.588059    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d59cb7674-9w6j2_0caa8eac-7d93-4da6-ba20-8fbcd004daa6/kube-auth-proxy/0.log"
Jun 03 20:18:43.595422 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:43.595401    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xv4qk_2e6d2055-8340-4249-985e-a172e9ca31b2/kube-multus-additional-cni-plugins/0.log"
Jun 03 20:18:43.617169 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:43.617144    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xv4qk_2e6d2055-8340-4249-985e-a172e9ca31b2/egress-router-binary-copy/0.log"
Jun 03 20:18:43.641302 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:43.641277    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xv4qk_2e6d2055-8340-4249-985e-a172e9ca31b2/cni-plugins/0.log"
Jun 03 20:18:43.662106 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:43.662080    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xv4qk_2e6d2055-8340-4249-985e-a172e9ca31b2/bond-cni-plugin/0.log"
Jun 03 20:18:43.682944 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:43.682914    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xv4qk_2e6d2055-8340-4249-985e-a172e9ca31b2/routeoverride-cni/0.log"
Jun 03 20:18:43.695086 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:43.695060    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-k6dp4_727344d2-b658-450b-8aa3-34ea3f160c38/payload-processing/0.log"
Jun 03 20:18:43.703775 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:43.703750    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xv4qk_2e6d2055-8340-4249-985e-a172e9ca31b2/whereabouts-cni-bincopy/0.log"
Jun 03 20:18:43.723379 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:43.723352    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xv4qk_2e6d2055-8340-4249-985e-a172e9ca31b2/whereabouts-cni/0.log"
Jun 03 20:18:43.800340 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:43.800304    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xhg77_e42f9663-7a96-4ef0-95f5-a62af5edbee4/kube-multus/0.log"
Jun 03 20:18:43.866202 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:43.866123    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dhn5t_6c557986-2994-4e1c-8425-9475d1281349/network-metrics-daemon/0.log"
Jun 03 20:18:43.886446 ip-10-0-129-187 kubenswrapper[2563]: I0603 20:18:43.886414    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dhn5t_6c557986-2994-4e1c-8425-9475d1281349/kube-rbac-proxy/0.log"