Jun 09 13:28:20.498187 ip-10-0-130-81 systemd[1]: Starting Kubernetes Kubelet...
Jun 09 13:28:20.898263 ip-10-0-130-81 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 09 13:28:20.898263 ip-10-0-130-81 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 09 13:28:20.898263 ip-10-0-130-81 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 09 13:28:20.898263 ip-10-0-130-81 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 09 13:28:20.898263 ip-10-0-130-81 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 09 13:28:20.898924 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.898324    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 09 13:28:20.903512 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903495    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 13:28:20.903512 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903511    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903515    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903518    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903521    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903524    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903527    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903529    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903532    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903535    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903537    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903540    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903542    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903545    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903547    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903550    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903552    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903555    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903569    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903572    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903575    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 13:28:20.903577 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903580    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903584    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903587    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903590    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903593    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903596    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903599    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903601    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903604    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903606    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903608    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903611    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903614    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903616    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903619    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903622    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903624    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903627    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903629    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 13:28:20.904070 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903632    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903634    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903637    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903639    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903641    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903644    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903646    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903649    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903651    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903653    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903656    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903659    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903661    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903664    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903666    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903670    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903672    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903675    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903679    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 13:28:20.904799 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903683    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903687    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903690    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903694    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903697    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903699    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903702    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903704    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903707    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903710    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903713    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903715    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903718    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903720    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903722    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903725    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903743    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903746    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903749    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 13:28:20.905276 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903752    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903754    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903757    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903760    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903762    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903765    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903769    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903772    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903775    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903779    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903782    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903784    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903787    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903790    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903793    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903796    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903798    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903801    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903803    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903806    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 13:28:20.905721 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.903809    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 13:28:20.906608 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906592    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 13:28:20.906608 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906608    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906612    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906616    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906619    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906622    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906625    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906628    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906631    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906633    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906636    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906638    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906642    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906644    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906647    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906650    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906653    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906655    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906658    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906660    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906663    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 13:28:20.906666 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906665    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906669    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906671    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906674    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906677    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906680    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906683    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906685    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906688    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906690    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906693    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906699    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906703    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906706    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906709    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906712    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906715    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906718    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906720    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 13:28:20.907260 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906723    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906744    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906748    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906750    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906770    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906774    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906779    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906783    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906786    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906789    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906791    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906795    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906798    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906801    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906803    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906806    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906809    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906812    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906814    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 13:28:20.907752 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906817    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906820    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906822    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906825    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906827    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906830    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906832    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906835    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906837    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906840    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906842    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906845    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906848    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906850    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906853    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906855    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906858    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906860    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906863    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906865    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 13:28:20.908220 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906867    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906870    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906872    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906875    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906879    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906881    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906884    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906887    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906890    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906904    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906909    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906912    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906915    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906918    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906920    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906923    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906926    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906928    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906931    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.906933    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 13:28:20.908703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907303    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907307    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907310    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907312    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907315    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907317    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907320    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907323    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907325    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907328    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907330    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907333    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907335    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907338    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907341    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907343    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907346    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907351    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907354    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907357    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 13:28:20.909216 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907360    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907363    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907366    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907368    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907370    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907373    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907375    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907378    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907380    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907383    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907385    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907388    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907390    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907393    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907395    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907398    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907400    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907402    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907405    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907407    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 13:28:20.909700 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907410    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907412    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907414    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907417    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907419    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907421    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907424    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907426    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907429    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907432    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907436    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907439    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907443    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907446    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907449    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907452    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907454    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907457    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907459    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 13:28:20.910244 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907462    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907464    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907467    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907469    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907471    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907474    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907476    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907479    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907481    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907485    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907487    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907489    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907492    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907495    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907497    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907499    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907502    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907504    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907507    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907509    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 13:28:20.910714 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907512    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907515    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907517    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907520    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907523    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907527    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907529    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907532    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907534    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907539    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907542    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907545    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907548    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907551    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907553    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907556    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907559    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907561    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907564    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.907566    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 13:28:20.911213 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907642    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907649    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907664    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907671    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907676    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907679    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907683    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907687    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907690    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907692    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907696    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907700    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907703    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907706    2562 flags.go:64] FLAG: --cgroup-root=""
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907709    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907712    2562 flags.go:64] FLAG: --client-ca-file=""
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907716    2562 flags.go:64] FLAG: --cloud-provider="external"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907719    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907724    2562 flags.go:64] FLAG: --cluster-domain=""
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907748    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907752    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907756    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907759    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907764    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 09 13:28:20.911699 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907767    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907770    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907774    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907777    2562 flags.go:64] FLAG: --contention-profiling="false"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907779    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907783    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907786    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907788    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907793    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907796    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907799    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907801    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907804    2562 flags.go:64] FLAG: --enable-server="true"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907807    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907811    2562 flags.go:64] FLAG: --event-burst="100"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907814    2562 flags.go:64] FLAG: --event-qps="50"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907817    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907820    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907823    2562 flags.go:64] FLAG: --eviction-hard=""
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907827    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907829    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907832    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907835    2562 flags.go:64] FLAG: --eviction-soft=""
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907838    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907840    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 09 13:28:20.912278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907844    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907847    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907850    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907853    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907856    2562 flags.go:64] FLAG: --feature-gates=""
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907859    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907862    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907865    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907868    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907871    2562 flags.go:64] FLAG: --healthz-port="10248"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907874    2562 flags.go:64] FLAG: --help="false"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907877    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-130-81.ec2.internal"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907880    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907883    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907886    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907889    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907893    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907896    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907898    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907901    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907904    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907906    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907909    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907912    2562 flags.go:64] FLAG: --kube-reserved=""
Jun 09 13:28:20.912917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907916    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907918    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907921    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907924    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907928    2562 flags.go:64] FLAG: --lock-file=""
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907930    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907933    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907936    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907941    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907945    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907947    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907950    2562 flags.go:64] FLAG: --logging-format="text"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907953    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907956    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907959    2562 flags.go:64] FLAG: --manifest-url=""
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907962    2562 flags.go:64] FLAG: --manifest-url-header=""
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907966    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907969    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907973    2562 flags.go:64] FLAG: --max-pods="110"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907975    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907978    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907981    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907984    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907987    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907990    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 09 13:28:20.913498 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.907993    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908000    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908003    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908006    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908009    2562 flags.go:64] FLAG: --pod-cidr=""
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908011    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908017    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908020    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908023    2562 flags.go:64] FLAG: --pods-per-core="0"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908026    2562 flags.go:64] FLAG: --port="10250"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908030    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908033    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c24910cba48fcd5b"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908036    2562 flags.go:64] FLAG: --qos-reserved=""
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908039    2562 flags.go:64] FLAG: --read-only-port="10255"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908042    2562 flags.go:64] FLAG: --register-node="true"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908044    2562 flags.go:64] FLAG: --register-with-taints=""
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908048    2562 flags.go:64] FLAG: --registry-burst="10"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908051    2562 flags.go:64] FLAG: --registry-qps="5"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908054    2562 flags.go:64] FLAG: --reserved-cpus=""
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908057    2562 flags.go:64] FLAG: --reserved-memory=""
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908061    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908064    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908066    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908069    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908072    2562 flags.go:64] FLAG: --runonce="false"
Jun 09 13:28:20.914171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908075    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908078    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908080    2562 flags.go:64] FLAG: --seccomp-default="false"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908083    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908086    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908089    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908095    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908098    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908101    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908104    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908107    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908109    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908112    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908115    2562 flags.go:64] FLAG: --system-cgroups=""
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908118    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908123    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908126    2562 flags.go:64] FLAG: --tls-cert-file=""
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908129    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908132    2562 flags.go:64] FLAG: --tls-min-version=""
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908135    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908138    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908140    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908143    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908146    2562 flags.go:64] FLAG: --v="2"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908150    2562 flags.go:64] FLAG: --version="false"
Jun 09 13:28:20.914801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908154    2562 flags.go:64] FLAG: --vmodule=""
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908158    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.908161    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908283    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908287    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908290    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908293    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908296    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908299    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908302    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908305    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908308    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908311    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908315    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908317    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908320    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908322    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908325    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908328    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908330    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 13:28:20.915409 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908333    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908336    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908338    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908342    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908346    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908349    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908351    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908353    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908356    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908359    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908361    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908363    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908366    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908369    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908371    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908374    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908376    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908379    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908381    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 13:28:20.915919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908384    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908386    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908389    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908391    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908394    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908396    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908400    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908403    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908405    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908408    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908411    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908415    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908418    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908421    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908425    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908428    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908430    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908433    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908435    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 13:28:20.916365 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908437    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908440    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908442    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908445    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908447    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908450    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908452    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908455    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908458    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908461    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908464    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908466    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908469    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908471    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908473    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908476    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908479    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908481    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908484    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908488    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 13:28:20.916879 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908491    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908494    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908496    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908499    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908501    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908504    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908506    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908514    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908516    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908519    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908521    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908525    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908528    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908531    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908534    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908537    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908539    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908542    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908544    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908547    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 13:28:20.917405 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908549    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 13:28:20.917919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908553    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 13:28:20.917919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908556    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 13:28:20.917919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.908558    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 13:28:20.917919 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.909206    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 09 13:28:20.917919 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.915759    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 09 13:28:20.917919 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.915775    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 09 13:28:20.917919 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.916600    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 09 13:28:20.917919 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.916607    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 09 13:28:20.917919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916664    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 13:28:20.917919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916670    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 13:28:20.917919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916673    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 13:28:20.917919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916676    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 13:28:20.917919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916679    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 13:28:20.917919 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916682    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916684    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916687    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916690    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916695    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916698    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916701    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916704    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916707    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916710    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916712    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916715    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916717    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916720    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916722    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916724    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916743    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916747    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916749    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 13:28:20.918271 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916752    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916756    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916759    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916762    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916765    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916769    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916772    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916775    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916777    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916780    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916783    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916785    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916788    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916790    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916793    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916795    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916798    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916800    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916803    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916805    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 13:28:20.918779 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916808    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916810    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916813    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916816    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916819    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916821    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916824    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916826    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916829    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916831    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916834    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916836    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916839    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916842    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916844    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916847    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916849    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916852    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916855    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916857    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 13:28:20.919255 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916860    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916862    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916864    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916867    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916869    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916872    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916875    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916877    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916879    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916882    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916884    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916887    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916890    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916893    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916895    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916898    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916900    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916902    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916906    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916909    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 13:28:20.919757 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916912    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 13:28:20.920257 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916915    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 13:28:20.920257 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916918    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 13:28:20.920257 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916920    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 13:28:20.920257 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916923    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 13:28:20.920257 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916926    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 13:28:20.920257 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916929    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 13:28:20.920257 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916931    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 13:28:20.920257 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916933    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 13:28:20.920257 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916936    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 13:28:20.920257 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916938    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 13:28:20.920257 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916942    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 13:28:20.920257 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916944    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 13:28:20.920257 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916946    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 13:28:20.920257 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.916949    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 13:28:20.920257 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.916954    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917067    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917072    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917075    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917078    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917081    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917084    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917086    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917089    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917092    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917095    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917097    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917100    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917103    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917105    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917108    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917110    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917113    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917116    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917118    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 09 13:28:20.920633 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917121    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917123    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917125    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917128    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917131    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917133    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917135    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917138    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917140    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917143    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917146    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917148    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917151    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917153    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917156    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917158    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917161    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917163    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917166    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917168    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 09 13:28:20.921206 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917170    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917173    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917175    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917177    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917180    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917182    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917185    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917187    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917190    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917192    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917195    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917197    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917199    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917202    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917204    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917207    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917209    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917212    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917214    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917217    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 09 13:28:20.921690 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917221    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917224    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917227    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917229    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917232    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917234    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917237    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917239    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917242    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917244    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917246    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917249    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917251    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917253    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917256    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917259    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917261    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917263    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917266    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917268    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 09 13:28:20.922180 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917270    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917273    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917275    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917278    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917280    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917283    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917285    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917288    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917291    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917294    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917297    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917300    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917303    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917305    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917309    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917313    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917316    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917318    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 09 13:28:20.922688 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917321    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 09 13:28:20.923133 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:20.917324    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 09 13:28:20.923133 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.917329    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 09 13:28:20.923133 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.917432    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 09 13:28:20.923133 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.919305    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 09 13:28:20.923133 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.920787    2562 server.go:1019] "Starting client certificate rotation"
Jun 09 13:28:20.923133 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.920888    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 09 13:28:20.923133 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.920933    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 09 13:28:20.923337 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.923194    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 09 13:28:20.924389 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.924359    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 09 13:28:20.938521 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.938497    2562 log.go:25] "Validated CRI v1 runtime API"
Jun 09 13:28:20.940823 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.940794    2562 log.go:25] "Validated CRI v1 image API"
Jun 09 13:28:20.941666 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.941644    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 09 13:28:20.944120 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.944101    2562 fs.go:135] Filesystem UUIDs: map[42a3a4a4-9763-4f81-8ebe-ead7fee52e39:/dev/nvme0n1p3 6aaca34f-f24f-4e79-838a-1a46e823c8e9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jun 09 13:28:20.944193 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.944120    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 09 13:28:20.944897 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.944881    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 09 13:28:20.949398 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.949274    2562 manager.go:216] Machine: {Timestamp:2026-06-09 13:28:20.948090531 +0000 UTC m=+0.322761283 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091311 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20f48be6f7525703c28a9d2a3974e4 SystemUUID:ec20f48b-e6f7-5257-03c2-8a9d2a3974e4 BootID:6c073627-d394-4920-aecc-9efc5ec307ed Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:05:37:c9:ae:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:05:37:c9:ae:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:01:b8:b2:21:82 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 09 13:28:20.949398 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.949398    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 09 13:28:20.949508 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.949477    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 09 13:28:20.952552 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.952530    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 09 13:28:20.952696 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.952556    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-81.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 09 13:28:20.953817 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.953805    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jun 09 13:28:20.953852 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.953820    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jun 09 13:28:20.953852 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.953834    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 09 13:28:20.954529 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.954519    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 09 13:28:20.955314 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.955304    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 09 13:28:20.958237 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.958226    2562 state_mem.go:36] "Initialized new in-memory state store"
Jun 09 13:28:20.958359 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.958350    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 09 13:28:20.958391 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.958379    2562 kubelet.go:486] "Attempting to sync node with API server"
Jun 09 13:28:20.958419 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.958394    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 09 13:28:20.958419 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.958408    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 09 13:28:20.958419 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.958418    2562 kubelet.go:398] "Adding apiserver pod source"
Jun 09 13:28:20.958492 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.958428    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 09 13:28:20.958772 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.958760    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 09 13:28:20.958846 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.958781    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 09 13:28:20.962155 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.962130    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 09 13:28:20.966300 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.966277    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 09 13:28:20.966355 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.966316    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 09 13:28:20.967323 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.967310    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 09 13:28:20.967364 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.967328    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 09 13:28:20.967364 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.967334    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 09 13:28:20.967364 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.967340    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 09 13:28:20.967364 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.967350    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 09 13:28:20.967364 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.967355    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 09 13:28:20.967364 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.967364    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 09 13:28:20.967519 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.967369    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 09 13:28:20.967519 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.967379    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 09 13:28:20.967519 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.967385    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 09 13:28:20.967519 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.967393    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 09 13:28:20.967519 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.967399    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 09 13:28:20.968241 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.968224    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 09 13:28:20.968241 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.968241    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 09 13:28:20.968378 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.968358    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dngr7"
Jun 09 13:28:20.970170 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:20.970126    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-81.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 09 13:28:20.970278 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:20.970149    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 09 13:28:20.971868 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.971852    2562 server.go:1268] "Started kubelet"
Jun 09 13:28:20.971939 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.971916    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 09 13:28:20.972084 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.971998    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 09 13:28:20.972141 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.972110    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 09 13:28:20.972418 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.972392    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-81.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 09 13:28:20.972997 ip-10-0-130-81 systemd[1]: Started Kubernetes Kubelet.
Jun 09 13:28:20.976310 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.976279    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dngr7"
Jun 09 13:28:20.976567 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.976551    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 09 13:28:20.977473 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.977457    2562 server.go:310] "Adding debug handlers to kubelet server"
Jun 09 13:28:20.979859 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:20.979783    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 09 13:28:20.980676 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.980655    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 09 13:28:20.980676 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.980664    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 09 13:28:20.980850 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:20.980720    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jun 09 13:28:20.981373 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.981348    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 09 13:28:20.981373 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.981350    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 09 13:28:20.981517 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.981381    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 09 13:28:20.981517 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.981497    2562 reconstruct.go:97] "Volume reconstruction finished"
Jun 09 13:28:20.981517 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.981503    2562 reconciler.go:29] "Reconciler: start to sync state"
Jun 09 13:28:20.981659 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.981608    2562 factory.go:55] Registering systemd factory
Jun 09 13:28:20.981659 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.981640    2562 factory.go:223] Registration of the systemd container factory successfully
Jun 09 13:28:20.981926 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.981910    2562 factory.go:153] Registering CRI-O factory
Jun 09 13:28:20.981926 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.981927    2562 factory.go:223] Registration of the crio container factory successfully
Jun 09 13:28:20.982075 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.981983    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 09 13:28:20.982075 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.982011    2562 factory.go:103] Registering Raw factory
Jun 09 13:28:20.982075 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.982025    2562 manager.go:1196] Started watching for new ooms in manager
Jun 09 13:28:20.982621 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.982441    2562 manager.go:349] Starting recovery of all containers
Jun 09 13:28:20.983789 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:20.982796    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-81.ec2.internal.18b76cb4b13c51f3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-81.ec2.internal,UID:ip-10-0-130-81.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-81.ec2.internal,},FirstTimestamp:2026-06-09 13:28:20.971753971 +0000 UTC m=+0.346424722,LastTimestamp:2026-06-09 13:28:20.971753971 +0000 UTC m=+0.346424722,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-81.ec2.internal,}"
Jun 09 13:28:20.991995 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.991854    2562 manager.go:354] Recovery completed
Jun 09 13:28:20.992924 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.992900    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 13:28:20.997051 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:20.997034    2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-81.ec2.internal\" not found" node="ip-10-0-130-81.ec2.internal"
Jun 09 13:28:20.997694 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.997683    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 13:28:20.999644 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.999626    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 13:28:20.999754 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.999657    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 13:28:20.999754 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:20.999672    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientPID"
Jun 09 13:28:21.000150 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.000137    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 09 13:28:21.000150 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.000149    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 09 13:28:21.000264 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.000169    2562 state_mem.go:36] "Initialized new in-memory state store"
Jun 09 13:28:21.000264 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.000194    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 13:28:21.001040 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.001025    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 13:28:21.001100 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.001053    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 13:28:21.001100 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.001063    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientPID"
Jun 09 13:28:21.001294 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.001280    2562 policy_none.go:49] "None policy: Start"
Jun 09 13:28:21.001352 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.001301    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 09 13:28:21.001352 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.001314    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 09 13:28:21.002388 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.002374    2562 policy_none.go:47] "Start"
Jun 09 13:28:21.045819 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.037106    2562 manager.go:337] "Starting Device Plugin manager"
Jun 09 13:28:21.045819 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:21.037147    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 09 13:28:21.045819 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.037160    2562 server.go:87] "Starting device plugin registration server"
Jun 09 13:28:21.045819 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.037430    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 09 13:28:21.045819 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.037442    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 09 13:28:21.045819 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.037512    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 09 13:28:21.045819 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.037605    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 09 13:28:21.045819 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.037613    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 09 13:28:21.045819 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:21.038388    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 09 13:28:21.045819 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:21.038466    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-81.ec2.internal\" not found"
Jun 09 13:28:21.047209 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.047188    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 09 13:28:21.048535 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.048515    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 09 13:28:21.048625 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.048552    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 09 13:28:21.048625 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.048574    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 09 13:28:21.048625 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:21.048612    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 09 13:28:21.053217 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.051783    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 13:28:21.138464 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.138434    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 13:28:21.139632 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.139614    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 13:28:21.139726 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.139646    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 13:28:21.139726 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.139657    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientPID"
Jun 09 13:28:21.139726 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.139680    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-81.ec2.internal"
Jun 09 13:28:21.148260 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.148244    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-81.ec2.internal"
Jun 09 13:28:21.148378 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:21.148267    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-81.ec2.internal\": node \"ip-10-0-130-81.ec2.internal\" not found"
Jun 09 13:28:21.148691 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.148654    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal"]
Jun 09 13:28:21.148756 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.148751    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 13:28:21.149510 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.149494    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 13:28:21.149594 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.149521    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 13:28:21.149594 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.149535    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientPID"
Jun 09 13:28:21.150892 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.150880    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 13:28:21.151015 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.151002    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jun 09 13:28:21.151054 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.151035    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 13:28:21.151588 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.151573    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 13:28:21.151660 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.151592    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 13:28:21.151660 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.151603    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientPID"
Jun 09 13:28:21.151660 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.151612    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 13:28:21.151660 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.151630    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 13:28:21.151660 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.151638    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientPID"
Jun 09 13:28:21.152725 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.152711    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal"
Jun 09 13:28:21.152810 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.152753    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 09 13:28:21.153388 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.153371    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientMemory"
Jun 09 13:28:21.153450 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.153404    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasNoDiskPressure"
Jun 09 13:28:21.153450 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.153418    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeHasSufficientPID"
Jun 09 13:28:21.164546 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:21.164529    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jun 09 13:28:21.183111 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.183090    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9354c623a5ab07e4ac4b5d10f8f810ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal\" (UID: \"9354c623a5ab07e4ac4b5d10f8f810ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jun 09 13:28:21.183175 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.183117    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9354c623a5ab07e4ac4b5d10f8f810ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal\" (UID: \"9354c623a5ab07e4ac4b5d10f8f810ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jun 09 13:28:21.183175 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.183134    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aea07464dfd29937372692ed2802aec2-config\") pod \"kube-apiserver-proxy-ip-10-0-130-81.ec2.internal\" (UID: \"aea07464dfd29937372692ed2802aec2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal"
Jun 09 13:28:21.187339 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:21.187324    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-81.ec2.internal\" not found" node="ip-10-0-130-81.ec2.internal"
Jun 09 13:28:21.190618 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:21.190603    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-81.ec2.internal\" not found" node="ip-10-0-130-81.ec2.internal"
Jun 09 13:28:21.265310 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:21.265285    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jun 09 13:28:21.283547 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.283525    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9354c623a5ab07e4ac4b5d10f8f810ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal\" (UID: \"9354c623a5ab07e4ac4b5d10f8f810ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jun 09 13:28:21.283615 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.283555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aea07464dfd29937372692ed2802aec2-config\") pod \"kube-apiserver-proxy-ip-10-0-130-81.ec2.internal\" (UID: \"aea07464dfd29937372692ed2802aec2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal"
Jun 09 13:28:21.283615 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.283573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9354c623a5ab07e4ac4b5d10f8f810ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal\" (UID: \"9354c623a5ab07e4ac4b5d10f8f810ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jun 09 13:28:21.283706 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.283617    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9354c623a5ab07e4ac4b5d10f8f810ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal\" (UID: \"9354c623a5ab07e4ac4b5d10f8f810ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jun 09 13:28:21.283706 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.283635    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9354c623a5ab07e4ac4b5d10f8f810ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal\" (UID: \"9354c623a5ab07e4ac4b5d10f8f810ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jun 09 13:28:21.283706 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.283649    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/aea07464dfd29937372692ed2802aec2-config\") pod \"kube-apiserver-proxy-ip-10-0-130-81.ec2.internal\" (UID: \"aea07464dfd29937372692ed2802aec2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal"
Jun 09 13:28:21.365680 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:21.365638    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jun 09 13:28:21.466467 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:21.466383    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jun 09 13:28:21.490833 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.490810    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jun 09 13:28:21.494222 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.494159    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal"
Jun 09 13:28:21.567236 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:21.567204    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jun 09 13:28:21.667794 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:21.667767    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jun 09 13:28:21.768297 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:21.768222    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jun 09 13:28:21.868812 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:21.868781    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jun 09 13:28:21.920311 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.920284    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 09 13:28:21.921066 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.920455    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 09 13:28:21.921066 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.920492    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 09 13:28:21.969137 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:21.969102    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jun 09 13:28:21.980629 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.980598    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 13:23:20 +0000 UTC" deadline="2028-01-14 18:54:24.750378071 +0000 UTC"
Jun 09 13:28:21.980629 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:21.980627    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14021h26m2.769755016s"
Jun 09 13:28:22.003625 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:22.003591    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea07464dfd29937372692ed2802aec2.slice/crio-0d521956e4922ee972b29d833b9ac165541d790f4e4d0b634cc533f2ea6855ed WatchSource:0}: Error finding container 0d521956e4922ee972b29d833b9ac165541d790f4e4d0b634cc533f2ea6855ed: Status 404 returned error can't find the container with id 0d521956e4922ee972b29d833b9ac165541d790f4e4d0b634cc533f2ea6855ed
Jun 09 13:28:22.003838 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:22.003819    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9354c623a5ab07e4ac4b5d10f8f810ac.slice/crio-36e0279eb7da3ad9163ffa3f7dc84bf4db20f2628e143ac8bbeb65b28f520d92 WatchSource:0}: Error finding container 36e0279eb7da3ad9163ffa3f7dc84bf4db20f2628e143ac8bbeb65b28f520d92: Status 404 returned error can't find the container with id 36e0279eb7da3ad9163ffa3f7dc84bf4db20f2628e143ac8bbeb65b28f520d92
Jun 09 13:28:22.008229 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.008213    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 09 13:28:22.052540 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.052442    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal" event={"ID":"aea07464dfd29937372692ed2802aec2","Type":"ContainerStarted","Data":"0d521956e4922ee972b29d833b9ac165541d790f4e4d0b634cc533f2ea6855ed"}
Jun 09 13:28:22.053540 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.053516    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal" event={"ID":"9354c623a5ab07e4ac4b5d10f8f810ac","Type":"ContainerStarted","Data":"36e0279eb7da3ad9163ffa3f7dc84bf4db20f2628e143ac8bbeb65b28f520d92"}
Jun 09 13:28:22.069686 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:22.069648    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jun 09 13:28:22.170161 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:22.170110    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jun 09 13:28:22.270668 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:22.270637    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jun 09 13:28:22.371206 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:22.371124    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jun 09 13:28:22.472168 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:22.472130    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-81.ec2.internal\" not found"
Jun 09 13:28:22.537240 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.537199    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 13:28:22.550558 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.550529    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 13:28:22.581195 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.581167    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal"
Jun 09 13:28:22.591815 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.591784    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 09 13:28:22.592960 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.592929    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal"
Jun 09 13:28:22.601463 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.601435    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 09 13:28:22.886886 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.886859    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 13:28:22.959855 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.959823    2562 apiserver.go:52] "Watching apiserver"
Jun 09 13:28:22.965329 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.965302    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 09 13:28:22.965708 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.965681    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-lnm5m","openshift-multus/network-metrics-daemon-xfldj","openshift-ovn-kubernetes/ovnkube-node-r6glq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh","openshift-dns/node-resolver-9bbb6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal","openshift-multus/multus-n6rnd","openshift-network-diagnostics/network-check-target-7gwnl","openshift-network-operator/iptables-alerter-jghnm","kube-system/global-pull-secret-syncer-sf96c","kube-system/konnectivity-agent-cfjjj","kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal","openshift-cluster-node-tuning-operator/tuned-tghmb","openshift-image-registry/node-ca-zl45c"]
Jun 09 13:28:22.968234 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.968212    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.970385 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.970365    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 09 13:28:22.970574 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.970556    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 09 13:28:22.970648 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.970641    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-grczb\""
Jun 09 13:28:22.970846 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.970826    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 09 13:28:22.970963 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.970369    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 09 13:28:22.971097 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.971084    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:22.974178 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.974156    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.974272 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.974213    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 09 13:28:22.974272 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.974250    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gqrh9\""
Jun 09 13:28:22.974618 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.974215    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 09 13:28:22.975576 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.975556    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:22.976422 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.976402    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 09 13:28:22.976537 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.976514    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 09 13:28:22.976621 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.976555    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-scgg6\""
Jun 09 13:28:22.976768 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.976753    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 09 13:28:22.976930 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.976909    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 09 13:28:22.977024 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.977000    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 09 13:28:22.977086 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.977053    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 09 13:28:22.977667 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.977650    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 09 13:28:22.977773 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.977675    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 09 13:28:22.977773 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.977676    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qp2tm\""
Jun 09 13:28:22.978010 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.977995    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 09 13:28:22.978312 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.978292    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9bbb6"
Jun 09 13:28:22.980446 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.980427    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 09 13:28:22.980550 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.980452    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dmqlt\""
Jun 09 13:28:22.980550 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.980428    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 09 13:28:22.980696 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.980674    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zl45c"
Jun 09 13:28:22.982088 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.982069    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 09 13:28:22.982842 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.982804    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 09 13:28:22.982842 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.982817    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 09 13:28:22.982842 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.982834    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 09 13:28:22.983062 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.983008    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tqg85\""
Jun 09 13:28:22.983115 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.983107    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jghnm"
Jun 09 13:28:22.985306 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.985290    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:22.985402 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.985376    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 09 13:28:22.985474 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.985416    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lmltb\""
Jun 09 13:28:22.985474 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.985470    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 09 13:28:22.985561 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.985415    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 09 13:28:22.987518 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.987500    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 09 13:28:22.987518 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.987503    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 09 13:28:22.987744 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.987714    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wt92l\""
Jun 09 13:28:22.987969 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.987954    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:22.988050 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:22.988028    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:22.990330 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.990290    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:22.990417 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:22.990353    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:22.992767 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.992749    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cfjjj"
Jun 09 13:28:22.993643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.993625    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-var-lib-kubelet\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:22.993749 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.993654    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-sys-fs\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:22.993749 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.993677    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-system-cni-dir\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.993749 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.993713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-var-lib-cni-bin\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.993912 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.993758    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-var-lib-kubelet\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.993912 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.993794    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-systemd-units\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.993912 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.993830    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-run-netns\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.993912 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.993854    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-multus-conf-dir\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.993912 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.993888    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-etc-openvswitch\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.993912 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.993909    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-sys\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:22.994176 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.993933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs62z\" (UniqueName: \"kubernetes.io/projected/1627b431-7d8e-4b7b-b5ee-01103ef5179a-kube-api-access-rs62z\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:22.994176 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.993973    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-device-dir\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:22.994176 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994009    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e9a83c7d-349e-4a6c-890b-6491c85d1cf1-iptables-alerter-script\") pod \"iptables-alerter-jghnm\" (UID: \"e9a83c7d-349e-4a6c-890b-6491c85d1cf1\") " pod="openshift-network-operator/iptables-alerter-jghnm"
Jun 09 13:28:22.994176 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994037    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-multus-socket-dir-parent\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.994176 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994061    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-var-lib-openvswitch\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.994176 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994084    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63fc7b55-3923-4edb-909b-df55349b7a32-ovn-node-metrics-cert\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.994176 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994107    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:22.994176 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-etc-selinux\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:22.994176 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxt8n\" (UniqueName: \"kubernetes.io/projected/e28d2f2d-2286-44be-99ba-641e1649ac47-kube-api-access-sxt8n\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:22.994475 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994164    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9ed8bc4-1037-41b7-ac71-9b6aae568b79-hosts-file\") pod \"node-resolver-9bbb6\" (UID: \"c9ed8bc4-1037-41b7-ac71-9b6aae568b79\") " pod="openshift-dns/node-resolver-9bbb6"
Jun 09 13:28:22.994475 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9ed8bc4-1037-41b7-ac71-9b6aae568b79-tmp-dir\") pod \"node-resolver-9bbb6\" (UID: \"c9ed8bc4-1037-41b7-ac71-9b6aae568b79\") " pod="openshift-dns/node-resolver-9bbb6"
Jun 09 13:28:22.994475 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-cnibin\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.994475 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-run-ovn\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.994475 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994275    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x7b5\" (UniqueName: \"kubernetes.io/projected/e9a83c7d-349e-4a6c-890b-6491c85d1cf1-kube-api-access-7x7b5\") pod \"iptables-alerter-jghnm\" (UID: \"e9a83c7d-349e-4a6c-890b-6491c85d1cf1\") " pod="openshift-network-operator/iptables-alerter-jghnm"
Jun 09 13:28:22.994475 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994297    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-hostroot\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.994475 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994315    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-node-log\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.994475 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e9007b1-6e07-49ff-b1a5-d40904431d90-serviceca\") pod \"node-ca-zl45c\" (UID: \"0e9007b1-6e07-49ff-b1a5-d40904431d90\") " pod="openshift-image-registry/node-ca-zl45c"
Jun 09 13:28:22.994475 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994358    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-kubelet\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.994475 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994380    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-run-ovn-kubernetes\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.994475 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994404    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63fc7b55-3923-4edb-909b-df55349b7a32-ovnkube-script-lib\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.994475 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994428    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1627b431-7d8e-4b7b-b5ee-01103ef5179a-tmp\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:22.994475 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994450    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-var-lib-cni-multus\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.994475 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994473    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-cni-netd\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.995034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994496    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzmj9\" (UniqueName: \"kubernetes.io/projected/63fc7b55-3923-4edb-909b-df55349b7a32-kube-api-access-xzmj9\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.995034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994518    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e9007b1-6e07-49ff-b1a5-d40904431d90-host\") pod \"node-ca-zl45c\" (UID: \"0e9007b1-6e07-49ff-b1a5-d40904431d90\") " pod="openshift-image-registry/node-ca-zl45c"
Jun 09 13:28:22.995034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994541    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63fc7b55-3923-4edb-909b-df55349b7a32-ovnkube-config\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.995034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994562    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-run\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:22.995034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994583    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9a83c7d-349e-4a6c-890b-6491c85d1cf1-host-slash\") pod \"iptables-alerter-jghnm\" (UID: \"e9a83c7d-349e-4a6c-890b-6491c85d1cf1\") " pod="openshift-network-operator/iptables-alerter-jghnm"
Jun 09 13:28:22.995034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994605    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-cni-binary-copy\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.995034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994642    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-lib-modules\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:22.995034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994664    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-socket-dir\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:22.995034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994694    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-kubernetes\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:22.995034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994716    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-sysctl-d\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:22.995034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994758    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-host\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:22.995034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994782    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-multus-cni-dir\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.995034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-slash\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.995034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-sysconfig\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:22.995034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-tuned\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:22.995034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-registration-dir\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:22.995034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994942    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994954    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t64z\" (UniqueName: \"kubernetes.io/projected/c9ed8bc4-1037-41b7-ac71-9b6aae568b79-kube-api-access-8t64z\") pod \"node-resolver-9bbb6\" (UID: \"c9ed8bc4-1037-41b7-ac71-9b6aae568b79\") " pod="openshift-dns/node-resolver-9bbb6"
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-multus-daemon-config\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.995005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-run-multus-certs\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.995027    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-cni-bin\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.994984    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.995057    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jpb9c\""
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.995057    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-modprobe-d\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.995117    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-sysctl-conf\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.995142    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-systemd\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.995166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-run-k8s-cni-cncf-io\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.995192    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn6rj\" (UniqueName: \"kubernetes.io/projected/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-kube-api-access-nn6rj\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.995214    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-run-systemd\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.995235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-run-openvswitch\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.995256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-os-release\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.995280    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-run-netns\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.995304    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-log-socket\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.995329    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63fc7b55-3923-4edb-909b-df55349b7a32-env-overrides\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.995643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.995353    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6fkp\" (UniqueName: \"kubernetes.io/projected/0e9007b1-6e07-49ff-b1a5-d40904431d90-kube-api-access-t6fkp\") pod \"node-ca-zl45c\" (UID: \"0e9007b1-6e07-49ff-b1a5-d40904431d90\") " pod="openshift-image-registry/node-ca-zl45c"
Jun 09 13:28:22.996412 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.995378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-etc-kubernetes\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:22.996412 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.995401    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:22.996478 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.996457    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:22.996520 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:22.996501    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:22.997580 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:22.997560    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 09 13:28:23.014403 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.014382    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 09 13:28:23.019450 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.019429    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-68k2c"
Jun 09 13:28:23.025863 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.025842    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-68k2c"
Jun 09 13:28:23.082463 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.082438    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 09 13:28:23.096598 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096567    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e9a83c7d-349e-4a6c-890b-6491c85d1cf1-iptables-alerter-script\") pod \"iptables-alerter-jghnm\" (UID: \"e9a83c7d-349e-4a6c-890b-6491c85d1cf1\") " pod="openshift-network-operator/iptables-alerter-jghnm"
Jun 09 13:28:23.096786 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096603    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-multus-socket-dir-parent\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.096786 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096637    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-var-lib-openvswitch\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.096786 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096687    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63fc7b55-3923-4edb-909b-df55349b7a32-ovn-node-metrics-cert\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.096786 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096726    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:23.096786 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096745    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-multus-socket-dir-parent\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.096786 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-etc-selinux\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:23.096786 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxt8n\" (UniqueName: \"kubernetes.io/projected/e28d2f2d-2286-44be-99ba-641e1649ac47-kube-api-access-sxt8n\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:23.097157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9ed8bc4-1037-41b7-ac71-9b6aae568b79-hosts-file\") pod \"node-resolver-9bbb6\" (UID: \"c9ed8bc4-1037-41b7-ac71-9b6aae568b79\") " pod="openshift-dns/node-resolver-9bbb6"
Jun 09 13:28:23.097157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096818    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9ed8bc4-1037-41b7-ac71-9b6aae568b79-tmp-dir\") pod \"node-resolver-9bbb6\" (UID: \"c9ed8bc4-1037-41b7-ac71-9b6aae568b79\") " pod="openshift-dns/node-resolver-9bbb6"
Jun 09 13:28:23.097157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-cnibin\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.097157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096848    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-run-ovn\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.097157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096867    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93f2797e-1352-4f1b-9a19-ed20fab0de84-os-release\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.097157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096892    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x7b5\" (UniqueName: \"kubernetes.io/projected/e9a83c7d-349e-4a6c-890b-6491c85d1cf1-kube-api-access-7x7b5\") pod \"iptables-alerter-jghnm\" (UID: \"e9a83c7d-349e-4a6c-890b-6491c85d1cf1\") " pod="openshift-network-operator/iptables-alerter-jghnm"
Jun 09 13:28:23.097157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096915    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-hostroot\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.097157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096932    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-node-log\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.097157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e9007b1-6e07-49ff-b1a5-d40904431d90-serviceca\") pod \"node-ca-zl45c\" (UID: \"0e9007b1-6e07-49ff-b1a5-d40904431d90\") " pod="openshift-image-registry/node-ca-zl45c"
Jun 09 13:28:23.097157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096965    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/93f2797e-1352-4f1b-9a19-ed20fab0de84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.097157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trcbp\" (UniqueName: \"kubernetes.io/projected/bfb80980-0aa2-49ab-b601-b895816adbb7-kube-api-access-trcbp\") pod \"network-metrics-daemon-xfldj\" (UID: \"bfb80980-0aa2-49ab-b601-b895816adbb7\") " pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:23.097157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.096996    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-kubelet\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.097157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097010    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-run-ovn-kubernetes\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.097157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097029    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63fc7b55-3923-4edb-909b-df55349b7a32-ovnkube-script-lib\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.097157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93f2797e-1352-4f1b-9a19-ed20fab0de84-cnibin\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.097157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-dbus\") pod \"global-pull-secret-syncer-sf96c\" (UID: \"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5\") " pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:23.097157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097089    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret\") pod \"global-pull-secret-syncer-sf96c\" (UID: \"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5\") " pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097129    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1627b431-7d8e-4b7b-b5ee-01103ef5179a-tmp\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097114    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097146    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-var-lib-cni-multus\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097163    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-cni-netd\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097176    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097184    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzmj9\" (UniqueName: \"kubernetes.io/projected/63fc7b55-3923-4edb-909b-df55349b7a32-kube-api-access-xzmj9\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097238    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e9007b1-6e07-49ff-b1a5-d40904431d90-host\") pod \"node-ca-zl45c\" (UID: \"0e9007b1-6e07-49ff-b1a5-d40904431d90\") " pod="openshift-image-registry/node-ca-zl45c"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097257    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63fc7b55-3923-4edb-909b-df55349b7a32-ovnkube-config\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097273    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-run\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097291    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9a83c7d-349e-4a6c-890b-6491c85d1cf1-host-slash\") pod \"iptables-alerter-jghnm\" (UID: \"e9a83c7d-349e-4a6c-890b-6491c85d1cf1\") " pod="openshift-network-operator/iptables-alerter-jghnm"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097313    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-cni-binary-copy\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097323    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e9a83c7d-349e-4a6c-890b-6491c85d1cf1-iptables-alerter-script\") pod \"iptables-alerter-jghnm\" (UID: \"e9a83c7d-349e-4a6c-890b-6491c85d1cf1\") " pod="openshift-network-operator/iptables-alerter-jghnm"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097337    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/93f2797e-1352-4f1b-9a19-ed20fab0de84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097369    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-lib-modules\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097387    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-socket-dir\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097404    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-kubernetes\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097462    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e9007b1-6e07-49ff-b1a5-d40904431d90-host\") pod \"node-ca-zl45c\" (UID: \"0e9007b1-6e07-49ff-b1a5-d40904431d90\") " pod="openshift-image-registry/node-ca-zl45c"
Jun 09 13:28:23.098060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097493    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-hostroot\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097537    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-kubernetes\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097587    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-kubelet\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097897    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/63fc7b55-3923-4edb-909b-df55349b7a32-ovnkube-config\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097914    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c9ed8bc4-1037-41b7-ac71-9b6aae568b79-hosts-file\") pod \"node-resolver-9bbb6\" (UID: \"c9ed8bc4-1037-41b7-ac71-9b6aae568b79\") " pod="openshift-dns/node-resolver-9bbb6"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097944    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-run\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097971    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e9a83c7d-349e-4a6c-890b-6491c85d1cf1-host-slash\") pod \"iptables-alerter-jghnm\" (UID: \"e9a83c7d-349e-4a6c-890b-6491c85d1cf1\") " pod="openshift-network-operator/iptables-alerter-jghnm"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098181    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c9ed8bc4-1037-41b7-ac71-9b6aae568b79-tmp-dir\") pod \"node-resolver-9bbb6\" (UID: \"c9ed8bc4-1037-41b7-ac71-9b6aae568b79\") " pod="openshift-dns/node-resolver-9bbb6"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098244    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-cnibin\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098288    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-run-ovn\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098323    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-run-ovn-kubernetes\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098357    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-etc-selinux\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-sysctl-d\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.097540    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-node-log\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098530    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-var-lib-openvswitch\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098625    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-cni-binary-copy\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098660    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-host\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098691    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-multus-cni-dir\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.098993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098717    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-slash\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098750    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-sysctl-d\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098771    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-sysconfig\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098797    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-tuned\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098811    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/63fc7b55-3923-4edb-909b-df55349b7a32-ovnkube-script-lib\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-registration-dir\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098851    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t64z\" (UniqueName: \"kubernetes.io/projected/c9ed8bc4-1037-41b7-ac71-9b6aae568b79-kube-api-access-8t64z\") pod \"node-resolver-9bbb6\" (UID: \"c9ed8bc4-1037-41b7-ac71-9b6aae568b79\") " pod="openshift-dns/node-resolver-9bbb6"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098906    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-cni-netd\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098941    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-registration-dir\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.098983    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-host\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099074    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-lib-modules\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099136    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e9007b1-6e07-49ff-b1a5-d40904431d90-serviceca\") pod \"node-ca-zl45c\" (UID: \"0e9007b1-6e07-49ff-b1a5-d40904431d90\") " pod="openshift-image-registry/node-ca-zl45c"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099167    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-socket-dir\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099179    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-multus-cni-dir\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099203    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-slash\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099212    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-var-lib-cni-multus\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099229    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-sysconfig\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099240    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-multus-daemon-config\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.099841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099374    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-run-multus-certs\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099420    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-run-multus-certs\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-cni-bin\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099497    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93f2797e-1352-4f1b-9a19-ed20fab0de84-cni-binary-copy\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099510    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-cni-bin\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-modprobe-d\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-sysctl-conf\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099668    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-modprobe-d\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099655    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-systemd\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099716    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-sysctl-conf\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099762    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-run-k8s-cni-cncf-io\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099777    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-systemd\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099791    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-multus-daemon-config\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099798    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nn6rj\" (UniqueName: \"kubernetes.io/projected/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-kube-api-access-nn6rj\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099839    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-run-systemd\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099844    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-run-k8s-cni-cncf-io\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-run-openvswitch\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.099982    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-run-systemd\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.100801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100038    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-os-release\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.101638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100063    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-run-openvswitch\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.101638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100133    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-run-netns\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.101638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100133    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-os-release\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.101638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100174    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-log-socket\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.101638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100202    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63fc7b55-3923-4edb-909b-df55349b7a32-env-overrides\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.101638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100212    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-run-netns\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.101638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6fkp\" (UniqueName: \"kubernetes.io/projected/0e9007b1-6e07-49ff-b1a5-d40904431d90-kube-api-access-t6fkp\") pod \"node-ca-zl45c\" (UID: \"0e9007b1-6e07-49ff-b1a5-d40904431d90\") " pod="openshift-image-registry/node-ca-zl45c"
Jun 09 13:28:23.101638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100257    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f2797e-1352-4f1b-9a19-ed20fab0de84-system-cni-dir\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.101638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100269    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-log-socket\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.101638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100308    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93f2797e-1352-4f1b-9a19-ed20fab0de84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.101638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aafe4ec3-c2bc-4c0a-b90f-7246208c42dc-konnectivity-ca\") pod \"konnectivity-agent-cfjjj\" (UID: \"aafe4ec3-c2bc-4c0a-b90f-7246208c42dc\") " pod="kube-system/konnectivity-agent-cfjjj"
Jun 09 13:28:23.101638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100362    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-etc-kubernetes\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.101638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100385    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.101638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aafe4ec3-c2bc-4c0a-b90f-7246208c42dc-agent-certs\") pod \"konnectivity-agent-cfjjj\" (UID: \"aafe4ec3-c2bc-4c0a-b90f-7246208c42dc\") " pod="kube-system/konnectivity-agent-cfjjj"
Jun 09 13:28:23.101638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100418    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z99h\" (UniqueName: \"kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h\") pod \"network-check-target-7gwnl\" (UID: \"6db742ac-0935-4dd7-917b-a954274b44d3\") " pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:23.101638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-kubelet-config\") pod \"global-pull-secret-syncer-sf96c\" (UID: \"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5\") " pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:23.101638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-var-lib-kubelet\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100476    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-sys-fs\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-system-cni-dir\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100516    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-var-lib-cni-bin\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100556    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-etc-kubernetes\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100556    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-var-lib-kubelet\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-systemd-units\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100605    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-run-netns\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100622    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/63fc7b55-3923-4edb-909b-df55349b7a32-env-overrides\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100640    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjjdb\" (UniqueName: \"kubernetes.io/projected/93f2797e-1352-4f1b-9a19-ed20fab0de84-kube-api-access-xjjdb\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100653    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-system-cni-dir\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-multus-conf-dir\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100689    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-etc-openvswitch\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100691    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-var-lib-kubelet\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100699    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-var-lib-kubelet\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100761    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-host-run-netns\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100770    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-multus-conf-dir\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.102338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100784    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-host-var-lib-cni-bin\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.102980 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100803    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-systemd-units\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.102980 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100822    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/63fc7b55-3923-4edb-909b-df55349b7a32-etc-openvswitch\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.102980 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs\") pod \"network-metrics-daemon-xfldj\" (UID: \"bfb80980-0aa2-49ab-b601-b895816adbb7\") " pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:23.102980 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-sys\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.102980 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100867    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-sys-fs\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:23.102980 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100886    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs62z\" (UniqueName: \"kubernetes.io/projected/1627b431-7d8e-4b7b-b5ee-01103ef5179a-kube-api-access-rs62z\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.102980 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100910    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1627b431-7d8e-4b7b-b5ee-01103ef5179a-sys\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.102980 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100911    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-device-dir\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:23.102980 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100949    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e28d2f2d-2286-44be-99ba-641e1649ac47-device-dir\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:23.102980 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.100956    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1627b431-7d8e-4b7b-b5ee-01103ef5179a-tmp\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.102980 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.101249    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/63fc7b55-3923-4edb-909b-df55349b7a32-ovn-node-metrics-cert\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.102980 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.101400    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1627b431-7d8e-4b7b-b5ee-01103ef5179a-etc-tuned\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.106679 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.106650    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxt8n\" (UniqueName: \"kubernetes.io/projected/e28d2f2d-2286-44be-99ba-641e1649ac47-kube-api-access-sxt8n\") pod \"aws-ebs-csi-driver-node-6s6qh\" (UID: \"e28d2f2d-2286-44be-99ba-641e1649ac47\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:23.106844 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.106654    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x7b5\" (UniqueName: \"kubernetes.io/projected/e9a83c7d-349e-4a6c-890b-6491c85d1cf1-kube-api-access-7x7b5\") pod \"iptables-alerter-jghnm\" (UID: \"e9a83c7d-349e-4a6c-890b-6491c85d1cf1\") " pod="openshift-network-operator/iptables-alerter-jghnm"
Jun 09 13:28:23.107947 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.107902    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzmj9\" (UniqueName: \"kubernetes.io/projected/63fc7b55-3923-4edb-909b-df55349b7a32-kube-api-access-xzmj9\") pod \"ovnkube-node-r6glq\" (UID: \"63fc7b55-3923-4edb-909b-df55349b7a32\") " pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.109320 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.108961    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn6rj\" (UniqueName: \"kubernetes.io/projected/248841a6-cc02-45c5-a3bb-aa9c4252cdc8-kube-api-access-nn6rj\") pod \"multus-n6rnd\" (UID: \"248841a6-cc02-45c5-a3bb-aa9c4252cdc8\") " pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.109320 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.109219    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6fkp\" (UniqueName: \"kubernetes.io/projected/0e9007b1-6e07-49ff-b1a5-d40904431d90-kube-api-access-t6fkp\") pod \"node-ca-zl45c\" (UID: \"0e9007b1-6e07-49ff-b1a5-d40904431d90\") " pod="openshift-image-registry/node-ca-zl45c"
Jun 09 13:28:23.109320 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.109256    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t64z\" (UniqueName: \"kubernetes.io/projected/c9ed8bc4-1037-41b7-ac71-9b6aae568b79-kube-api-access-8t64z\") pod \"node-resolver-9bbb6\" (UID: \"c9ed8bc4-1037-41b7-ac71-9b6aae568b79\") " pod="openshift-dns/node-resolver-9bbb6"
Jun 09 13:28:23.109939 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.109919    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs62z\" (UniqueName: \"kubernetes.io/projected/1627b431-7d8e-4b7b-b5ee-01103ef5179a-kube-api-access-rs62z\") pod \"tuned-tghmb\" (UID: \"1627b431-7d8e-4b7b-b5ee-01103ef5179a\") " pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.201782 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.201695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93f2797e-1352-4f1b-9a19-ed20fab0de84-os-release\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.201782 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.201758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/93f2797e-1352-4f1b-9a19-ed20fab0de84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.201987 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.201787    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trcbp\" (UniqueName: \"kubernetes.io/projected/bfb80980-0aa2-49ab-b601-b895816adbb7-kube-api-access-trcbp\") pod \"network-metrics-daemon-xfldj\" (UID: \"bfb80980-0aa2-49ab-b601-b895816adbb7\") " pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:23.201987 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.201813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93f2797e-1352-4f1b-9a19-ed20fab0de84-cnibin\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.201987 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.201833    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-dbus\") pod \"global-pull-secret-syncer-sf96c\" (UID: \"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5\") " pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:23.201987 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.201835    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93f2797e-1352-4f1b-9a19-ed20fab0de84-os-release\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.201987 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.201854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret\") pod \"global-pull-secret-syncer-sf96c\" (UID: \"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5\") " pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:23.201987 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.201898    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/93f2797e-1352-4f1b-9a19-ed20fab0de84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.201987 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.201913    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93f2797e-1352-4f1b-9a19-ed20fab0de84-cnibin\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.201987 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.201931    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93f2797e-1352-4f1b-9a19-ed20fab0de84-cni-binary-copy\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.201987 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.201982    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f2797e-1352-4f1b-9a19-ed20fab0de84-system-cni-dir\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.202474 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.201989    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-dbus\") pod \"global-pull-secret-syncer-sf96c\" (UID: \"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5\") " pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:23.202474 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.202014    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93f2797e-1352-4f1b-9a19-ed20fab0de84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.202474 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.202042    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aafe4ec3-c2bc-4c0a-b90f-7246208c42dc-konnectivity-ca\") pod \"konnectivity-agent-cfjjj\" (UID: \"aafe4ec3-c2bc-4c0a-b90f-7246208c42dc\") " pod="kube-system/konnectivity-agent-cfjjj"
Jun 09 13:28:23.202474 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.202068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aafe4ec3-c2bc-4c0a-b90f-7246208c42dc-agent-certs\") pod \"konnectivity-agent-cfjjj\" (UID: \"aafe4ec3-c2bc-4c0a-b90f-7246208c42dc\") " pod="kube-system/konnectivity-agent-cfjjj"
Jun 09 13:28:23.202474 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.202077    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f2797e-1352-4f1b-9a19-ed20fab0de84-system-cni-dir\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.202474 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:23.202041    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 13:28:23.202474 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:23.202170    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret podName:4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:23.702147466 +0000 UTC m=+3.076818220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret") pod "global-pull-secret-syncer-sf96c" (UID: "4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5") : object "kube-system"/"original-pull-secret" not registered
Jun 09 13:28:23.202474 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.202093    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z99h\" (UniqueName: \"kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h\") pod \"network-check-target-7gwnl\" (UID: \"6db742ac-0935-4dd7-917b-a954274b44d3\") " pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:23.202474 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.202290    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-kubelet-config\") pod \"global-pull-secret-syncer-sf96c\" (UID: \"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5\") " pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:23.202474 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.202324    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjjdb\" (UniqueName: \"kubernetes.io/projected/93f2797e-1352-4f1b-9a19-ed20fab0de84-kube-api-access-xjjdb\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.202474 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.202351    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs\") pod \"network-metrics-daemon-xfldj\" (UID: \"bfb80980-0aa2-49ab-b601-b895816adbb7\") " pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:23.202474 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.202400    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-kubelet-config\") pod \"global-pull-secret-syncer-sf96c\" (UID: \"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5\") " pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:23.202474 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.202430    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/93f2797e-1352-4f1b-9a19-ed20fab0de84-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.202474 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:23.202461    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 13:28:23.203045 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:23.202515    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs podName:bfb80980-0aa2-49ab-b601-b895816adbb7 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:23.702492963 +0000 UTC m=+3.077163716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs") pod "network-metrics-daemon-xfldj" (UID: "bfb80980-0aa2-49ab-b601-b895816adbb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 13:28:23.203045 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.202520    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93f2797e-1352-4f1b-9a19-ed20fab0de84-cni-binary-copy\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.203045 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.202575    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93f2797e-1352-4f1b-9a19-ed20fab0de84-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.203045 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.202639    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/aafe4ec3-c2bc-4c0a-b90f-7246208c42dc-konnectivity-ca\") pod \"konnectivity-agent-cfjjj\" (UID: \"aafe4ec3-c2bc-4c0a-b90f-7246208c42dc\") " pod="kube-system/konnectivity-agent-cfjjj"
Jun 09 13:28:23.203045 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.203023    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/93f2797e-1352-4f1b-9a19-ed20fab0de84-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.204648 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.204629    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/aafe4ec3-c2bc-4c0a-b90f-7246208c42dc-agent-certs\") pod \"konnectivity-agent-cfjjj\" (UID: \"aafe4ec3-c2bc-4c0a-b90f-7246208c42dc\") " pod="kube-system/konnectivity-agent-cfjjj"
Jun 09 13:28:23.211106 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:23.211084    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 13:28:23.211106 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:23.211104    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 13:28:23.211279 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:23.211114    2562 projected.go:196] Error preparing data for projected volume kube-api-access-8z99h for pod openshift-network-diagnostics/network-check-target-7gwnl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 13:28:23.211279 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:23.211177    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h podName:6db742ac-0935-4dd7-917b-a954274b44d3 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:23.711160137 +0000 UTC m=+3.085830898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8z99h" (UniqueName: "kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h") pod "network-check-target-7gwnl" (UID: "6db742ac-0935-4dd7-917b-a954274b44d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 13:28:23.212913 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.212890    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trcbp\" (UniqueName: \"kubernetes.io/projected/bfb80980-0aa2-49ab-b601-b895816adbb7-kube-api-access-trcbp\") pod \"network-metrics-daemon-xfldj\" (UID: \"bfb80980-0aa2-49ab-b601-b895816adbb7\") " pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:23.212913 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.212904    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjjdb\" (UniqueName: \"kubernetes.io/projected/93f2797e-1352-4f1b-9a19-ed20fab0de84-kube-api-access-xjjdb\") pod \"multus-additional-cni-plugins-lnm5m\" (UID: \"93f2797e-1352-4f1b-9a19-ed20fab0de84\") " pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.283681 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.283639    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n6rnd"
Jun 09 13:28:23.290054 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.290031    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tghmb"
Jun 09 13:28:23.297667 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.297645    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:23.303523 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.303500    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh"
Jun 09 13:28:23.312233 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.312212    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9bbb6"
Jun 09 13:28:23.319955 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.319939    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zl45c"
Jun 09 13:28:23.325695 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.325679    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jghnm"
Jun 09 13:28:23.332306 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.332288    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lnm5m"
Jun 09 13:28:23.337890 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.337874    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-cfjjj"
Jun 09 13:28:23.706677 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.706642    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs\") pod \"network-metrics-daemon-xfldj\" (UID: \"bfb80980-0aa2-49ab-b601-b895816adbb7\") " pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:23.706891 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.706702    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret\") pod \"global-pull-secret-syncer-sf96c\" (UID: \"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5\") " pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:23.706891 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:23.706821    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 13:28:23.706891 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:23.706834    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 13:28:23.707062 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:23.706897    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs podName:bfb80980-0aa2-49ab-b601-b895816adbb7 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:24.706878642 +0000 UTC m=+4.081549389 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs") pod "network-metrics-daemon-xfldj" (UID: "bfb80980-0aa2-49ab-b601-b895816adbb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 13:28:23.707062 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:23.706913    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret podName:4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:24.706907212 +0000 UTC m=+4.081577954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret") pod "global-pull-secret-syncer-sf96c" (UID: "4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5") : object "kube-system"/"original-pull-secret" not registered
Jun 09 13:28:23.807470 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:23.807442    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z99h\" (UniqueName: \"kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h\") pod \"network-check-target-7gwnl\" (UID: \"6db742ac-0935-4dd7-917b-a954274b44d3\") " pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:23.807631 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:23.807604    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 13:28:23.807631 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:23.807621    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 13:28:23.807631 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:23.807630    2562 projected.go:196] Error preparing data for projected volume kube-api-access-8z99h for pod openshift-network-diagnostics/network-check-target-7gwnl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 13:28:23.807757 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:23.807679    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h podName:6db742ac-0935-4dd7-917b-a954274b44d3 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:24.807666106 +0000 UTC m=+4.182336849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z99h" (UniqueName: "kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h") pod "network-check-target-7gwnl" (UID: "6db742ac-0935-4dd7-917b-a954274b44d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 13:28:23.844437 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:23.844350    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248841a6_cc02_45c5_a3bb_aa9c4252cdc8.slice/crio-f9ad05f7501b974d7da6de33043d4d4303763a34cc3223d6ddd490b2fde05a0a WatchSource:0}: Error finding container f9ad05f7501b974d7da6de33043d4d4303763a34cc3223d6ddd490b2fde05a0a: Status 404 returned error can't find the container with id f9ad05f7501b974d7da6de33043d4d4303763a34cc3223d6ddd490b2fde05a0a
Jun 09 13:28:23.845892 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:23.845780    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63fc7b55_3923_4edb_909b_df55349b7a32.slice/crio-b91b03f0f635549b39f24c1ec8fd083b274a9ff80cd8bd3042beb0658cdad154 WatchSource:0}: Error finding container b91b03f0f635549b39f24c1ec8fd083b274a9ff80cd8bd3042beb0658cdad154: Status 404 returned error can't find the container with id b91b03f0f635549b39f24c1ec8fd083b274a9ff80cd8bd3042beb0658cdad154
Jun 09 13:28:23.848911 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:23.848881    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1627b431_7d8e_4b7b_b5ee_01103ef5179a.slice/crio-a917af12dbbfd7afea6f375ccd2abca1ca944c6222d8fcd855fb858e9b892554 WatchSource:0}: Error finding container a917af12dbbfd7afea6f375ccd2abca1ca944c6222d8fcd855fb858e9b892554: Status 404 returned error can't find the container with id a917af12dbbfd7afea6f375ccd2abca1ca944c6222d8fcd855fb858e9b892554
Jun 09 13:28:23.850063 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:23.850045    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f2797e_1352_4f1b_9a19_ed20fab0de84.slice/crio-aa2ba8dfaf0399ab2a33765d271b611060887705560aa1fc42bf341ecfa14572 WatchSource:0}: Error finding container aa2ba8dfaf0399ab2a33765d271b611060887705560aa1fc42bf341ecfa14572: Status 404 returned error can't find the container with id aa2ba8dfaf0399ab2a33765d271b611060887705560aa1fc42bf341ecfa14572
Jun 09 13:28:23.870865 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:23.870844    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e9007b1_6e07_49ff_b1a5_d40904431d90.slice/crio-35bc9b7cd0e97ce7b13dd3bccc2900b1ab257ef875d943e7eef7e21d60448960 WatchSource:0}: Error finding container 35bc9b7cd0e97ce7b13dd3bccc2900b1ab257ef875d943e7eef7e21d60448960: Status 404 returned error can't find the container with id 35bc9b7cd0e97ce7b13dd3bccc2900b1ab257ef875d943e7eef7e21d60448960
Jun 09 13:28:23.872498 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:23.872475    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a83c7d_349e_4a6c_890b_6491c85d1cf1.slice/crio-f9820f3668c383c55e31716dffa53287c34eee5c78718f2129f2fa38f34a18bb WatchSource:0}: Error finding container f9820f3668c383c55e31716dffa53287c34eee5c78718f2129f2fa38f34a18bb: Status 404 returned error can't find the container with id f9820f3668c383c55e31716dffa53287c34eee5c78718f2129f2fa38f34a18bb
Jun 09 13:28:23.873174 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:23.873153    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaafe4ec3_c2bc_4c0a_b90f_7246208c42dc.slice/crio-c25020e65855fb7768574316abb34035b17360e259a7e8159fecbfa3bf04a375 WatchSource:0}: Error finding container c25020e65855fb7768574316abb34035b17360e259a7e8159fecbfa3bf04a375: Status 404 returned error can't find the container with id c25020e65855fb7768574316abb34035b17360e259a7e8159fecbfa3bf04a375
Jun 09 13:28:23.874648 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:23.874602    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28d2f2d_2286_44be_99ba_641e1649ac47.slice/crio-d95b7ec73a6690124ec28be9ee4d3bcffa975bfe92390a6e543bb00564ecbf9d WatchSource:0}: Error finding container d95b7ec73a6690124ec28be9ee4d3bcffa975bfe92390a6e543bb00564ecbf9d: Status 404 returned error can't find the container with id d95b7ec73a6690124ec28be9ee4d3bcffa975bfe92390a6e543bb00564ecbf9d
Jun 09 13:28:23.875248 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:23.875227    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ed8bc4_1037_41b7_ac71_9b6aae568b79.slice/crio-57dcced675df0e6a77ade791c00831b62090174cb4eec85e9828e94d9ddf40ef WatchSource:0}: Error finding container 57dcced675df0e6a77ade791c00831b62090174cb4eec85e9828e94d9ddf40ef: Status 404 returned error can't find the container with id 57dcced675df0e6a77ade791c00831b62090174cb4eec85e9828e94d9ddf40ef
Jun 09 13:28:24.030060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:24.029810    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 13:23:23 +0000 UTC" deadline="2028-03-01 22:32:05.504496518 +0000 UTC"
Jun 09 13:28:24.030060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:24.030059    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15153h3m41.474443943s"
Jun 09 13:28:24.059517 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:24.059487    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal" event={"ID":"aea07464dfd29937372692ed2802aec2","Type":"ContainerStarted","Data":"fa56c508c16160a027f87a3fadb52fcb8502a1e16d90adb8c723c1c46d503ff7"}
Jun 09 13:28:24.061156 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:24.061122    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh" event={"ID":"e28d2f2d-2286-44be-99ba-641e1649ac47","Type":"ContainerStarted","Data":"d95b7ec73a6690124ec28be9ee4d3bcffa975bfe92390a6e543bb00564ecbf9d"}
Jun 09 13:28:24.062637 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:24.062614    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cfjjj" event={"ID":"aafe4ec3-c2bc-4c0a-b90f-7246208c42dc","Type":"ContainerStarted","Data":"c25020e65855fb7768574316abb34035b17360e259a7e8159fecbfa3bf04a375"}
Jun 09 13:28:24.065921 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:24.065895    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lnm5m" event={"ID":"93f2797e-1352-4f1b-9a19-ed20fab0de84","Type":"ContainerStarted","Data":"aa2ba8dfaf0399ab2a33765d271b611060887705560aa1fc42bf341ecfa14572"}
Jun 09 13:28:24.067023 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:24.066965    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tghmb" event={"ID":"1627b431-7d8e-4b7b-b5ee-01103ef5179a","Type":"ContainerStarted","Data":"a917af12dbbfd7afea6f375ccd2abca1ca944c6222d8fcd855fb858e9b892554"}
Jun 09 13:28:24.067947 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:24.067929    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n6rnd" event={"ID":"248841a6-cc02-45c5-a3bb-aa9c4252cdc8","Type":"ContainerStarted","Data":"f9ad05f7501b974d7da6de33043d4d4303763a34cc3223d6ddd490b2fde05a0a"}
Jun 09 13:28:24.068836 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:24.068816    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9bbb6" event={"ID":"c9ed8bc4-1037-41b7-ac71-9b6aae568b79","Type":"ContainerStarted","Data":"57dcced675df0e6a77ade791c00831b62090174cb4eec85e9828e94d9ddf40ef"}
Jun 09 13:28:24.069969 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:24.069946    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zl45c" event={"ID":"0e9007b1-6e07-49ff-b1a5-d40904431d90","Type":"ContainerStarted","Data":"35bc9b7cd0e97ce7b13dd3bccc2900b1ab257ef875d943e7eef7e21d60448960"}
Jun 09 13:28:24.071293 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:24.071274    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jghnm" event={"ID":"e9a83c7d-349e-4a6c-890b-6491c85d1cf1","Type":"ContainerStarted","Data":"f9820f3668c383c55e31716dffa53287c34eee5c78718f2129f2fa38f34a18bb"}
Jun 09 13:28:24.072352 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:24.072333    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq" event={"ID":"63fc7b55-3923-4edb-909b-df55349b7a32","Type":"ContainerStarted","Data":"b91b03f0f635549b39f24c1ec8fd083b274a9ff80cd8bd3042beb0658cdad154"}
Jun 09 13:28:24.073130 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:24.073090    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-81.ec2.internal" podStartSLOduration=2.07249534 podStartE2EDuration="2.07249534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:24.072351896 +0000 UTC m=+3.447022656" watchObservedRunningTime="2026-06-09 13:28:24.07249534 +0000 UTC m=+3.447166100"
Jun 09 13:28:24.714652 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:24.714610    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs\") pod \"network-metrics-daemon-xfldj\" (UID: \"bfb80980-0aa2-49ab-b601-b895816adbb7\") " pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:24.714861 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:24.714674    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret\") pod \"global-pull-secret-syncer-sf96c\" (UID: \"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5\") " pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:24.714861 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:24.714830    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 13:28:24.714974 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:24.714894    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret podName:4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:26.71487606 +0000 UTC m=+6.089546813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret") pod "global-pull-secret-syncer-sf96c" (UID: "4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5") : object "kube-system"/"original-pull-secret" not registered
Jun 09 13:28:24.715324 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:24.715302    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 13:28:24.715403 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:24.715361    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs podName:bfb80980-0aa2-49ab-b601-b895816adbb7 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:26.715346175 +0000 UTC m=+6.090016925 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs") pod "network-metrics-daemon-xfldj" (UID: "bfb80980-0aa2-49ab-b601-b895816adbb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 13:28:24.815816 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:24.815771    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z99h\" (UniqueName: \"kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h\") pod \"network-check-target-7gwnl\" (UID: \"6db742ac-0935-4dd7-917b-a954274b44d3\") " pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:24.816007 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:24.815988    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 13:28:24.816007 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:24.816007    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 13:28:24.816115 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:24.816021    2562 projected.go:196] Error preparing data for projected volume kube-api-access-8z99h for pod openshift-network-diagnostics/network-check-target-7gwnl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 13:28:24.816115 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:24.816081    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h podName:6db742ac-0935-4dd7-917b-a954274b44d3 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:26.816061611 +0000 UTC m=+6.190732356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z99h" (UniqueName: "kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h") pod "network-check-target-7gwnl" (UID: "6db742ac-0935-4dd7-917b-a954274b44d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 13:28:25.030446 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:25.030333    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 13:23:23 +0000 UTC" deadline="2028-03-08 05:38:10.732396162 +0000 UTC"
Jun 09 13:28:25.030446 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:25.030396    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15304h9m45.702004925s"
Jun 09 13:28:25.051260 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:25.051231    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:25.051413 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:25.051367    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:25.051788 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:25.051764    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:25.051888 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:25.051864    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:25.051952 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:25.051925    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:25.052000 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:25.051988    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:25.087771 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:25.087401    2562 generic.go:356] "Generic (PLEG): container finished" podID="9354c623a5ab07e4ac4b5d10f8f810ac" containerID="ab71a1386c434854675ba4bace12aa455e2d803cc77ad6e5757925007660c599" exitCode=0
Jun 09 13:28:25.088355 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:25.088327    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal" event={"ID":"9354c623a5ab07e4ac4b5d10f8f810ac","Type":"ContainerDied","Data":"ab71a1386c434854675ba4bace12aa455e2d803cc77ad6e5757925007660c599"}
Jun 09 13:28:26.097676 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:26.097637    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal" event={"ID":"9354c623a5ab07e4ac4b5d10f8f810ac","Type":"ContainerStarted","Data":"c40450e994dd82b409b4e4f0c98ac589f65355a8a06f901e6304eff48946d183"}
Jun 09 13:28:26.114761 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:26.114689    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-81.ec2.internal" podStartSLOduration=4.114668345 podStartE2EDuration="4.114668345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:26.11391676 +0000 UTC m=+5.488587522" watchObservedRunningTime="2026-06-09 13:28:26.114668345 +0000 UTC m=+5.489339109"
Jun 09 13:28:26.730058 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:26.730017    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret\") pod \"global-pull-secret-syncer-sf96c\" (UID: \"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5\") " pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:26.730245 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:26.730113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs\") pod \"network-metrics-daemon-xfldj\" (UID: \"bfb80980-0aa2-49ab-b601-b895816adbb7\") " pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:26.730245 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:26.730234    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 13:28:26.730358 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:26.730296    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs podName:bfb80980-0aa2-49ab-b601-b895816adbb7 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:30.73027667 +0000 UTC m=+10.104947425 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs") pod "network-metrics-daemon-xfldj" (UID: "bfb80980-0aa2-49ab-b601-b895816adbb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 13:28:26.730749 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:26.730709    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 13:28:26.730841 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:26.730780    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret podName:4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:30.730765329 +0000 UTC m=+10.105436073 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret") pod "global-pull-secret-syncer-sf96c" (UID: "4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5") : object "kube-system"/"original-pull-secret" not registered
Jun 09 13:28:26.831186 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:26.831121    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z99h\" (UniqueName: \"kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h\") pod \"network-check-target-7gwnl\" (UID: \"6db742ac-0935-4dd7-917b-a954274b44d3\") " pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:26.831349 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:26.831276    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 13:28:26.831349 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:26.831297    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 13:28:26.831349 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:26.831311    2562 projected.go:196] Error preparing data for projected volume kube-api-access-8z99h for pod openshift-network-diagnostics/network-check-target-7gwnl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 13:28:26.831521 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:26.831368    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h podName:6db742ac-0935-4dd7-917b-a954274b44d3 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:30.831349428 +0000 UTC m=+10.206020170 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z99h" (UniqueName: "kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h") pod "network-check-target-7gwnl" (UID: "6db742ac-0935-4dd7-917b-a954274b44d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 13:28:27.051080 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:27.051013    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:27.051236 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:27.051117    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:27.051399 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:27.051381    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:27.051508 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:27.051472    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:27.051563 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:27.051519    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:27.051610 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:27.051587    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:29.050844 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:29.050814    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:29.051216 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:29.050920    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:29.051295 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:29.051276    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:29.051383 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:29.051366    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:29.051836 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:29.051804    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:29.051909 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:29.051876    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:30.769333 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:30.769296    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret\") pod \"global-pull-secret-syncer-sf96c\" (UID: \"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5\") " pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:30.769922 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:30.769373    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs\") pod \"network-metrics-daemon-xfldj\" (UID: \"bfb80980-0aa2-49ab-b601-b895816adbb7\") " pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:30.769922 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:30.769553    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 13:28:30.769922 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:30.769609    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs podName:bfb80980-0aa2-49ab-b601-b895816adbb7 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:38.769593723 +0000 UTC m=+18.144264462 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs") pod "network-metrics-daemon-xfldj" (UID: "bfb80980-0aa2-49ab-b601-b895816adbb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 13:28:30.770082 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:30.770057    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 13:28:30.770136 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:30.770103    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret podName:4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:38.770092751 +0000 UTC m=+18.144763490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret") pod "global-pull-secret-syncer-sf96c" (UID: "4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5") : object "kube-system"/"original-pull-secret" not registered
Jun 09 13:28:30.869770 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:30.869717    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z99h\" (UniqueName: \"kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h\") pod \"network-check-target-7gwnl\" (UID: \"6db742ac-0935-4dd7-917b-a954274b44d3\") " pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:30.869964 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:30.869912    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 13:28:30.869964 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:30.869937    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 13:28:30.869964 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:30.869951    2562 projected.go:196] Error preparing data for projected volume kube-api-access-8z99h for pod openshift-network-diagnostics/network-check-target-7gwnl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 13:28:30.870166 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:30.870015    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h podName:6db742ac-0935-4dd7-917b-a954274b44d3 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:38.869995554 +0000 UTC m=+18.244666308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z99h" (UniqueName: "kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h") pod "network-check-target-7gwnl" (UID: "6db742ac-0935-4dd7-917b-a954274b44d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 13:28:31.050962 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:31.050888    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:31.051118 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:31.051019    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:31.051118 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:31.051083    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:31.051223 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:31.051186    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:31.051256 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:31.051216    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:31.051256 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:31.051238    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:33.049820 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:33.049313    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:33.049820 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:33.049362    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:33.049820 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:33.049313    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:33.049820 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:33.049460    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:33.049820 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:33.049521    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:33.049820 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:33.049619    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:35.050005 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:35.049498    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:35.050005 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:35.049506    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:35.050005 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:35.049641    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:35.050005 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:35.049633    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:35.050005 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:35.049762    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:35.050005 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:35.049854    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:37.049455 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:37.049397    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:37.049455 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:37.049405    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:37.049928 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:37.049470    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:37.049928 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:37.049570    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:37.049928 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:37.049639    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:37.049928 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:37.049719    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:38.827664 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:38.827626    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret\") pod \"global-pull-secret-syncer-sf96c\" (UID: \"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5\") " pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:38.828142 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:38.827725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs\") pod \"network-metrics-daemon-xfldj\" (UID: \"bfb80980-0aa2-49ab-b601-b895816adbb7\") " pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:38.828142 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:38.827815    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 13:28:38.828142 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:38.827830    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 13:28:38.828142 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:38.827893    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs podName:bfb80980-0aa2-49ab-b601-b895816adbb7 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:54.82787189 +0000 UTC m=+34.202542630 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs") pod "network-metrics-daemon-xfldj" (UID: "bfb80980-0aa2-49ab-b601-b895816adbb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 13:28:38.828142 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:38.827910    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret podName:4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:54.827903442 +0000 UTC m=+34.202574181 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret") pod "global-pull-secret-syncer-sf96c" (UID: "4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5") : object "kube-system"/"original-pull-secret" not registered
Jun 09 13:28:38.928212 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:38.928171    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z99h\" (UniqueName: \"kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h\") pod \"network-check-target-7gwnl\" (UID: \"6db742ac-0935-4dd7-917b-a954274b44d3\") " pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:38.928375 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:38.928352    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 13:28:38.928422 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:38.928381    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 13:28:38.928422 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:38.928393    2562 projected.go:196] Error preparing data for projected volume kube-api-access-8z99h for pod openshift-network-diagnostics/network-check-target-7gwnl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 13:28:38.928498 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:38.928455    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h podName:6db742ac-0935-4dd7-917b-a954274b44d3 nodeName:}" failed. No retries permitted until 2026-06-09 13:28:54.928441255 +0000 UTC m=+34.303111993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z99h" (UniqueName: "kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h") pod "network-check-target-7gwnl" (UID: "6db742ac-0935-4dd7-917b-a954274b44d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 13:28:39.049030 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:39.048993    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:39.049030 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:39.049027    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:39.049283 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:39.049057    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:39.049283 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:39.049175    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:39.049283 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:39.049229    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:39.049402 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:39.049303    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:41.050286 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:41.050255    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:41.050776 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:41.050372    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:41.050776 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:41.050395    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:41.050776 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:41.050435    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:41.050776 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:41.050458    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:41.050776 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:41.050576    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:43.060006 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:43.058912    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:43.060006 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:43.059258    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:43.060006 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:43.058979    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:43.060006 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:43.059401    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:43.060006 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:43.058912    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:43.060006 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:43.059515    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:43.147357 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:43.146988    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-cfjjj" event={"ID":"aafe4ec3-c2bc-4c0a-b90f-7246208c42dc","Type":"ContainerStarted","Data":"285fb67b6678a7e36cfd7de343a525d94df1d24d8828534ba22b7813396cebc1"}
Jun 09 13:28:43.150745 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:43.150086    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tghmb" event={"ID":"1627b431-7d8e-4b7b-b5ee-01103ef5179a","Type":"ContainerStarted","Data":"a8d7dd23439cdf168bbeae2aba5310a1e7291219b52182dde1736326f38c04e3"}
Jun 09 13:28:43.162455 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:43.162368    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-cfjjj" podStartSLOduration=3.135355707 podStartE2EDuration="22.162345946s" totalImagesPullingTime="19.026990239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:43.161585329 +0000 UTC m=+22.536256103" watchObservedRunningTime="2026-06-09 13:28:43.162345946 +0000 UTC m=+22.537016712"
Jun 09 13:28:43.178758 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:43.178290    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tghmb" podStartSLOduration=3.145553318 podStartE2EDuration="22.178274795s" totalImagesPullingTime="19.032721477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:43.17755155 +0000 UTC m=+22.552222312" watchObservedRunningTime="2026-06-09 13:28:43.178274795 +0000 UTC m=+22.552945556"
Jun 09 13:28:44.153652 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:44.153395    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n6rnd" event={"ID":"248841a6-cc02-45c5-a3bb-aa9c4252cdc8","Type":"ContainerStarted","Data":"3e48517ca1cc63486dffd268459583d8e908e53d8315ff67650021898d5372d6"}
Jun 09 13:28:44.154789 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:44.154769    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9bbb6" event={"ID":"c9ed8bc4-1037-41b7-ac71-9b6aae568b79","Type":"ContainerStarted","Data":"1c3603dbf8063c4ad8e9b2e89011bea067a68ba44cf7397a479162398c72ce3b"}
Jun 09 13:28:44.156086 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:44.156040    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zl45c" event={"ID":"0e9007b1-6e07-49ff-b1a5-d40904431d90","Type":"ContainerStarted","Data":"f25bd3cadd25e1fea5a475cee7857a54628f7302aa31e250b8807a4302d52843"}
Jun 09 13:28:44.158960 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:44.158942    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq" event={"ID":"63fc7b55-3923-4edb-909b-df55349b7a32","Type":"ContainerStarted","Data":"091197fdec348badcb285b2eeea763c21a38996230fafe2d438b69c483d1bab2"}
Jun 09 13:28:44.159062 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:44.158991    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq" event={"ID":"63fc7b55-3923-4edb-909b-df55349b7a32","Type":"ContainerStarted","Data":"be9b99329e4fbdba8563dd442f8235a470147049205e8e1d1584cd319d7b70a7"}
Jun 09 13:28:44.159062 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:44.159029    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq" event={"ID":"63fc7b55-3923-4edb-909b-df55349b7a32","Type":"ContainerStarted","Data":"1253dce14c97c46ededcd84990f634b704401b0704a6cf3b1c5119afe6b0a452"}
Jun 09 13:28:44.159062 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:44.159060    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq" event={"ID":"63fc7b55-3923-4edb-909b-df55349b7a32","Type":"ContainerStarted","Data":"0bd94a64636a58098156846c7721ef157f29d64be13dae836f34581a9abac5ac"}
Jun 09 13:28:44.159182 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:44.159092    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq" event={"ID":"63fc7b55-3923-4edb-909b-df55349b7a32","Type":"ContainerStarted","Data":"8e3272aa8d4360e0da167f22a18155d4e38f36fd0bc3d0c0b3849949f99374f2"}
Jun 09 13:28:44.159182 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:44.159123    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq" event={"ID":"63fc7b55-3923-4edb-909b-df55349b7a32","Type":"ContainerStarted","Data":"9b20231d96489772d90e6c390aa29c42ee222bc4c26cd85dec4d826623484fb8"}
Jun 09 13:28:44.160301 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:44.160283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh" event={"ID":"e28d2f2d-2286-44be-99ba-641e1649ac47","Type":"ContainerStarted","Data":"5bafa9c454a428754404b3f83f5cd3997b6bc73fdae1d2be4c7f00c844d141ee"}
Jun 09 13:28:44.161662 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:44.161638    2562 generic.go:356] "Generic (PLEG): container finished" podID="93f2797e-1352-4f1b-9a19-ed20fab0de84" containerID="a893621faa876355ee8f15afaf9219b36e4bf17e90e1b8650b6f35f67f1e6e03" exitCode=0
Jun 09 13:28:44.161766 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:44.161711    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lnm5m" event={"ID":"93f2797e-1352-4f1b-9a19-ed20fab0de84","Type":"ContainerDied","Data":"a893621faa876355ee8f15afaf9219b36e4bf17e90e1b8650b6f35f67f1e6e03"}
Jun 09 13:28:44.171983 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:44.170163    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-n6rnd" podStartSLOduration=4.055957226 podStartE2EDuration="23.170147522s" totalImagesPullingTime="19.114190296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:44.169703162 +0000 UTC m=+23.544373924" watchObservedRunningTime="2026-06-09 13:28:44.170147522 +0000 UTC m=+23.544818284"
Jun 09 13:28:44.184221 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:44.184182    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9bbb6" podStartSLOduration=4.160609295 podStartE2EDuration="23.18417085s" totalImagesPullingTime="19.023561555s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:44.183625678 +0000 UTC m=+23.558296439" watchObservedRunningTime="2026-06-09 13:28:44.18417085 +0000 UTC m=+23.558841611"
Jun 09 13:28:44.201138 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:44.201096    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zl45c" podStartSLOduration=4.129054939 podStartE2EDuration="23.201079337s" totalImagesPullingTime="19.072024398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:44.200952521 +0000 UTC m=+23.575623281" watchObservedRunningTime="2026-06-09 13:28:44.201079337 +0000 UTC m=+23.575750098"
Jun 09 13:28:44.562057 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:44.562036    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 09 13:28:45.049917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:45.049882    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:45.050100 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:45.049892    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:45.050100 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:45.050007    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:45.050100 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:45.049892    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:45.050228 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:45.050090    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:45.050228 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:45.050190    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:45.061139 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:45.061035    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T13:28:44.562052363Z","UUID":"ed0fd20b-8d53-45a0-8dec-262c1b76afe1","Handler":null,"Name":"","Endpoint":""}
Jun 09 13:28:45.062937 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:45.062914    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 09 13:28:45.063050 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:45.062953    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 09 13:28:45.167061 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:45.166692    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jghnm" event={"ID":"e9a83c7d-349e-4a6c-890b-6491c85d1cf1","Type":"ContainerStarted","Data":"6878ca4948b6204c86e033a0745ff985feb2919b700453edb19eccf0cffd3439"}
Jun 09 13:28:45.169329 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:45.169300    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh" event={"ID":"e28d2f2d-2286-44be-99ba-641e1649ac47","Type":"ContainerStarted","Data":"80ec341be8068d407f7129acbb2efbac4af497059f5c9c1df6d264f92bab3d22"}
Jun 09 13:28:45.181873 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:45.181817    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jghnm" podStartSLOduration=5.110512874 podStartE2EDuration="24.181798817s" totalImagesPullingTime="19.071285943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:45.18114473 +0000 UTC m=+24.555815492" watchObservedRunningTime="2026-06-09 13:28:45.181798817 +0000 UTC m=+24.556469579"
Jun 09 13:28:46.177995 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:46.177955    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq" event={"ID":"63fc7b55-3923-4edb-909b-df55349b7a32","Type":"ContainerStarted","Data":"7d419292a605472af72afde687e51a9b2df3e9bf8bfa5f44f038c24dc334febe"}
Jun 09 13:28:46.180306 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:46.180279    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh" event={"ID":"e28d2f2d-2286-44be-99ba-641e1649ac47","Type":"ContainerStarted","Data":"e48bf194660a801742e988a630de9a491aa1f93e74b583d54438a4c187086264"}
Jun 09 13:28:46.198321 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:46.198270    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6s6qh" podStartSLOduration=3.891685823 podStartE2EDuration="25.19825238s" totalImagesPullingTime="21.306566557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:46.197628079 +0000 UTC m=+25.572298832" watchObservedRunningTime="2026-06-09 13:28:46.19825238 +0000 UTC m=+25.572923143"
Jun 09 13:28:46.231191 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:46.230936    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-cfjjj"
Jun 09 13:28:46.231545 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:46.231523    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-cfjjj"
Jun 09 13:28:47.049414 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:47.049210    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:47.049609 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:47.049210    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:47.049609 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:47.049521    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:47.049609 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:47.049568    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:47.049609 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:47.049216    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:47.049823 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:47.049649    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:47.182394 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:47.182362    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-cfjjj"
Jun 09 13:28:47.182879 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:47.182857    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-cfjjj"
Jun 09 13:28:47.271039 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:47.271000    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:28:47.349295 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:47.349160    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:28:49.049744 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:49.049574    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:49.050538 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:49.049574    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:49.050538 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:49.049869    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:49.050538 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:49.049587    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:49.050538 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:49.049915    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:49.050538 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:49.050005    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:49.189968 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:49.189923    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq" event={"ID":"63fc7b55-3923-4edb-909b-df55349b7a32","Type":"ContainerStarted","Data":"199e176f96311321c98ecdbac36d5478b6385b9a7d00ecdb4d9589ea6f2eb368"}
Jun 09 13:28:49.190200 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:49.190181    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:49.190395 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:49.190319    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:49.190395 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:49.190377    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:49.191838 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:49.191811    2562 generic.go:356] "Generic (PLEG): container finished" podID="93f2797e-1352-4f1b-9a19-ed20fab0de84" containerID="a024cbaa4ef2f7e009855fe392e84a887f55b28f500ff8a23e6bf61277202f23" exitCode=0
Jun 09 13:28:49.192000 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:49.191960    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lnm5m" event={"ID":"93f2797e-1352-4f1b-9a19-ed20fab0de84","Type":"ContainerDied","Data":"a024cbaa4ef2f7e009855fe392e84a887f55b28f500ff8a23e6bf61277202f23"}
Jun 09 13:28:49.206284 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:49.206261    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:49.206391 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:49.206354    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:28:49.213866 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:49.213828    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq" podStartSLOduration=9.066729239 podStartE2EDuration="28.213815871s" totalImagesPullingTime="19.147086632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:28:49.21217738 +0000 UTC m=+28.586848140" watchObservedRunningTime="2026-06-09 13:28:49.213815871 +0000 UTC m=+28.588486632"
Jun 09 13:28:50.540384 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:50.540350    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7gwnl"]
Jun 09 13:28:50.541018 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:50.540510    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:50.541018 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:50.540621    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:50.543805 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:50.543782    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sf96c"]
Jun 09 13:28:50.543932 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:50.543890    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:50.544004 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:50.543987    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:50.544385 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:50.544360    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xfldj"]
Jun 09 13:28:50.544467 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:50.544460    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:50.544566 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:50.544550    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:51.198871 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:51.198834    2562 generic.go:356] "Generic (PLEG): container finished" podID="93f2797e-1352-4f1b-9a19-ed20fab0de84" containerID="2bc4c30ac1f669441a91e04871324d57fb61483ad6e47e7b6b05ade222c28d77" exitCode=0
Jun 09 13:28:51.199072 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:51.198927    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lnm5m" event={"ID":"93f2797e-1352-4f1b-9a19-ed20fab0de84","Type":"ContainerDied","Data":"2bc4c30ac1f669441a91e04871324d57fb61483ad6e47e7b6b05ade222c28d77"}
Jun 09 13:28:52.049661 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:52.049467    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:52.050052 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:52.049525    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:52.050052 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:52.049766    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:52.050052 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:52.049817    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:52.050052 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:52.049527    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:52.050052 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:52.049909    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:52.592243 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:52.592177    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:28:52.643172 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:52.643132    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:28:52.819334 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:52.819301    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:28:52.920114 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:52.920021    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:28:53.205401 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:53.205364    2562 generic.go:356] "Generic (PLEG): container finished" podID="93f2797e-1352-4f1b-9a19-ed20fab0de84" containerID="8db2e729e5842d8d883840027ed31d76f8c482fd278bc7d24d7aeb75787db19b" exitCode=0
Jun 09 13:28:53.205932 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:53.205446    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lnm5m" event={"ID":"93f2797e-1352-4f1b-9a19-ed20fab0de84","Type":"ContainerDied","Data":"8db2e729e5842d8d883840027ed31d76f8c482fd278bc7d24d7aeb75787db19b"}
Jun 09 13:28:54.049166 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:54.049131    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:54.049348 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:54.049246    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:54.049348 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:54.049275    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:54.049348 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:54.049272    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:54.049348 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:54.049341    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:54.049560 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:54.049403    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:54.853030 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:54.852949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs\") pod \"network-metrics-daemon-xfldj\" (UID: \"bfb80980-0aa2-49ab-b601-b895816adbb7\") " pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:54.853030 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:54.852996    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret\") pod \"global-pull-secret-syncer-sf96c\" (UID: \"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5\") " pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:54.853749 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:54.853107    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 09 13:28:54.853749 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:54.853108    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 13:28:54.853749 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:54.853165    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret podName:4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5 nodeName:}" failed. No retries permitted until 2026-06-09 13:29:26.853149373 +0000 UTC m=+66.227820114 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret") pod "global-pull-secret-syncer-sf96c" (UID: "4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5") : object "kube-system"/"original-pull-secret" not registered
Jun 09 13:28:54.853749 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:54.853195    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs podName:bfb80980-0aa2-49ab-b601-b895816adbb7 nodeName:}" failed. No retries permitted until 2026-06-09 13:29:26.853177111 +0000 UTC m=+66.227847854 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs") pod "network-metrics-daemon-xfldj" (UID: "bfb80980-0aa2-49ab-b601-b895816adbb7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 09 13:28:54.954028 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:54.953994    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z99h\" (UniqueName: \"kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h\") pod \"network-check-target-7gwnl\" (UID: \"6db742ac-0935-4dd7-917b-a954274b44d3\") " pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:54.954218 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:54.954177    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 09 13:28:54.954218 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:54.954203    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 09 13:28:54.954218 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:54.954214    2562 projected.go:196] Error preparing data for projected volume kube-api-access-8z99h for pod openshift-network-diagnostics/network-check-target-7gwnl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 13:28:54.954363 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:54.954281    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h podName:6db742ac-0935-4dd7-917b-a954274b44d3 nodeName:}" failed. No retries permitted until 2026-06-09 13:29:26.95426188 +0000 UTC m=+66.328932619 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8z99h" (UniqueName: "kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h") pod "network-check-target-7gwnl" (UID: "6db742ac-0935-4dd7-917b-a954274b44d3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 09 13:28:56.040954 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:56.040912    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:28:56.049469 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:56.049444    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:56.049613 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:56.049481    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:56.049613 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:56.049563    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sf96c" podUID="4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5"
Jun 09 13:28:56.049613 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:56.049444    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:56.049794 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:56.049651    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7gwnl" podUID="6db742ac-0935-4dd7-917b-a954274b44d3"
Jun 09 13:28:56.049794 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:56.049758    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:28:56.965171 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:56.965144    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-81.ec2.internal" event="NodeReady"
Jun 09 13:28:56.965324 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:56.965290    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 09 13:28:57.007778 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.007726    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mxqtr"]
Jun 09 13:28:57.021413 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.021105    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rjnj2"]
Jun 09 13:28:57.021413 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.021258    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:28:57.023664 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.023639    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 09 13:28:57.023895 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.023871    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zls7s\""
Jun 09 13:28:57.023989 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.023918    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 09 13:28:57.042222 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.042201    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mxqtr"]
Jun 09 13:28:57.042222 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.042240    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rjnj2"]
Jun 09 13:28:57.042604 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.042319    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rjnj2"
Jun 09 13:28:57.044693 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.044670    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 09 13:28:57.044820 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.044692    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 09 13:28:57.044820 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.044704    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 09 13:28:57.044820 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.044670    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zk45d\""
Jun 09 13:28:57.169774 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.169722    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:28:57.169955 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.169815    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f2243267-ba22-40c2-b0d8-57c36d93f33c-config-volume\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:28:57.169955 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.169874    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73f59fdc-d918-48d3-bf11-81f7344ba09b-cert\") pod \"ingress-canary-rjnj2\" (UID: \"73f59fdc-d918-48d3-bf11-81f7344ba09b\") " pod="openshift-ingress-canary/ingress-canary-rjnj2"
Jun 09 13:28:57.169955 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.169893    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2243267-ba22-40c2-b0d8-57c36d93f33c-tmp-dir\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:28:57.169955 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.169916    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7klkb\" (UniqueName: \"kubernetes.io/projected/f2243267-ba22-40c2-b0d8-57c36d93f33c-kube-api-access-7klkb\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:28:57.170332 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.169972    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmt9r\" (UniqueName: \"kubernetes.io/projected/73f59fdc-d918-48d3-bf11-81f7344ba09b-kube-api-access-bmt9r\") pod \"ingress-canary-rjnj2\" (UID: \"73f59fdc-d918-48d3-bf11-81f7344ba09b\") " pod="openshift-ingress-canary/ingress-canary-rjnj2"
Jun 09 13:28:57.270898 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.270820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:28:57.270898 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.270882    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f2243267-ba22-40c2-b0d8-57c36d93f33c-config-volume\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:28:57.271107 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.270946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73f59fdc-d918-48d3-bf11-81f7344ba09b-cert\") pod \"ingress-canary-rjnj2\" (UID: \"73f59fdc-d918-48d3-bf11-81f7344ba09b\") " pod="openshift-ingress-canary/ingress-canary-rjnj2"
Jun 09 13:28:57.271107 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.270967    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2243267-ba22-40c2-b0d8-57c36d93f33c-tmp-dir\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:28:57.271107 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:57.270984    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 13:28:57.271107 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.270990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7klkb\" (UniqueName: \"kubernetes.io/projected/f2243267-ba22-40c2-b0d8-57c36d93f33c-kube-api-access-7klkb\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:28:57.271107 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:57.271056    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls podName:f2243267-ba22-40c2-b0d8-57c36d93f33c nodeName:}" failed. No retries permitted until 2026-06-09 13:28:57.771034777 +0000 UTC m=+37.145705516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls") pod "dns-default-mxqtr" (UID: "f2243267-ba22-40c2-b0d8-57c36d93f33c") : secret "dns-default-metrics-tls" not found
Jun 09 13:28:57.271336 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.271135    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmt9r\" (UniqueName: \"kubernetes.io/projected/73f59fdc-d918-48d3-bf11-81f7344ba09b-kube-api-access-bmt9r\") pod \"ingress-canary-rjnj2\" (UID: \"73f59fdc-d918-48d3-bf11-81f7344ba09b\") " pod="openshift-ingress-canary/ingress-canary-rjnj2"
Jun 09 13:28:57.271336 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.271258    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f2243267-ba22-40c2-b0d8-57c36d93f33c-tmp-dir\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:28:57.271427 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.271379    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f2243267-ba22-40c2-b0d8-57c36d93f33c-config-volume\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:28:57.275343 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.275324    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/73f59fdc-d918-48d3-bf11-81f7344ba09b-cert\") pod \"ingress-canary-rjnj2\" (UID: \"73f59fdc-d918-48d3-bf11-81f7344ba09b\") " pod="openshift-ingress-canary/ingress-canary-rjnj2"
Jun 09 13:28:57.280425 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.280394    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7klkb\" (UniqueName: \"kubernetes.io/projected/f2243267-ba22-40c2-b0d8-57c36d93f33c-kube-api-access-7klkb\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:28:57.280556 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.280536    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmt9r\" (UniqueName: \"kubernetes.io/projected/73f59fdc-d918-48d3-bf11-81f7344ba09b-kube-api-access-bmt9r\") pod \"ingress-canary-rjnj2\" (UID: \"73f59fdc-d918-48d3-bf11-81f7344ba09b\") " pod="openshift-ingress-canary/ingress-canary-rjnj2"
Jun 09 13:28:57.351581 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.351545    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rjnj2"
Jun 09 13:28:57.504453 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.504425    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rjnj2"]
Jun 09 13:28:57.572486 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:28:57.572407    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73f59fdc_d918_48d3_bf11_81f7344ba09b.slice/crio-360c587320c3ece30fa7800b07b599d914740b130343bda72daefdc804a159a2 WatchSource:0}: Error finding container 360c587320c3ece30fa7800b07b599d914740b130343bda72daefdc804a159a2: Status 404 returned error can't find the container with id 360c587320c3ece30fa7800b07b599d914740b130343bda72daefdc804a159a2
Jun 09 13:28:57.775027 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:57.774989    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:28:57.775215 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:57.775108    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 13:28:57.775215 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:57.775158    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls podName:f2243267-ba22-40c2-b0d8-57c36d93f33c nodeName:}" failed. No retries permitted until 2026-06-09 13:28:58.775144801 +0000 UTC m=+38.149815540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls") pod "dns-default-mxqtr" (UID: "f2243267-ba22-40c2-b0d8-57c36d93f33c") : secret "dns-default-metrics-tls" not found
Jun 09 13:28:58.049111 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:58.049074    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:28:58.049595 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:58.049081    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:28:58.049595 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:58.049206    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:28:58.051759 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:58.051723    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vwqsn\""
Jun 09 13:28:58.051830 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:58.051774    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 09 13:28:58.052531 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:58.052506    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 09 13:28:58.052531 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:58.052528    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 09 13:28:58.052690 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:58.052529    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mb9fc\""
Jun 09 13:28:58.052690 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:58.052591    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 09 13:28:58.221364 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:58.221261    2562 generic.go:356] "Generic (PLEG): container finished" podID="93f2797e-1352-4f1b-9a19-ed20fab0de84" containerID="bca4e52f969ea806ab55fd411d25fa63c84924040ccfdee872d053b23d1285ad" exitCode=0
Jun 09 13:28:58.221364 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:58.221343    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lnm5m" event={"ID":"93f2797e-1352-4f1b-9a19-ed20fab0de84","Type":"ContainerDied","Data":"bca4e52f969ea806ab55fd411d25fa63c84924040ccfdee872d053b23d1285ad"}
Jun 09 13:28:58.223151 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:58.223130    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rjnj2" event={"ID":"73f59fdc-d918-48d3-bf11-81f7344ba09b","Type":"ContainerStarted","Data":"360c587320c3ece30fa7800b07b599d914740b130343bda72daefdc804a159a2"}
Jun 09 13:28:58.783214 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:58.783184    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:28:58.783915 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:58.783662    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 13:28:58.783915 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:28:58.783769    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls podName:f2243267-ba22-40c2-b0d8-57c36d93f33c nodeName:}" failed. No retries permitted until 2026-06-09 13:29:00.783722022 +0000 UTC m=+40.158392761 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls") pod "dns-default-mxqtr" (UID: "f2243267-ba22-40c2-b0d8-57c36d93f33c") : secret "dns-default-metrics-tls" not found
Jun 09 13:28:59.229462 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.229405    2562 generic.go:356] "Generic (PLEG): container finished" podID="93f2797e-1352-4f1b-9a19-ed20fab0de84" containerID="9f38c1e3290c67efd4c1e5bcef85d11373505fd0d8cdb465ad1c9c9ab5ddfa73" exitCode=0
Jun 09 13:28:59.229957 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.229467    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lnm5m" event={"ID":"93f2797e-1352-4f1b-9a19-ed20fab0de84","Type":"ContainerDied","Data":"9f38c1e3290c67efd4c1e5bcef85d11373505fd0d8cdb465ad1c9c9ab5ddfa73"}
Jun 09 13:28:59.687226 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.686819    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"]
Jun 09 13:28:59.699552 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.699531    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"]
Jun 09 13:28:59.699678 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.699659    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:28:59.701973 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.701718    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 09 13:28:59.701973 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.701772    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 09 13:28:59.701973 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.701940    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jun 09 13:28:59.701973 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.701949    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 09 13:28:59.712779 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.712755    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"]
Jun 09 13:28:59.712887 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.712797    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"]
Jun 09 13:28:59.712887 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.712873    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:28:59.715145 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.714906    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jun 09 13:28:59.715513 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.715290    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jun 09 13:28:59.715513 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.715289    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jun 09 13:28:59.715513 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.715361    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jun 09 13:28:59.793049 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.793010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62sjb\" (UniqueName: \"kubernetes.io/projected/02b731d8-781f-47bc-bcbe-d088ab66fc57-kube-api-access-62sjb\") pod \"klusterlet-addon-workmgr-b57f94b9b-pkcwc\" (UID: \"02b731d8-781f-47bc-bcbe-d088ab66fc57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:28:59.793188 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.793122    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02b731d8-781f-47bc-bcbe-d088ab66fc57-tmp\") pod \"klusterlet-addon-workmgr-b57f94b9b-pkcwc\" (UID: \"02b731d8-781f-47bc-bcbe-d088ab66fc57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:28:59.793188 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.793139    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/02b731d8-781f-47bc-bcbe-d088ab66fc57-klusterlet-config\") pod \"klusterlet-addon-workmgr-b57f94b9b-pkcwc\" (UID: \"02b731d8-781f-47bc-bcbe-d088ab66fc57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:28:59.893869 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.893788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02b731d8-781f-47bc-bcbe-d088ab66fc57-tmp\") pod \"klusterlet-addon-workmgr-b57f94b9b-pkcwc\" (UID: \"02b731d8-781f-47bc-bcbe-d088ab66fc57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:28:59.893869 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.893825    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/02b731d8-781f-47bc-bcbe-d088ab66fc57-klusterlet-config\") pod \"klusterlet-addon-workmgr-b57f94b9b-pkcwc\" (UID: \"02b731d8-781f-47bc-bcbe-d088ab66fc57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:28:59.893869 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.893868    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62sjb\" (UniqueName: \"kubernetes.io/projected/02b731d8-781f-47bc-bcbe-d088ab66fc57-kube-api-access-62sjb\") pod \"klusterlet-addon-workmgr-b57f94b9b-pkcwc\" (UID: \"02b731d8-781f-47bc-bcbe-d088ab66fc57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:28:59.894127 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.893907    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2d5fdccf-3ce6-442e-a058-d31d03969735-hub\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:28:59.894127 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.893930    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d5fdccf-3ce6-442e-a058-d31d03969735-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:28:59.894127 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.893957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgqqp\" (UniqueName: \"kubernetes.io/projected/2d5fdccf-3ce6-442e-a058-d31d03969735-kube-api-access-sgqqp\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:28:59.894127 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.893982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5fdccf-3ce6-442e-a058-d31d03969735-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:28:59.894127 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.894005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2d5fdccf-3ce6-442e-a058-d31d03969735-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:28:59.894127 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.894054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2d5fdccf-3ce6-442e-a058-d31d03969735-ca\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:28:59.894362 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.894268    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02b731d8-781f-47bc-bcbe-d088ab66fc57-tmp\") pod \"klusterlet-addon-workmgr-b57f94b9b-pkcwc\" (UID: \"02b731d8-781f-47bc-bcbe-d088ab66fc57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:28:59.898226 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.898208    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/02b731d8-781f-47bc-bcbe-d088ab66fc57-klusterlet-config\") pod \"klusterlet-addon-workmgr-b57f94b9b-pkcwc\" (UID: \"02b731d8-781f-47bc-bcbe-d088ab66fc57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:28:59.903805 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.903787    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62sjb\" (UniqueName: \"kubernetes.io/projected/02b731d8-781f-47bc-bcbe-d088ab66fc57-kube-api-access-62sjb\") pod \"klusterlet-addon-workmgr-b57f94b9b-pkcwc\" (UID: \"02b731d8-781f-47bc-bcbe-d088ab66fc57\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:28:59.995119 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.995083    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2d5fdccf-3ce6-442e-a058-d31d03969735-hub\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:28:59.995239 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.995123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d5fdccf-3ce6-442e-a058-d31d03969735-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:28:59.995239 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.995148    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgqqp\" (UniqueName: \"kubernetes.io/projected/2d5fdccf-3ce6-442e-a058-d31d03969735-kube-api-access-sgqqp\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:28:59.995239 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.995176    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5fdccf-3ce6-442e-a058-d31d03969735-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:28:59.995239 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.995199    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2d5fdccf-3ce6-442e-a058-d31d03969735-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:28:59.995444 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.995316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2d5fdccf-3ce6-442e-a058-d31d03969735-ca\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:28:59.995998 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.995974    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5fdccf-3ce6-442e-a058-d31d03969735-additional-service-ca\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:28:59.997792 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.997771    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2d5fdccf-3ce6-442e-a058-d31d03969735-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:28:59.997944 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.997924    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d5fdccf-3ce6-442e-a058-d31d03969735-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:28:59.998140 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.998127    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2d5fdccf-3ce6-442e-a058-d31d03969735-ca\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:28:59.998259 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:28:59.998243    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2d5fdccf-3ce6-442e-a058-d31d03969735-hub\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:29:00.005292 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:00.005274    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgqqp\" (UniqueName: \"kubernetes.io/projected/2d5fdccf-3ce6-442e-a058-d31d03969735-kube-api-access-sgqqp\") pod \"cluster-proxy-proxy-agent-58694965c-vhzqh\" (UID: \"2d5fdccf-3ce6-442e-a058-d31d03969735\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:29:00.012147 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:00.012130    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:29:00.032389 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:00.032358    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:29:00.163825 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:00.163724    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"]
Jun 09 13:29:00.166562 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:29:00.166534    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02b731d8_781f_47bc_bcbe_d088ab66fc57.slice/crio-990791f4ae3368b654df4cb04c034e5726e35304fc262f403fc9fc5ab099cabd WatchSource:0}: Error finding container 990791f4ae3368b654df4cb04c034e5726e35304fc262f403fc9fc5ab099cabd: Status 404 returned error can't find the container with id 990791f4ae3368b654df4cb04c034e5726e35304fc262f403fc9fc5ab099cabd
Jun 09 13:29:00.186081 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:00.186022    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"]
Jun 09 13:29:00.189663 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:29:00.189637    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d5fdccf_3ce6_442e_a058_d31d03969735.slice/crio-355b3726b489ad4b45344e8d6a13ab386714159b504f8865686693debd1c9b17 WatchSource:0}: Error finding container 355b3726b489ad4b45344e8d6a13ab386714159b504f8865686693debd1c9b17: Status 404 returned error can't find the container with id 355b3726b489ad4b45344e8d6a13ab386714159b504f8865686693debd1c9b17
Jun 09 13:29:00.232496 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:00.232462    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh" event={"ID":"2d5fdccf-3ce6-442e-a058-d31d03969735","Type":"ContainerStarted","Data":"355b3726b489ad4b45344e8d6a13ab386714159b504f8865686693debd1c9b17"}
Jun 09 13:29:00.233636 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:00.233604    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc" event={"ID":"02b731d8-781f-47bc-bcbe-d088ab66fc57","Type":"ContainerStarted","Data":"990791f4ae3368b654df4cb04c034e5726e35304fc262f403fc9fc5ab099cabd"}
Jun 09 13:29:00.236701 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:00.236679    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lnm5m" event={"ID":"93f2797e-1352-4f1b-9a19-ed20fab0de84","Type":"ContainerStarted","Data":"f1011ccdf274ce7ebb9f17a539c44d83a0fa069fcae667b3a048f9fc84a92db8"}
Jun 09 13:29:00.238048 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:00.238030    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rjnj2" event={"ID":"73f59fdc-d918-48d3-bf11-81f7344ba09b","Type":"ContainerStarted","Data":"60cdb7009cd1cee61f2ebabb6738947918e352ce0e1778df5761b465cade088b"}
Jun 09 13:29:00.260206 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:00.258957    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lnm5m" podStartSLOduration=9.454208669 podStartE2EDuration="39.258940456s" totalImagesPullingTime="29.804731787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:29:00.258629535 +0000 UTC m=+39.633300296" watchObservedRunningTime="2026-06-09 13:29:00.258940456 +0000 UTC m=+39.633611218"
Jun 09 13:29:00.272233 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:00.272192    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rjnj2" podStartSLOduration=2.2529611 podStartE2EDuration="4.272179094s" totalImagesPullingTime="2.019217994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:29:00.271814495 +0000 UTC m=+39.646485257" watchObservedRunningTime="2026-06-09 13:29:00.272179094 +0000 UTC m=+39.646849855"
Jun 09 13:29:00.378111 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:00.378077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:29:00.430418 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:00.430382    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:29:00.802322 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:00.802213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:29:00.802649 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:29:00.802318    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 13:29:00.802649 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:29:00.802418    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls podName:f2243267-ba22-40c2-b0d8-57c36d93f33c nodeName:}" failed. No retries permitted until 2026-06-09 13:29:04.802395111 +0000 UTC m=+44.177065855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls") pod "dns-default-mxqtr" (UID: "f2243267-ba22-40c2-b0d8-57c36d93f33c") : secret "dns-default-metrics-tls" not found
Jun 09 13:29:01.399546 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:01.399252    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:29:01.458520 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:01.458438    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:29:04.837831 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:04.837791    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:29:04.838268 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:29:04.837963    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 13:29:04.838268 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:29:04.838061    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls podName:f2243267-ba22-40c2-b0d8-57c36d93f33c nodeName:}" failed. No retries permitted until 2026-06-09 13:29:12.838041385 +0000 UTC m=+52.212712123 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls") pod "dns-default-mxqtr" (UID: "f2243267-ba22-40c2-b0d8-57c36d93f33c") : secret "dns-default-metrics-tls" not found
Jun 09 13:29:06.256691 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:06.256660    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc" event={"ID":"02b731d8-781f-47bc-bcbe-d088ab66fc57","Type":"ContainerStarted","Data":"8afca845815586b08c62d416e2878ce2ae7ce14324cc80506d7637ff5518d041"}
Jun 09 13:29:06.257191 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:06.256857    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:29:06.258850 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:06.258816    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:29:06.259022 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:06.259003    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh" event={"ID":"2d5fdccf-3ce6-442e-a058-d31d03969735","Type":"ContainerStarted","Data":"4892fbe67e77d983a07b62673620eb3e8d73380f3751613af477dc36a133c66e"}
Jun 09 13:29:06.259096 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:06.259031    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh" event={"ID":"2d5fdccf-3ce6-442e-a058-d31d03969735","Type":"ContainerStarted","Data":"22df414fda05d85c3ef831a5d07d9db02bd5ae86df9a4e9b3e7bb31151313304"}
Jun 09 13:29:06.259096 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:06.259046    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh" event={"ID":"2d5fdccf-3ce6-442e-a058-d31d03969735","Type":"ContainerStarted","Data":"e9da23776e0e2dbbfdeb0e0723ccb7f825b379e8668be18b0dc3c95d35036da5"}
Jun 09 13:29:06.273645 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:06.273603    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc" podStartSLOduration=1.866697608 podStartE2EDuration="7.273588465s" totalImagesPullingTime="5.406890857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:29:06.272354002 +0000 UTC m=+45.647024753" watchObservedRunningTime="2026-06-09 13:29:06.273588465 +0000 UTC m=+45.648259227"
Jun 09 13:29:06.301613 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:06.301567    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh" podStartSLOduration=1.916339522 podStartE2EDuration="7.301555239s" totalImagesPullingTime="5.385215717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:29:06.30119616 +0000 UTC m=+45.675866921" watchObservedRunningTime="2026-06-09 13:29:06.301555239 +0000 UTC m=+45.676225999"
Jun 09 13:29:11.818744 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:11.818685    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:29:11.873086 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:11.873053    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:29:12.896748 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:12.896690    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:29:12.897228 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:29:12.896877    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 13:29:12.897228 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:29:12.896975    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls podName:f2243267-ba22-40c2-b0d8-57c36d93f33c nodeName:}" failed. No retries permitted until 2026-06-09 13:29:28.896954048 +0000 UTC m=+68.271624799 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls") pod "dns-default-mxqtr" (UID: "f2243267-ba22-40c2-b0d8-57c36d93f33c") : secret "dns-default-metrics-tls" not found
Jun 09 13:29:13.576314 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:13.576259    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:29:13.626656 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:13.626617    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:29:19.517321 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:19.517283    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:29:21.209751 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:21.209709    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r6glq"
Jun 09 13:29:21.322853 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:21.322816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:29:21.377822 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:21.377788    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:29:21.435216 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:21.435185    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:29:26.900322 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:26.900284    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs\") pod \"network-metrics-daemon-xfldj\" (UID: \"bfb80980-0aa2-49ab-b601-b895816adbb7\") " pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:29:26.900770 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:26.900342    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret\") pod \"global-pull-secret-syncer-sf96c\" (UID: \"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5\") " pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:29:26.903059 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:26.903041    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 09 13:29:26.903156 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:26.903091    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 09 13:29:26.910764 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:29:26.910742    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 09 13:29:26.910860 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:29:26.910811    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs podName:bfb80980-0aa2-49ab-b601-b895816adbb7 nodeName:}" failed. No retries permitted until 2026-06-09 13:30:30.910794307 +0000 UTC m=+130.285465046 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs") pod "network-metrics-daemon-xfldj" (UID: "bfb80980-0aa2-49ab-b601-b895816adbb7") : secret "metrics-daemon-secret" not found
Jun 09 13:29:26.913627 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:26.913599    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5-original-pull-secret\") pod \"global-pull-secret-syncer-sf96c\" (UID: \"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5\") " pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:29:26.979549 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:26.979511    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:29:27.001541 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:27.001510    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z99h\" (UniqueName: \"kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h\") pod \"network-check-target-7gwnl\" (UID: \"6db742ac-0935-4dd7-917b-a954274b44d3\") " pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:29:27.004491 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:27.004474    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 09 13:29:27.014170 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:27.014151    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 09 13:29:27.025487 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:27.025456    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z99h\" (UniqueName: \"kubernetes.io/projected/6db742ac-0935-4dd7-917b-a954274b44d3-kube-api-access-8z99h\") pod \"network-check-target-7gwnl\" (UID: \"6db742ac-0935-4dd7-917b-a954274b44d3\") " pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:29:27.035023 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:27.034999    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:29:27.158780 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:27.158681    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sf96c"
Jun 09 13:29:27.171358 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:27.171335    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-mb9fc\""
Jun 09 13:29:27.179449 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:27.179428    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:29:27.300909 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:27.300877    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sf96c"]
Jun 09 13:29:27.305185 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:29:27.305161    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f3a9543_145b_4b8e_9d9d_dd8c15d5f1b5.slice/crio-6cb493341573006ed21d488872356a83d31302913d547d243bfa7ecf3a2fc7de WatchSource:0}: Error finding container 6cb493341573006ed21d488872356a83d31302913d547d243bfa7ecf3a2fc7de: Status 404 returned error can't find the container with id 6cb493341573006ed21d488872356a83d31302913d547d243bfa7ecf3a2fc7de
Jun 09 13:29:27.311601 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:27.311570    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sf96c" event={"ID":"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5","Type":"ContainerStarted","Data":"6cb493341573006ed21d488872356a83d31302913d547d243bfa7ecf3a2fc7de"}
Jun 09 13:29:27.329451 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:27.329419    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7gwnl"]
Jun 09 13:29:27.332171 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:29:27.332149    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6db742ac_0935_4dd7_917b_a954274b44d3.slice/crio-0ea7b4edc8198f2081679595136d95da70d8098e355bd6a5e411f47088a74f28 WatchSource:0}: Error finding container 0ea7b4edc8198f2081679595136d95da70d8098e355bd6a5e411f47088a74f28: Status 404 returned error can't find the container with id 0ea7b4edc8198f2081679595136d95da70d8098e355bd6a5e411f47088a74f28
Jun 09 13:29:28.316170 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:28.316133    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7gwnl" event={"ID":"6db742ac-0935-4dd7-917b-a954274b44d3","Type":"ContainerStarted","Data":"0ea7b4edc8198f2081679595136d95da70d8098e355bd6a5e411f47088a74f28"}
Jun 09 13:29:28.914889 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:28.914843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:29:28.915085 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:29:28.915033    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 13:29:28.915151 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:29:28.915115    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls podName:f2243267-ba22-40c2-b0d8-57c36d93f33c nodeName:}" failed. No retries permitted until 2026-06-09 13:30:00.915093831 +0000 UTC m=+100.289764585 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls") pod "dns-default-mxqtr" (UID: "f2243267-ba22-40c2-b0d8-57c36d93f33c") : secret "dns-default-metrics-tls" not found
Jun 09 13:29:32.329869 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:32.329829    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sf96c" event={"ID":"4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5","Type":"ContainerStarted","Data":"de8fbcf3f9e2dffff1b07448cbf53674683a89b59cf15400e14ab6fb6492c90c"}
Jun 09 13:29:32.331326 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:32.331304    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7gwnl" event={"ID":"6db742ac-0935-4dd7-917b-a954274b44d3","Type":"ContainerStarted","Data":"4553de08a3f742afc8ce9cbeb8b2f58eec731c33714e2941529ecb94e5d97da4"}
Jun 09 13:29:32.331381 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:32.331364    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:29:32.345471 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:32.345417    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sf96c" podStartSLOduration=66.957805849 podStartE2EDuration="1m11.345405763s" totalImagesPullingTime="4.387599914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:29:32.344666861 +0000 UTC m=+71.719337624" watchObservedRunningTime="2026-06-09 13:29:32.345405763 +0000 UTC m=+71.720076523"
Jun 09 13:29:32.358987 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:29:32.358950    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7gwnl" podStartSLOduration=67.00226585 podStartE2EDuration="1m11.358937483s" totalImagesPullingTime="4.356671633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:29:32.358022774 +0000 UTC m=+71.732693535" watchObservedRunningTime="2026-06-09 13:29:32.358937483 +0000 UTC m=+71.733608243"
Jun 09 13:30:00.941277 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:30:00.941231    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:30:00.941676 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:30:00.941361    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 13:30:00.941676 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:30:00.941423    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls podName:f2243267-ba22-40c2-b0d8-57c36d93f33c nodeName:}" failed. No retries permitted until 2026-06-09 13:31:04.941410761 +0000 UTC m=+164.316081499 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls") pod "dns-default-mxqtr" (UID: "f2243267-ba22-40c2-b0d8-57c36d93f33c") : secret "dns-default-metrics-tls" not found
Jun 09 13:30:02.239096 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:30:02.239043    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:30:03.338354 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:30:03.338327    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7gwnl"
Jun 09 13:30:30.935932 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:30:30.935895    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs\") pod \"network-metrics-daemon-xfldj\" (UID: \"bfb80980-0aa2-49ab-b601-b895816adbb7\") " pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:30:30.936368 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:30:30.936024    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 09 13:30:30.936368 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:30:30.936077    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs podName:bfb80980-0aa2-49ab-b601-b895816adbb7 nodeName:}" failed. No retries permitted until 2026-06-09 13:32:32.936062975 +0000 UTC m=+252.310733713 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs") pod "network-metrics-daemon-xfldj" (UID: "bfb80980-0aa2-49ab-b601-b895816adbb7") : secret "metrics-daemon-secret" not found
Jun 09 13:31:00.033554 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:31:00.033501    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mxqtr" podUID="f2243267-ba22-40c2-b0d8-57c36d93f33c"
Jun 09 13:31:00.575912 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:31:00.575882    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:31:01.064113 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:31:01.064078    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:31:04.983569 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:31:04.983533    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:31:04.984036 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:31:04.983677    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 09 13:31:04.984036 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:31:04.983761    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls podName:f2243267-ba22-40c2-b0d8-57c36d93f33c nodeName:}" failed. No retries permitted until 2026-06-09 13:33:06.98372411 +0000 UTC m=+286.358394848 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls") pod "dns-default-mxqtr" (UID: "f2243267-ba22-40c2-b0d8-57c36d93f33c") : secret "dns-default-metrics-tls" not found
Jun 09 13:31:06.257875 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:31:06.257829    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc" podUID="02b731d8-781f-47bc-bcbe-d088ab66fc57" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused"
Jun 09 13:31:06.593461 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:31:06.593381    2562 generic.go:356] "Generic (PLEG): container finished" podID="02b731d8-781f-47bc-bcbe-d088ab66fc57" containerID="8afca845815586b08c62d416e2878ce2ae7ce14324cc80506d7637ff5518d041" exitCode=1
Jun 09 13:31:06.593461 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:31:06.593454    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc" event={"ID":"02b731d8-781f-47bc-bcbe-d088ab66fc57","Type":"ContainerDied","Data":"8afca845815586b08c62d416e2878ce2ae7ce14324cc80506d7637ff5518d041"}
Jun 09 13:31:06.593780 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:31:06.593765    2562 scope.go:117] "RemoveContainer" containerID="8afca845815586b08c62d416e2878ce2ae7ce14324cc80506d7637ff5518d041"
Jun 09 13:31:07.597324 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:31:07.597283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc" event={"ID":"02b731d8-781f-47bc-bcbe-d088ab66fc57","Type":"ContainerStarted","Data":"a3fb6d13c26a41fb5e776d8fcd38a0659c061e3e5c380eb2707e0af862328747"}
Jun 09 13:31:07.597697 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:31:07.597607    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:31:07.598294 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:31:07.598272    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:31:15.049704 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:31:15.049665    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:32:16.578278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:16.578235    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:16.666750 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:16.666697    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:18.027282 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:18.027250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:18.082873 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:18.082841    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:21.150623 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:21.150595    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:21.226340 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:21.226291    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:21.630979 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:21.630944    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:21.723384 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:21.723352    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:21.823314 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:21.823278    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:21.940123 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:21.940100    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:22.007507 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:22.007478    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:22.371869 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:22.371775    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:22.422947 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:22.422913    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:22.648673 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:22.648587    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:22.748875 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:22.748846    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:23.073282 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:23.073255    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9bbb6_c9ed8bc4-1037-41b7-ac71-9b6aae568b79/dns-node-resolver/0.log"
Jun 09 13:32:24.063682 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:24.063646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:24.274511 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:24.274478    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zl45c_0e9007b1-6e07-49ff-b1a5-d40904431d90/node-ca/0.log"
Jun 09 13:32:24.294071 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:24.294039    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:24.393921 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:24.393831    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:25.074250 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:25.074221    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rjnj2_73f59fdc-d918-48d3-bf11-81f7344ba09b/serve-healthcheck-canary/0.log"
Jun 09 13:32:25.139448 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:25.139424    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:25.807984 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:25.807954    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:25.929653 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:25.929621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:26.215197 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:26.215170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:26.325148 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:26.325117    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:26.516294 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:26.516219    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:27.101034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:27.101000    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:27.901355 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:27.901321    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:28.097786 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:28.097756    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:28.152605 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:28.152528    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:28.516361 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:28.516331    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:28.706008 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:28.705980    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:28.806904 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:28.806821    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:29.306051 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:29.305984    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:29.707167 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:29.707122    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:29.809552 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:29.809511    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:30.101720 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:30.101637    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:30.304470 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:30.304437    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:30.357595 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:30.357508    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:30.716624 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:30.716593    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:31.097869 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:31.097793    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:31.700950 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:31.700911    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:31.801743 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:31.801712    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:32.301089 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:32.301051    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:32.426318 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:32.426290    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:32.526234 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:32.526204    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:32.704277 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:32.704249    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:32.992122 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:32.992036    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs\") pod \"network-metrics-daemon-xfldj\" (UID: \"bfb80980-0aa2-49ab-b601-b895816adbb7\") " pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:32:32.992283 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:32:32.992175    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 09 13:32:32.992283 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:32:32.992234    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs podName:bfb80980-0aa2-49ab-b601-b895816adbb7 nodeName:}" failed. No retries permitted until 2026-06-09 13:34:34.992217652 +0000 UTC m=+374.366888391 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs") pod "network-metrics-daemon-xfldj" (UID: "bfb80980-0aa2-49ab-b601-b895816adbb7") : secret "metrics-daemon-secret" not found
Jun 09 13:32:33.101954 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:33.101926    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:33.501647 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:33.501587    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:34.177947 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:34.177916    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:34.304591 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:34.304558    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:34.707160 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:34.707131    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:34.902243 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:34.902205    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:35.105299 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:35.105203    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:35.299541 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:35.299511    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:36.107211 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:36.107158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:36.300336 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:36.300305    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:36.498672 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:36.498640    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:42.059751 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:42.059695    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:42.127534 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:42.127500    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:42.926669 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:42.926632    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:48.106252 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.106219    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mzckz"]
Jun 09 13:32:48.108297 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.108282    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mzckz"
Jun 09 13:32:48.110586 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.110561    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 09 13:32:48.110688 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.110598    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 09 13:32:48.111754 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.111707    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 09 13:32:48.111754 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.111716    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zslht\""
Jun 09 13:32:48.111908 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.111762    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 09 13:32:48.121609 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.121592    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mzckz"]
Jun 09 13:32:48.198250 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.198220    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68169161-9efc-4393-82dc-26216149a02f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzckz\" (UID: \"68169161-9efc-4393-82dc-26216149a02f\") " pod="openshift-insights/insights-runtime-extractor-mzckz"
Jun 09 13:32:48.198250 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.198249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkg7w\" (UniqueName: \"kubernetes.io/projected/68169161-9efc-4393-82dc-26216149a02f-kube-api-access-tkg7w\") pod \"insights-runtime-extractor-mzckz\" (UID: \"68169161-9efc-4393-82dc-26216149a02f\") " pod="openshift-insights/insights-runtime-extractor-mzckz"
Jun 09 13:32:48.198432 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.198294    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68169161-9efc-4393-82dc-26216149a02f-crio-socket\") pod \"insights-runtime-extractor-mzckz\" (UID: \"68169161-9efc-4393-82dc-26216149a02f\") " pod="openshift-insights/insights-runtime-extractor-mzckz"
Jun 09 13:32:48.198432 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.198322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68169161-9efc-4393-82dc-26216149a02f-data-volume\") pod \"insights-runtime-extractor-mzckz\" (UID: \"68169161-9efc-4393-82dc-26216149a02f\") " pod="openshift-insights/insights-runtime-extractor-mzckz"
Jun 09 13:32:48.198432 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.198347    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68169161-9efc-4393-82dc-26216149a02f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzckz\" (UID: \"68169161-9efc-4393-82dc-26216149a02f\") " pod="openshift-insights/insights-runtime-extractor-mzckz"
Jun 09 13:32:48.236944 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.236911    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:48.299040 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.299003    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68169161-9efc-4393-82dc-26216149a02f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzckz\" (UID: \"68169161-9efc-4393-82dc-26216149a02f\") " pod="openshift-insights/insights-runtime-extractor-mzckz"
Jun 09 13:32:48.299040 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.299037    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkg7w\" (UniqueName: \"kubernetes.io/projected/68169161-9efc-4393-82dc-26216149a02f-kube-api-access-tkg7w\") pod \"insights-runtime-extractor-mzckz\" (UID: \"68169161-9efc-4393-82dc-26216149a02f\") " pod="openshift-insights/insights-runtime-extractor-mzckz"
Jun 09 13:32:48.299263 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.299071    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68169161-9efc-4393-82dc-26216149a02f-crio-socket\") pod \"insights-runtime-extractor-mzckz\" (UID: \"68169161-9efc-4393-82dc-26216149a02f\") " pod="openshift-insights/insights-runtime-extractor-mzckz"
Jun 09 13:32:48.299263 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.299134    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/68169161-9efc-4393-82dc-26216149a02f-crio-socket\") pod \"insights-runtime-extractor-mzckz\" (UID: \"68169161-9efc-4393-82dc-26216149a02f\") " pod="openshift-insights/insights-runtime-extractor-mzckz"
Jun 09 13:32:48.299263 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.299179    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68169161-9efc-4393-82dc-26216149a02f-data-volume\") pod \"insights-runtime-extractor-mzckz\" (UID: \"68169161-9efc-4393-82dc-26216149a02f\") " pod="openshift-insights/insights-runtime-extractor-mzckz"
Jun 09 13:32:48.299263 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.299222    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68169161-9efc-4393-82dc-26216149a02f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzckz\" (UID: \"68169161-9efc-4393-82dc-26216149a02f\") " pod="openshift-insights/insights-runtime-extractor-mzckz"
Jun 09 13:32:48.299601 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.299581    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/68169161-9efc-4393-82dc-26216149a02f-data-volume\") pod \"insights-runtime-extractor-mzckz\" (UID: \"68169161-9efc-4393-82dc-26216149a02f\") " pod="openshift-insights/insights-runtime-extractor-mzckz"
Jun 09 13:32:48.299972 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.299950    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/68169161-9efc-4393-82dc-26216149a02f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mzckz\" (UID: \"68169161-9efc-4393-82dc-26216149a02f\") " pod="openshift-insights/insights-runtime-extractor-mzckz"
Jun 09 13:32:48.301446 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.301430    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/68169161-9efc-4393-82dc-26216149a02f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mzckz\" (UID: \"68169161-9efc-4393-82dc-26216149a02f\") " pod="openshift-insights/insights-runtime-extractor-mzckz"
Jun 09 13:32:48.307527 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.307510    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkg7w\" (UniqueName: \"kubernetes.io/projected/68169161-9efc-4393-82dc-26216149a02f-kube-api-access-tkg7w\") pod \"insights-runtime-extractor-mzckz\" (UID: \"68169161-9efc-4393-82dc-26216149a02f\") " pod="openshift-insights/insights-runtime-extractor-mzckz"
Jun 09 13:32:48.417044 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.416951    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mzckz"
Jun 09 13:32:48.542202 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.542172    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mzckz"]
Jun 09 13:32:48.545263 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:32:48.545235    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68169161_9efc_4393_82dc_26216149a02f.slice/crio-76a9663dd5deec78959d94dec2f673eb79e0c255c7409bfc37ef24d864fda69d WatchSource:0}: Error finding container 76a9663dd5deec78959d94dec2f673eb79e0c255c7409bfc37ef24d864fda69d: Status 404 returned error can't find the container with id 76a9663dd5deec78959d94dec2f673eb79e0c255c7409bfc37ef24d864fda69d
Jun 09 13:32:48.878515 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.878482    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzckz" event={"ID":"68169161-9efc-4393-82dc-26216149a02f","Type":"ContainerStarted","Data":"ba58d7ba7548cb094ab12c3150c10c63e755e43e4be0d0e2ee1bdbbadb05460b"}
Jun 09 13:32:48.878685 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:48.878534    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzckz" event={"ID":"68169161-9efc-4393-82dc-26216149a02f","Type":"ContainerStarted","Data":"76a9663dd5deec78959d94dec2f673eb79e0c255c7409bfc37ef24d864fda69d"}
Jun 09 13:32:49.498338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:49.498310    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:49.884547 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:49.884461    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzckz" event={"ID":"68169161-9efc-4393-82dc-26216149a02f","Type":"ContainerStarted","Data":"51dd0063d287ae6e817840d84da4b2283407a8f2d404170cf4db3ecdfb22e339"}
Jun 09 13:32:50.698937 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:50.698915    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:50.797789 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:50.797758    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:50.884434 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:50.884406    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:50.888493 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:50.888469    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mzckz" event={"ID":"68169161-9efc-4393-82dc-26216149a02f","Type":"ContainerStarted","Data":"8c180dd5f6236a3302091ed93c132f743006d1ac88a05f34738e59e54d5b5878"}
Jun 09 13:32:50.912286 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:50.912210    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mzckz" podStartSLOduration=0.909315509 podStartE2EDuration="2.912195693s" totalImagesPullingTime="2.002880184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:32:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:32:50.911466467 +0000 UTC m=+270.286137229" watchObservedRunningTime="2026-06-09 13:32:50.912195693 +0000 UTC m=+270.286866465"
Jun 09 13:32:50.969397 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:50.969365    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:53.908623 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:53.908591    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:53.993053 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:53.993019    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:54.234116 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:54.234085    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:56.479350 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:56.479314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:58.460657 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:58.460628    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:58.519231 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:58.519203    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:59.044300 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.044271    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:59.277359 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.277326    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:59.312558 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.312480    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vnv6l"]
Jun 09 13:32:59.315227 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.315207    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.320073 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.320050    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 09 13:32:59.320073 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.320061    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 09 13:32:59.320254 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.320061    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r79z2\""
Jun 09 13:32:59.320587 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.320567    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 09 13:32:59.320687 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.320570    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 09 13:32:59.320687 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.320601    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 09 13:32:59.320687 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.320664    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 09 13:32:59.362643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.362615    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:59.375684 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.375660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5b44b25-0e65-49ed-b57f-098ca40c57ed-node-exporter-wtmp\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.375812 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.375689    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5b44b25-0e65-49ed-b57f-098ca40c57ed-node-exporter-textfile\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.375812 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.375713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm9p9\" (UniqueName: \"kubernetes.io/projected/f5b44b25-0e65-49ed-b57f-098ca40c57ed-kube-api-access-hm9p9\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.375812 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.375743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5b44b25-0e65-49ed-b57f-098ca40c57ed-root\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.375812 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.375769    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5b44b25-0e65-49ed-b57f-098ca40c57ed-node-exporter-accelerators-collector-config\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.375949 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.375822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5b44b25-0e65-49ed-b57f-098ca40c57ed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.375949 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.375853    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5b44b25-0e65-49ed-b57f-098ca40c57ed-node-exporter-tls\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.375949 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.375876    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5b44b25-0e65-49ed-b57f-098ca40c57ed-sys\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.375949 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.375892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5b44b25-0e65-49ed-b57f-098ca40c57ed-metrics-client-ca\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.422193 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.422164    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:59.476985 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.476952    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5b44b25-0e65-49ed-b57f-098ca40c57ed-node-exporter-tls\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.477375 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.477000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5b44b25-0e65-49ed-b57f-098ca40c57ed-sys\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.477375 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.477045    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5b44b25-0e65-49ed-b57f-098ca40c57ed-metrics-client-ca\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.477375 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.477119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5b44b25-0e65-49ed-b57f-098ca40c57ed-node-exporter-wtmp\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.477375 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.477127    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f5b44b25-0e65-49ed-b57f-098ca40c57ed-sys\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.477375 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.477150    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5b44b25-0e65-49ed-b57f-098ca40c57ed-node-exporter-textfile\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.477375 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.477186    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hm9p9\" (UniqueName: \"kubernetes.io/projected/f5b44b25-0e65-49ed-b57f-098ca40c57ed-kube-api-access-hm9p9\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.477375 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.477275    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f5b44b25-0e65-49ed-b57f-098ca40c57ed-node-exporter-wtmp\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.477375 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.477299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5b44b25-0e65-49ed-b57f-098ca40c57ed-root\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.477375 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.477336    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5b44b25-0e65-49ed-b57f-098ca40c57ed-node-exporter-accelerators-collector-config\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.477375 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.477371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5b44b25-0e65-49ed-b57f-098ca40c57ed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.477796 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.477385    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f5b44b25-0e65-49ed-b57f-098ca40c57ed-root\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.477796 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.477485    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f5b44b25-0e65-49ed-b57f-098ca40c57ed-node-exporter-textfile\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.477796 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.477652    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5b44b25-0e65-49ed-b57f-098ca40c57ed-metrics-client-ca\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.477912 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.477868    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f5b44b25-0e65-49ed-b57f-098ca40c57ed-node-exporter-accelerators-collector-config\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.479394 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.479374    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f5b44b25-0e65-49ed-b57f-098ca40c57ed-node-exporter-tls\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.479677 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.479657    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5b44b25-0e65-49ed-b57f-098ca40c57ed-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.485883 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.485858    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm9p9\" (UniqueName: \"kubernetes.io/projected/f5b44b25-0e65-49ed-b57f-098ca40c57ed-kube-api-access-hm9p9\") pod \"node-exporter-vnv6l\" (UID: \"f5b44b25-0e65-49ed-b57f-098ca40c57ed\") " pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.527770 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.527717    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:59.623522 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.623433    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:59.627403 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.627384    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vnv6l"
Jun 09 13:32:59.636895 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:32:59.636872    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b44b25_0e65_49ed_b57f_098ca40c57ed.slice/crio-9fb78679e507c8f2bd8bf77f6e923abab18c89af6cd57bc9b77f6ccd66559700 WatchSource:0}: Error finding container 9fb78679e507c8f2bd8bf77f6e923abab18c89af6cd57bc9b77f6ccd66559700: Status 404 returned error can't find the container with id 9fb78679e507c8f2bd8bf77f6e923abab18c89af6cd57bc9b77f6ccd66559700
Jun 09 13:32:59.725128 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.725093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:32:59.915657 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:32:59.915577    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vnv6l" event={"ID":"f5b44b25-0e65-49ed-b57f-098ca40c57ed","Type":"ContainerStarted","Data":"9fb78679e507c8f2bd8bf77f6e923abab18c89af6cd57bc9b77f6ccd66559700"}
Jun 09 13:33:00.095066 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:00.095037    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:00.346825 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:00.346792    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:00.434564 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:00.434528    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:00.649327 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:00.649291    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:00.920252 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:00.920167    2562 generic.go:356] "Generic (PLEG): container finished" podID="f5b44b25-0e65-49ed-b57f-098ca40c57ed" containerID="41ec2ae94863bf0d9edaa9dbab46afb68fa85ea43ec54c4af655a83dbe371d15" exitCode=0
Jun 09 13:33:00.920252 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:00.920202    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vnv6l" event={"ID":"f5b44b25-0e65-49ed-b57f-098ca40c57ed","Type":"ContainerDied","Data":"41ec2ae94863bf0d9edaa9dbab46afb68fa85ea43ec54c4af655a83dbe371d15"}
Jun 09 13:33:01.313594 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.313245    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"]
Jun 09 13:33:01.316629 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.316613    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.319082 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.319059    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 09 13:33:01.319212 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.319059    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 09 13:33:01.319212 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.319102    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-b9khk\""
Jun 09 13:33:01.319212 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.319146    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 09 13:33:01.319212 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.319094    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5v67kli6hcjjb\""
Jun 09 13:33:01.319463 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.319449    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 09 13:33:01.319541 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.319524    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 09 13:33:01.327505 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.327472    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"]
Jun 09 13:33:01.392036 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.392004    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.392036 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.392038    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3687e302-44f4-4a4d-8b80-65b538150cab-metrics-client-ca\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.392272 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.392060    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-thanos-querier-tls\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.392272 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.392075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-grpc-tls\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.392272 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.392125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.392272 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.392173    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.392272 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.392198    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6wqq\" (UniqueName: \"kubernetes.io/projected/3687e302-44f4-4a4d-8b80-65b538150cab-kube-api-access-j6wqq\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.392447 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.392284    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.492714 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.492678    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.492866 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.492723    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.492866 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.492768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3687e302-44f4-4a4d-8b80-65b538150cab-metrics-client-ca\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.492866 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.492791    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-thanos-querier-tls\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.492866 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.492807    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-grpc-tls\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.492866 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.492835    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.493115 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.492871    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.493115 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.492895    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6wqq\" (UniqueName: \"kubernetes.io/projected/3687e302-44f4-4a4d-8b80-65b538150cab-kube-api-access-j6wqq\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.493936 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.493876    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3687e302-44f4-4a4d-8b80-65b538150cab-metrics-client-ca\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.495635 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.495576    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.495751 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.495682    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.495883 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.495858    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.495955 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.495942    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-grpc-tls\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.496014 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.495998    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.496122 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.496106    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3687e302-44f4-4a4d-8b80-65b538150cab-secret-thanos-querier-tls\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.501463 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.501442    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6wqq\" (UniqueName: \"kubernetes.io/projected/3687e302-44f4-4a4d-8b80-65b538150cab-kube-api-access-j6wqq\") pod \"thanos-querier-7799bf4fc-d9wgk\" (UID: \"3687e302-44f4-4a4d-8b80-65b538150cab\") " pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.624885 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.624801    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:01.758818 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.758793    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"]
Jun 09 13:33:01.761080 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:33:01.761058    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3687e302_44f4_4a4d_8b80_65b538150cab.slice/crio-c3e6f88243a94ec755289c31fc74f08aa7d286dee3ca4da96cfd76fad793977f WatchSource:0}: Error finding container c3e6f88243a94ec755289c31fc74f08aa7d286dee3ca4da96cfd76fad793977f: Status 404 returned error can't find the container with id c3e6f88243a94ec755289c31fc74f08aa7d286dee3ca4da96cfd76fad793977f
Jun 09 13:33:01.926855 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.926769    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vnv6l" event={"ID":"f5b44b25-0e65-49ed-b57f-098ca40c57ed","Type":"ContainerStarted","Data":"ae364f1d784e820448cb5a560c1bda2737e3a69bf5eeebbe95c057c984d61eef"}
Jun 09 13:33:01.926855 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.926845    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vnv6l" event={"ID":"f5b44b25-0e65-49ed-b57f-098ca40c57ed","Type":"ContainerStarted","Data":"f3a8ee6e5495996b1d81b30ed0135aa4f0d94ce5d034394b6260db098112b0be"}
Jun 09 13:33:01.927887 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.927862    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk" event={"ID":"3687e302-44f4-4a4d-8b80-65b538150cab","Type":"ContainerStarted","Data":"c3e6f88243a94ec755289c31fc74f08aa7d286dee3ca4da96cfd76fad793977f"}
Jun 09 13:33:01.945239 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:01.945191    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vnv6l" podStartSLOduration=1.948885964 podStartE2EDuration="2.9451766s" totalImagesPullingTime="925.663864ms" totalInitContainerRuntime="70.626772ms" isStatefulPod=true podCreationTimestamp="2026-06-09 13:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:33:01.94427854 +0000 UTC m=+281.318949328" watchObservedRunningTime="2026-06-09 13:33:01.9451766 +0000 UTC m=+281.319847396"
Jun 09 13:33:02.250301 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:02.250266    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:02.354137 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:02.354102    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:02.540076 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:02.539982    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:03.577087 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:33:03.577039    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mxqtr" podUID="f2243267-ba22-40c2-b0d8-57c36d93f33c"
Jun 09 13:33:03.935605 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:03.935574    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk" event={"ID":"3687e302-44f4-4a4d-8b80-65b538150cab","Type":"ContainerStarted","Data":"ec856ff6475b1fa3fbcd715b306b3da054eb98ab9004507b4880edd2134ecb0e"}
Jun 09 13:33:03.935769 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:03.935643    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk" event={"ID":"3687e302-44f4-4a4d-8b80-65b538150cab","Type":"ContainerStarted","Data":"cf91438125cba372b7180d127f52a3366580c9a2da764801b11b2e00238ee8e1"}
Jun 09 13:33:03.935769 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:03.935584    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:33:03.935769 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:03.935669    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk" event={"ID":"3687e302-44f4-4a4d-8b80-65b538150cab","Type":"ContainerStarted","Data":"601dcb00583c6bd1344ad1b6c5c880c7f2d9f171d698de3248435dd61224c14b"}
Jun 09 13:33:04.068845 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:04.068818    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:04.175647 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:04.175612    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:04.229689 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:04.229623    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:04.343937 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:04.343896    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:04.941272 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:04.941240    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk" event={"ID":"3687e302-44f4-4a4d-8b80-65b538150cab","Type":"ContainerStarted","Data":"a07af89feee0b42b2b192ed720dc969a6036ec1b9a36c99606928190ad992c07"}
Jun 09 13:33:04.941662 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:04.941317    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk" event={"ID":"3687e302-44f4-4a4d-8b80-65b538150cab","Type":"ContainerStarted","Data":"dd5fc652c39b6b93a530176499fb29ca7b547d8bff6b0b18386f6544104cc404"}
Jun 09 13:33:04.941662 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:04.941359    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk" event={"ID":"3687e302-44f4-4a4d-8b80-65b538150cab","Type":"ContainerStarted","Data":"f72014c54169d2431b3fa2f2b9dc6748ff0e94b4af5cfa51abeee653949f7dad"}
Jun 09 13:33:04.941662 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:04.941410    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:04.965449 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:04.965408    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk" podStartSLOduration=1.34213816 podStartE2EDuration="3.965394069s" totalImagesPullingTime="2.623255909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:33:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:33:04.964025344 +0000 UTC m=+284.338696104" watchObservedRunningTime="2026-06-09 13:33:04.965394069 +0000 UTC m=+284.340064808"
Jun 09 13:33:05.556542 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:05.556510    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:06.953093 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:06.953063    2562 generic.go:356] "Generic (PLEG): container finished" podID="02b731d8-781f-47bc-bcbe-d088ab66fc57" containerID="a3fb6d13c26a41fb5e776d8fcd38a0659c061e3e5c380eb2707e0af862328747" exitCode=1
Jun 09 13:33:06.953470 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:06.953105    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc" event={"ID":"02b731d8-781f-47bc-bcbe-d088ab66fc57","Type":"ContainerDied","Data":"a3fb6d13c26a41fb5e776d8fcd38a0659c061e3e5c380eb2707e0af862328747"}
Jun 09 13:33:06.953470 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:06.953175    2562 scope.go:117] "RemoveContainer" containerID="8afca845815586b08c62d416e2878ce2ae7ce14324cc80506d7637ff5518d041"
Jun 09 13:33:06.953604 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:06.953472    2562 scope.go:117] "RemoveContainer" containerID="a3fb6d13c26a41fb5e776d8fcd38a0659c061e3e5c380eb2707e0af862328747"
Jun 09 13:33:06.953655 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:33:06.953637    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-b57f94b9b-pkcwc_open-cluster-management-agent-addon(02b731d8-781f-47bc-bcbe-d088ab66fc57)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc" podUID="02b731d8-781f-47bc-bcbe-d088ab66fc57"
Jun 09 13:33:07.040071 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:07.040031    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:33:07.042334 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:07.042317    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2243267-ba22-40c2-b0d8-57c36d93f33c-metrics-tls\") pod \"dns-default-mxqtr\" (UID: \"f2243267-ba22-40c2-b0d8-57c36d93f33c\") " pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:33:07.238775 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:07.238677    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zls7s\""
Jun 09 13:33:07.247587 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:07.247561    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:33:07.374932 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:07.374902    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mxqtr"]
Jun 09 13:33:07.377758 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:33:07.377708    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2243267_ba22_40c2_b0d8_57c36d93f33c.slice/crio-71cf14d6d8b95138c08805bb2f72de25d4889a77dc0105a17e53dc7368ad3221 WatchSource:0}: Error finding container 71cf14d6d8b95138c08805bb2f72de25d4889a77dc0105a17e53dc7368ad3221: Status 404 returned error can't find the container with id 71cf14d6d8b95138c08805bb2f72de25d4889a77dc0105a17e53dc7368ad3221
Jun 09 13:33:07.598582 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:07.598487    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:33:07.957463 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:07.957423    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mxqtr" event={"ID":"f2243267-ba22-40c2-b0d8-57c36d93f33c","Type":"ContainerStarted","Data":"71cf14d6d8b95138c08805bb2f72de25d4889a77dc0105a17e53dc7368ad3221"}
Jun 09 13:33:07.959282 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:07.959261    2562 scope.go:117] "RemoveContainer" containerID="a3fb6d13c26a41fb5e776d8fcd38a0659c061e3e5c380eb2707e0af862328747"
Jun 09 13:33:07.959466 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:33:07.959445    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-b57f94b9b-pkcwc_open-cluster-management-agent-addon(02b731d8-781f-47bc-bcbe-d088ab66fc57)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc" podUID="02b731d8-781f-47bc-bcbe-d088ab66fc57"
Jun 09 13:33:08.963509 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:08.963478    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mxqtr" event={"ID":"f2243267-ba22-40c2-b0d8-57c36d93f33c","Type":"ContainerStarted","Data":"beff81151e2c3d7c951cad65a23a7c4726df3a1e59d27911425ed3a84cba0d20"}
Jun 09 13:33:09.968892 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:09.968856    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mxqtr" event={"ID":"f2243267-ba22-40c2-b0d8-57c36d93f33c","Type":"ContainerStarted","Data":"81dec92e8099b84b4a715d6c6791e9a0031cab5032a6d9ea9571f91067f7fefd"}
Jun 09 13:33:09.969351 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:09.968974    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:33:09.985864 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:09.985816    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mxqtr" podStartSLOduration=252.555287413 podStartE2EDuration="4m13.985800717s" totalImagesPullingTime="1.430513304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:28:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:33:09.984933901 +0000 UTC m=+289.359604663" watchObservedRunningTime="2026-06-09 13:33:09.985800717 +0000 UTC m=+289.360471478"
Jun 09 13:33:10.013341 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:10.013298    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:33:10.013781 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:10.013762    2562 scope.go:117] "RemoveContainer" containerID="a3fb6d13c26a41fb5e776d8fcd38a0659c061e3e5c380eb2707e0af862328747"
Jun 09 13:33:10.013951 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:33:10.013932    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-b57f94b9b-pkcwc_open-cluster-management-agent-addon(02b731d8-781f-47bc-bcbe-d088ab66fc57)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc" podUID="02b731d8-781f-47bc-bcbe-d088ab66fc57"
Jun 09 13:33:10.033643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:10.033606    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh" podUID="2d5fdccf-3ce6-442e-a058-d31d03969735" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 09 13:33:10.953892 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:10.953866    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7799bf4fc-d9wgk"
Jun 09 13:33:11.079590 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:11.079561    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:11.178487 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:11.178456    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:11.235463 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:11.235388    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:11.364766 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:11.364713    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:11.641543 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:11.641461    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:11.737643 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:11.737609    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:11.943525 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:11.943492    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:12.046569 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:12.046537    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:12.156587 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:12.156551    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:12.373505 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:12.373424    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:12.429404 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:12.429375    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:12.555528 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:12.555499    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:12.759917 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:12.759869    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:13.244747 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:13.244696    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:14.775934 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:14.775902    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:14.834593 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:14.834561    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:17.267262 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:17.267232    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:17.367856 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:17.367827    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:18.051062 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:33:18.051004    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-xfldj" podUID="bfb80980-0aa2-49ab-b601-b895816adbb7"
Jun 09 13:33:18.538318 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:18.538285    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:18.638241 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:18.638210    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:19.236615 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:19.236583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:19.288526 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:19.288498    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:19.973757 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:19.973709    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mxqtr"
Jun 09 13:33:20.034079 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:20.034039    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh" podUID="2d5fdccf-3ce6-442e-a058-d31d03969735" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 09 13:33:20.183184 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:20.183147    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:20.236913 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:20.236844    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:20.539380 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:20.539291    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:20.639201 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:20.639167    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:21.008432 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.008410    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jun 09 13:33:21.317016 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.316937    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65fdc4dd95-9kb64"]
Jun 09 13:33:21.319925 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.319909    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.323272 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.323185    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 09 13:33:21.323272 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.323194    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l7h29\""
Jun 09 13:33:21.324056 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.323762    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 09 13:33:21.324056 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.323827    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 09 13:33:21.324056 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.324014    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 09 13:33:21.324056 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.324072    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 09 13:33:21.326167 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.324608    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 09 13:33:21.326167 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.324696    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 09 13:33:21.330936 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.330912    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65fdc4dd95-9kb64"]
Jun 09 13:33:21.449330 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.449288    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/452d4749-45ba-485b-8dea-0d430833e754-console-oauth-config\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.449510 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.449346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-742m8\" (UniqueName: \"kubernetes.io/projected/452d4749-45ba-485b-8dea-0d430833e754-kube-api-access-742m8\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.449510 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.449420    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/452d4749-45ba-485b-8dea-0d430833e754-console-serving-cert\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.449510 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.449439    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-oauth-serving-cert\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.449510 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.449462    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-console-config\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.449510 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.449482    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-service-ca\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.550557 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.550523    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-console-config\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.550557 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.550562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-service-ca\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.550815 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.550599    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/452d4749-45ba-485b-8dea-0d430833e754-console-oauth-config\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.550815 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.550635    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-742m8\" (UniqueName: \"kubernetes.io/projected/452d4749-45ba-485b-8dea-0d430833e754-kube-api-access-742m8\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.550815 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.550762    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/452d4749-45ba-485b-8dea-0d430833e754-console-serving-cert\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.550815 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.550788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-oauth-serving-cert\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.551408 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.551380    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-service-ca\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.551505 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.551413    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-oauth-serving-cert\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.551505 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.551401    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-console-config\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.553251 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.553229    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/452d4749-45ba-485b-8dea-0d430833e754-console-oauth-config\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.553345 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.553308    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/452d4749-45ba-485b-8dea-0d430833e754-console-serving-cert\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.559675 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.559654    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-742m8\" (UniqueName: \"kubernetes.io/projected/452d4749-45ba-485b-8dea-0d430833e754-kube-api-access-742m8\") pod \"console-65fdc4dd95-9kb64\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") " pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.631611 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.631523    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:21.780489 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:21.780463    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65fdc4dd95-9kb64"]
Jun 09 13:33:21.782647 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:33:21.782626    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452d4749_45ba_485b_8dea_0d430833e754.slice/crio-6c50e5c11a05ff88613d79ca5e7ac1e7cfac19a9ceec2c552b22d3b1fa7e0828 WatchSource:0}: Error finding container 6c50e5c11a05ff88613d79ca5e7ac1e7cfac19a9ceec2c552b22d3b1fa7e0828: Status 404 returned error can't find the container with id 6c50e5c11a05ff88613d79ca5e7ac1e7cfac19a9ceec2c552b22d3b1fa7e0828
Jun 09 13:33:22.009067 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:22.009030    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fdc4dd95-9kb64" event={"ID":"452d4749-45ba-485b-8dea-0d430833e754","Type":"ContainerStarted","Data":"6c50e5c11a05ff88613d79ca5e7ac1e7cfac19a9ceec2c552b22d3b1fa7e0828"}
Jun 09 13:33:22.049707 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:22.049680    2562 scope.go:117] "RemoveContainer" containerID="a3fb6d13c26a41fb5e776d8fcd38a0659c061e3e5c380eb2707e0af862328747"
Jun 09 13:33:23.014367 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:23.014320    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc" event={"ID":"02b731d8-781f-47bc-bcbe-d088ab66fc57","Type":"ContainerStarted","Data":"f8efe663b366c8042925822b6ad4fd54ac98e3cd734b8f21bce44ec596a11e49"}
Jun 09 13:33:23.014819 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:23.014668    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:33:23.016229 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:23.016206    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-b57f94b9b-pkcwc"
Jun 09 13:33:25.383886 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.383804    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5866856597-89wzq"]
Jun 09 13:33:25.387173 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.387154    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.388405 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.388381    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:25.399320 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.399290    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5866856597-89wzq"]
Jun 09 13:33:25.399474 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.399456    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 09 13:33:25.488000 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.487960    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f8f2d09-0c76-4594-a484-bc3513771d97-console-oauth-config\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.488183 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.488009    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-console-config\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.488183 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.488028    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-service-ca\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.488183 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.488111    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnn5b\" (UniqueName: \"kubernetes.io/projected/6f8f2d09-0c76-4594-a484-bc3513771d97-kube-api-access-dnn5b\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.488183 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.488148    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-oauth-serving-cert\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.488343 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.488198    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f8f2d09-0c76-4594-a484-bc3513771d97-console-serving-cert\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.488343 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.488273    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-trusted-ca-bundle\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.488862 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.488842    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:25.589635 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.589605    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f8f2d09-0c76-4594-a484-bc3513771d97-console-serving-cert\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.589807 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.589657    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-trusted-ca-bundle\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.589807 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.589683    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f8f2d09-0c76-4594-a484-bc3513771d97-console-oauth-config\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.589807 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.589724    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-console-config\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.589807 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.589775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-service-ca\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.589807 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.589806    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnn5b\" (UniqueName: \"kubernetes.io/projected/6f8f2d09-0c76-4594-a484-bc3513771d97-kube-api-access-dnn5b\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.590051 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.589832    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-oauth-serving-cert\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.590618 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.590595    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-console-config\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.590618 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.590603    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-service-ca\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.590809 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.590788    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-oauth-serving-cert\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.590873 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.590856    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-trusted-ca-bundle\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.592558 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.592538    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f8f2d09-0c76-4594-a484-bc3513771d97-console-oauth-config\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.592660 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.592644    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f8f2d09-0c76-4594-a484-bc3513771d97-console-serving-cert\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.598558 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.598537    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnn5b\" (UniqueName: \"kubernetes.io/projected/6f8f2d09-0c76-4594-a484-bc3513771d97-kube-api-access-dnn5b\") pod \"console-5866856597-89wzq\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") " pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.700004 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.699968    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:25.825246 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:25.825219    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5866856597-89wzq"]
Jun 09 13:33:25.827653 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:33:25.827625    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8f2d09_0c76_4594_a484_bc3513771d97.slice/crio-c4516043360a47e8b89855d04c2d4835c90ee182c9efc29ee9558084c2b60746 WatchSource:0}: Error finding container c4516043360a47e8b89855d04c2d4835c90ee182c9efc29ee9558084c2b60746: Status 404 returned error can't find the container with id c4516043360a47e8b89855d04c2d4835c90ee182c9efc29ee9558084c2b60746
Jun 09 13:33:26.026104 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:26.026003    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5866856597-89wzq" event={"ID":"6f8f2d09-0c76-4594-a484-bc3513771d97","Type":"ContainerStarted","Data":"e0ca30f9057cc31863e971de8f1bbd85b6a31a91ac4a96d435e5f28480ae6224"}
Jun 09 13:33:26.026104 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:26.026050    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5866856597-89wzq" event={"ID":"6f8f2d09-0c76-4594-a484-bc3513771d97","Type":"ContainerStarted","Data":"c4516043360a47e8b89855d04c2d4835c90ee182c9efc29ee9558084c2b60746"}
Jun 09 13:33:26.027441 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:26.027412    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fdc4dd95-9kb64" event={"ID":"452d4749-45ba-485b-8dea-0d430833e754","Type":"ContainerStarted","Data":"54ff8d451fc63e26375cb8faefcb23befefc9b177b2f99d0f2229760f701abe3"}
Jun 09 13:33:26.045492 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:26.045442    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5866856597-89wzq" podStartSLOduration=1.045427509 podStartE2EDuration="1.045427509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:33:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:33:26.044293129 +0000 UTC m=+305.418963889" watchObservedRunningTime="2026-06-09 13:33:26.045427509 +0000 UTC m=+305.420098324"
Jun 09 13:33:26.060962 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:26.060905    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65fdc4dd95-9kb64" podStartSLOduration=1.730535814 podStartE2EDuration="5.060886952s" totalImagesPullingTime="3.330351138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:33:26.059716711 +0000 UTC m=+305.434387474" watchObservedRunningTime="2026-06-09 13:33:26.060886952 +0000 UTC m=+305.435557745"
Jun 09 13:33:26.383333 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:26.383246    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:26.484197 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:26.484164    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:26.982278 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:26.982244    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:27.088316 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:27.088284    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:27.183887 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:27.183850    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:29.049501 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:29.049474    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:33:29.097633 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:29.097599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:29.218472 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:29.218448    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:30.033569 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:30.033529    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh" podUID="2d5fdccf-3ce6-442e-a058-d31d03969735" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Jun 09 13:33:30.033784 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:30.033595    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh"
Jun 09 13:33:30.034047 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:30.034020    2562 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"4892fbe67e77d983a07b62673620eb3e8d73380f3751613af477dc36a133c66e"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Jun 09 13:33:30.034082 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:30.034067    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh" podUID="2d5fdccf-3ce6-442e-a058-d31d03969735" containerName="service-proxy" containerID="cri-o://4892fbe67e77d983a07b62673620eb3e8d73380f3751613af477dc36a133c66e" gracePeriod=30
Jun 09 13:33:31.045434 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:31.045399    2562 generic.go:356] "Generic (PLEG): container finished" podID="2d5fdccf-3ce6-442e-a058-d31d03969735" containerID="4892fbe67e77d983a07b62673620eb3e8d73380f3751613af477dc36a133c66e" exitCode=2
Jun 09 13:33:31.045841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:31.045446    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh" event={"ID":"2d5fdccf-3ce6-442e-a058-d31d03969735","Type":"ContainerDied","Data":"4892fbe67e77d983a07b62673620eb3e8d73380f3751613af477dc36a133c66e"}
Jun 09 13:33:31.045841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:31.045479    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-58694965c-vhzqh" event={"ID":"2d5fdccf-3ce6-442e-a058-d31d03969735","Type":"ContainerStarted","Data":"4bead9a608f87049f43eb60b07da83b35f5430dbeeb85d5ebb361375b1eafbc0"}
Jun 09 13:33:31.179043 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:31.179006    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:31.233155 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:31.233126    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:31.632036 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:31.632005    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:31.632181 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:31.632057    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:31.636572 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:31.636550    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:32.052985 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:32.052957    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:33:35.700363 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:35.700312    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:35.700851 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:35.700385    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:35.705181 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:35.705156    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:36.064538 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:36.064462    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:33:36.111164 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:36.111125    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65fdc4dd95-9kb64"]
Jun 09 13:33:36.789985 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:36.789949    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:37.983810 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:37.983780    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:38.037554 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:38.037531    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:39.581954 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:39.581923    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:39.640459 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:39.640425    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:42.038833 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:42.038805    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:42.096842 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:42.096809    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:45.177235 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:45.177198    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:57.045481 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:57.045448    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:33:57.141892 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:33:57.141846    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:01.131467 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.131372    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-65fdc4dd95-9kb64" podUID="452d4749-45ba-485b-8dea-0d430833e754" containerName="console" containerID="cri-o://54ff8d451fc63e26375cb8faefcb23befefc9b177b2f99d0f2229760f701abe3" gracePeriod=15
Jun 09 13:34:01.367260 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.367238    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:34:01.463910 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.463876    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/452d4749-45ba-485b-8dea-0d430833e754-console-oauth-config\") pod \"452d4749-45ba-485b-8dea-0d430833e754\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") "
Jun 09 13:34:01.464093 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.463927    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/452d4749-45ba-485b-8dea-0d430833e754-console-serving-cert\") pod \"452d4749-45ba-485b-8dea-0d430833e754\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") "
Jun 09 13:34:01.464093 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.463976    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-service-ca\") pod \"452d4749-45ba-485b-8dea-0d430833e754\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") "
Jun 09 13:34:01.464093 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.464003    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-742m8\" (UniqueName: \"kubernetes.io/projected/452d4749-45ba-485b-8dea-0d430833e754-kube-api-access-742m8\") pod \"452d4749-45ba-485b-8dea-0d430833e754\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") "
Jun 09 13:34:01.464093 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.464040    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-oauth-serving-cert\") pod \"452d4749-45ba-485b-8dea-0d430833e754\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") "
Jun 09 13:34:01.464093 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.464066    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-console-config\") pod \"452d4749-45ba-485b-8dea-0d430833e754\" (UID: \"452d4749-45ba-485b-8dea-0d430833e754\") "
Jun 09 13:34:01.464406 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.464380    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-service-ca" (OuterVolumeSpecName: "service-ca") pod "452d4749-45ba-485b-8dea-0d430833e754" (UID: "452d4749-45ba-485b-8dea-0d430833e754"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 13:34:01.464517 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.464486    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "452d4749-45ba-485b-8dea-0d430833e754" (UID: "452d4749-45ba-485b-8dea-0d430833e754"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 13:34:01.464582 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.464491    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-console-config" (OuterVolumeSpecName: "console-config") pod "452d4749-45ba-485b-8dea-0d430833e754" (UID: "452d4749-45ba-485b-8dea-0d430833e754"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 13:34:01.466374 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.466350    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/452d4749-45ba-485b-8dea-0d430833e754-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "452d4749-45ba-485b-8dea-0d430833e754" (UID: "452d4749-45ba-485b-8dea-0d430833e754"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 13:34:01.466478 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.466410    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/452d4749-45ba-485b-8dea-0d430833e754-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "452d4749-45ba-485b-8dea-0d430833e754" (UID: "452d4749-45ba-485b-8dea-0d430833e754"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 13:34:01.466478 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.466410    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/452d4749-45ba-485b-8dea-0d430833e754-kube-api-access-742m8" (OuterVolumeSpecName: "kube-api-access-742m8") pod "452d4749-45ba-485b-8dea-0d430833e754" (UID: "452d4749-45ba-485b-8dea-0d430833e754"). InnerVolumeSpecName "kube-api-access-742m8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 13:34:01.564793 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.564756    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/452d4749-45ba-485b-8dea-0d430833e754-console-serving-cert\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:34:01.564793 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.564784    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-service-ca\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:34:01.564793 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.564794    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-742m8\" (UniqueName: \"kubernetes.io/projected/452d4749-45ba-485b-8dea-0d430833e754-kube-api-access-742m8\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:34:01.564793 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.564803    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-oauth-serving-cert\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:34:01.565055 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.564811    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/452d4749-45ba-485b-8dea-0d430833e754-console-config\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:34:01.565055 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:01.564820    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/452d4749-45ba-485b-8dea-0d430833e754-console-oauth-config\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:34:02.147958 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:02.147925    2562 generic.go:356] "Generic (PLEG): container finished" podID="452d4749-45ba-485b-8dea-0d430833e754" containerID="54ff8d451fc63e26375cb8faefcb23befefc9b177b2f99d0f2229760f701abe3" exitCode=0
Jun 09 13:34:02.148410 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:02.147971    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65fdc4dd95-9kb64"
Jun 09 13:34:02.148410 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:02.148011    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fdc4dd95-9kb64" event={"ID":"452d4749-45ba-485b-8dea-0d430833e754","Type":"ContainerDied","Data":"54ff8d451fc63e26375cb8faefcb23befefc9b177b2f99d0f2229760f701abe3"}
Jun 09 13:34:02.148410 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:02.148065    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65fdc4dd95-9kb64" event={"ID":"452d4749-45ba-485b-8dea-0d430833e754","Type":"ContainerDied","Data":"6c50e5c11a05ff88613d79ca5e7ac1e7cfac19a9ceec2c552b22d3b1fa7e0828"}
Jun 09 13:34:02.148410 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:02.148094    2562 scope.go:117] "RemoveContainer" containerID="54ff8d451fc63e26375cb8faefcb23befefc9b177b2f99d0f2229760f701abe3"
Jun 09 13:34:02.156176 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:02.156159    2562 scope.go:117] "RemoveContainer" containerID="54ff8d451fc63e26375cb8faefcb23befefc9b177b2f99d0f2229760f701abe3"
Jun 09 13:34:02.156431 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:34:02.156411    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54ff8d451fc63e26375cb8faefcb23befefc9b177b2f99d0f2229760f701abe3\": container with ID starting with 54ff8d451fc63e26375cb8faefcb23befefc9b177b2f99d0f2229760f701abe3 not found: ID does not exist" containerID="54ff8d451fc63e26375cb8faefcb23befefc9b177b2f99d0f2229760f701abe3"
Jun 09 13:34:02.156488 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:02.156443    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54ff8d451fc63e26375cb8faefcb23befefc9b177b2f99d0f2229760f701abe3"} err="failed to get container status \"54ff8d451fc63e26375cb8faefcb23befefc9b177b2f99d0f2229760f701abe3\": rpc error: code = NotFound desc = could not find container \"54ff8d451fc63e26375cb8faefcb23befefc9b177b2f99d0f2229760f701abe3\": container with ID starting with 54ff8d451fc63e26375cb8faefcb23befefc9b177b2f99d0f2229760f701abe3 not found: ID does not exist"
Jun 09 13:34:02.170846 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:02.170821    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65fdc4dd95-9kb64"]
Jun 09 13:34:02.175648 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:02.175629    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65fdc4dd95-9kb64"]
Jun 09 13:34:03.053431 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:03.053402    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="452d4749-45ba-485b-8dea-0d430833e754" path="/var/lib/kubelet/pods/452d4749-45ba-485b-8dea-0d430833e754/volumes"
Jun 09 13:34:15.419883 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:15.419844    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:15.478543 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:15.478508    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:19.978092 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:19.978062    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64989789db-68ss7"]
Jun 09 13:34:19.978454 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:19.978309    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="452d4749-45ba-485b-8dea-0d430833e754" containerName="console"
Jun 09 13:34:19.978454 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:19.978320    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="452d4749-45ba-485b-8dea-0d430833e754" containerName="console"
Jun 09 13:34:19.978454 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:19.978358    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="452d4749-45ba-485b-8dea-0d430833e754" containerName="console"
Jun 09 13:34:19.983313 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:19.981891    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:19.990905 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:19.990883    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64989789db-68ss7"]
Jun 09 13:34:20.032950 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.032916    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:20.085089 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.085058    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:20.098178 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.098151    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-trusted-ca-bundle\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.098302 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.098183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-config\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.098302 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.098207    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-oauth-serving-cert\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.098422 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.098305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-oauth-config\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.098422 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.098364    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-service-ca\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.098422 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.098402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-serving-cert\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.098535 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.098464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnzmk\" (UniqueName: \"kubernetes.io/projected/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-kube-api-access-bnzmk\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.199530 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.199486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnzmk\" (UniqueName: \"kubernetes.io/projected/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-kube-api-access-bnzmk\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.199530 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.199531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-trusted-ca-bundle\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.199838 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.199551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-config\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.199838 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.199567    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-oauth-serving-cert\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.199838 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.199591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-oauth-config\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.199838 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.199631    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-service-ca\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.199838 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.199664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-serving-cert\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.200452 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.200427    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-trusted-ca-bundle\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.200550 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.200420    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-oauth-serving-cert\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.200591 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.200563    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-config\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.200591 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.200581    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-service-ca\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.202130 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.202114    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-serving-cert\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.202257 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.202239    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-oauth-config\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.209044 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.209016    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnzmk\" (UniqueName: \"kubernetes.io/projected/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-kube-api-access-bnzmk\") pod \"console-64989789db-68ss7\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") " pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.291971 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.291896    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:20.415701 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:20.415670    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64989789db-68ss7"]
Jun 09 13:34:20.418491 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:34:20.418467    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod308ac3cc_a81f_4ea5_a6b0_5baf69e5c2b2.slice/crio-def80b146a41bf3124eb4ca6ebf3400cc3a87fccb868013f603e1d3bb1328b70 WatchSource:0}: Error finding container def80b146a41bf3124eb4ca6ebf3400cc3a87fccb868013f603e1d3bb1328b70: Status 404 returned error can't find the container with id def80b146a41bf3124eb4ca6ebf3400cc3a87fccb868013f603e1d3bb1328b70
Jun 09 13:34:21.213811 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:21.213776    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64989789db-68ss7" event={"ID":"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2","Type":"ContainerStarted","Data":"54bf7fe15ef25e91e9c9930c555494982790c8e6881c68927ae9635a9d9cf592"}
Jun 09 13:34:21.214152 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:21.213835    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64989789db-68ss7" event={"ID":"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2","Type":"ContainerStarted","Data":"def80b146a41bf3124eb4ca6ebf3400cc3a87fccb868013f603e1d3bb1328b70"}
Jun 09 13:34:21.232108 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:21.232065    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64989789db-68ss7" podStartSLOduration=2.232050483 podStartE2EDuration="2.232050483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:34:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:34:21.231384452 +0000 UTC m=+360.606055212" watchObservedRunningTime="2026-06-09 13:34:21.232050483 +0000 UTC m=+360.606721244"
Jun 09 13:34:22.827539 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:22.827501    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:22.880032 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:22.879998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:22.939129 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:22.939082    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:27.241212 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:27.241178    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:27.299267 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:27.299237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:28.630661 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:28.630625    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:28.689804 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:28.689771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:30.292864 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:30.292807    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:30.293237 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:30.292897    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:30.297541 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:30.297513    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:31.252658 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:31.252627    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:34:31.298594 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:31.298564    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5866856597-89wzq"]
Jun 09 13:34:31.418192 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:31.418156    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:31.519149 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:31.519065    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:31.579526 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:31.579495    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:35.012999 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:35.012962    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs\") pod \"network-metrics-daemon-xfldj\" (UID: \"bfb80980-0aa2-49ab-b601-b895816adbb7\") " pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:34:35.015372 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:35.015352    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfb80980-0aa2-49ab-b601-b895816adbb7-metrics-certs\") pod \"network-metrics-daemon-xfldj\" (UID: \"bfb80980-0aa2-49ab-b601-b895816adbb7\") " pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:34:35.053076 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:35.053049    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vwqsn\""
Jun 09 13:34:35.061028 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:35.061008    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xfldj"
Jun 09 13:34:35.187764 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:35.187717    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xfldj"]
Jun 09 13:34:35.190561 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:34:35.190535    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfb80980_0aa2_49ab_b601_b895816adbb7.slice/crio-125404b2c84d265e0970266b87ebab5a948be3b3baa8eca6a6a517ec7bc87af7 WatchSource:0}: Error finding container 125404b2c84d265e0970266b87ebab5a948be3b3baa8eca6a6a517ec7bc87af7: Status 404 returned error can't find the container with id 125404b2c84d265e0970266b87ebab5a948be3b3baa8eca6a6a517ec7bc87af7
Jun 09 13:34:35.192334 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:35.192319    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 09 13:34:35.262710 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:35.262674    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xfldj" event={"ID":"bfb80980-0aa2-49ab-b601-b895816adbb7","Type":"ContainerStarted","Data":"125404b2c84d265e0970266b87ebab5a948be3b3baa8eca6a6a517ec7bc87af7"}
Jun 09 13:34:36.267605 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:36.267518    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xfldj" event={"ID":"bfb80980-0aa2-49ab-b601-b895816adbb7","Type":"ContainerStarted","Data":"56252b81a884dbf49d57885570587d87bb864cb35de84be4a6be8dad3e2988df"}
Jun 09 13:34:36.267605 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:36.267569    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xfldj" event={"ID":"bfb80980-0aa2-49ab-b601-b895816adbb7","Type":"ContainerStarted","Data":"0bca62b9d5c823270175fc235aac19016c76211a1062f1a495733b0d8b73e46a"}
Jun 09 13:34:36.284253 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:36.284201    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xfldj" podStartSLOduration=374.514294749 podStartE2EDuration="6m15.284183181s" totalImagesPullingTime="769.888432ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:34:36.283438261 +0000 UTC m=+375.658109022" watchObservedRunningTime="2026-06-09 13:34:36.284183181 +0000 UTC m=+375.658853943"
Jun 09 13:34:36.375020 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:36.374983    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:36.427277 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:36.427239    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:36.486256 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:36.486231    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:42.058133 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:42.058100    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:42.151789 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:42.151749    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:42.202263 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:42.202221    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:34:56.321971 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.321906    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5866856597-89wzq" podUID="6f8f2d09-0c76-4594-a484-bc3513771d97" containerName="console" containerID="cri-o://e0ca30f9057cc31863e971de8f1bbd85b6a31a91ac4a96d435e5f28480ae6224" gracePeriod=15
Jun 09 13:34:56.561690 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.561669    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:34:56.680062 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.680034    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-console-config\") pod \"6f8f2d09-0c76-4594-a484-bc3513771d97\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") "
Jun 09 13:34:56.680234 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.680068    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-oauth-serving-cert\") pod \"6f8f2d09-0c76-4594-a484-bc3513771d97\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") "
Jun 09 13:34:56.680234 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.680115    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-service-ca\") pod \"6f8f2d09-0c76-4594-a484-bc3513771d97\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") "
Jun 09 13:34:56.680234 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.680135    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-trusted-ca-bundle\") pod \"6f8f2d09-0c76-4594-a484-bc3513771d97\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") "
Jun 09 13:34:56.680234 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.680156    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f8f2d09-0c76-4594-a484-bc3513771d97-console-oauth-config\") pod \"6f8f2d09-0c76-4594-a484-bc3513771d97\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") "
Jun 09 13:34:56.680234 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.680209    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnn5b\" (UniqueName: \"kubernetes.io/projected/6f8f2d09-0c76-4594-a484-bc3513771d97-kube-api-access-dnn5b\") pod \"6f8f2d09-0c76-4594-a484-bc3513771d97\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") "
Jun 09 13:34:56.680482 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.680237    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f8f2d09-0c76-4594-a484-bc3513771d97-console-serving-cert\") pod \"6f8f2d09-0c76-4594-a484-bc3513771d97\" (UID: \"6f8f2d09-0c76-4594-a484-bc3513771d97\") "
Jun 09 13:34:56.680573 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.680542    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-console-config" (OuterVolumeSpecName: "console-config") pod "6f8f2d09-0c76-4594-a484-bc3513771d97" (UID: "6f8f2d09-0c76-4594-a484-bc3513771d97"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 13:34:56.680652 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.680634    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-service-ca" (OuterVolumeSpecName: "service-ca") pod "6f8f2d09-0c76-4594-a484-bc3513771d97" (UID: "6f8f2d09-0c76-4594-a484-bc3513771d97"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 13:34:56.680702 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.680646    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "6f8f2d09-0c76-4594-a484-bc3513771d97" (UID: "6f8f2d09-0c76-4594-a484-bc3513771d97"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 13:34:56.680702 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.680650    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "6f8f2d09-0c76-4594-a484-bc3513771d97" (UID: "6f8f2d09-0c76-4594-a484-bc3513771d97"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 13:34:56.682633 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.682604    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8f2d09-0c76-4594-a484-bc3513771d97-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "6f8f2d09-0c76-4594-a484-bc3513771d97" (UID: "6f8f2d09-0c76-4594-a484-bc3513771d97"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 13:34:56.682821 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.682626    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f8f2d09-0c76-4594-a484-bc3513771d97-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "6f8f2d09-0c76-4594-a484-bc3513771d97" (UID: "6f8f2d09-0c76-4594-a484-bc3513771d97"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 13:34:56.682821 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.682645    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f8f2d09-0c76-4594-a484-bc3513771d97-kube-api-access-dnn5b" (OuterVolumeSpecName: "kube-api-access-dnn5b") pod "6f8f2d09-0c76-4594-a484-bc3513771d97" (UID: "6f8f2d09-0c76-4594-a484-bc3513771d97"). InnerVolumeSpecName "kube-api-access-dnn5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 13:34:56.780715 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.780674    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/6f8f2d09-0c76-4594-a484-bc3513771d97-console-serving-cert\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:34:56.780715 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.780707    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-console-config\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:34:56.780715 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.780721    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-oauth-serving-cert\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:34:56.780994 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.780759    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-service-ca\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:34:56.780994 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.780771    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8f2d09-0c76-4594-a484-bc3513771d97-trusted-ca-bundle\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:34:56.780994 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.780783    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/6f8f2d09-0c76-4594-a484-bc3513771d97-console-oauth-config\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:34:56.780994 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:56.780792    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnn5b\" (UniqueName: \"kubernetes.io/projected/6f8f2d09-0c76-4594-a484-bc3513771d97-kube-api-access-dnn5b\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:34:57.340660 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:57.340574    2562 generic.go:356] "Generic (PLEG): container finished" podID="6f8f2d09-0c76-4594-a484-bc3513771d97" containerID="e0ca30f9057cc31863e971de8f1bbd85b6a31a91ac4a96d435e5f28480ae6224" exitCode=0
Jun 09 13:34:57.340660 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:57.340616    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5866856597-89wzq"
Jun 09 13:34:57.341157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:57.340614    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5866856597-89wzq" event={"ID":"6f8f2d09-0c76-4594-a484-bc3513771d97","Type":"ContainerDied","Data":"e0ca30f9057cc31863e971de8f1bbd85b6a31a91ac4a96d435e5f28480ae6224"}
Jun 09 13:34:57.341157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:57.340770    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5866856597-89wzq" event={"ID":"6f8f2d09-0c76-4594-a484-bc3513771d97","Type":"ContainerDied","Data":"c4516043360a47e8b89855d04c2d4835c90ee182c9efc29ee9558084c2b60746"}
Jun 09 13:34:57.341157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:57.340803    2562 scope.go:117] "RemoveContainer" containerID="e0ca30f9057cc31863e971de8f1bbd85b6a31a91ac4a96d435e5f28480ae6224"
Jun 09 13:34:57.348615 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:57.348594    2562 scope.go:117] "RemoveContainer" containerID="e0ca30f9057cc31863e971de8f1bbd85b6a31a91ac4a96d435e5f28480ae6224"
Jun 09 13:34:57.348901 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:34:57.348881    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0ca30f9057cc31863e971de8f1bbd85b6a31a91ac4a96d435e5f28480ae6224\": container with ID starting with e0ca30f9057cc31863e971de8f1bbd85b6a31a91ac4a96d435e5f28480ae6224 not found: ID does not exist" containerID="e0ca30f9057cc31863e971de8f1bbd85b6a31a91ac4a96d435e5f28480ae6224"
Jun 09 13:34:57.348998 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:57.348907    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0ca30f9057cc31863e971de8f1bbd85b6a31a91ac4a96d435e5f28480ae6224"} err="failed to get container status \"e0ca30f9057cc31863e971de8f1bbd85b6a31a91ac4a96d435e5f28480ae6224\": rpc error: code = NotFound desc = could not find container \"e0ca30f9057cc31863e971de8f1bbd85b6a31a91ac4a96d435e5f28480ae6224\": container with ID starting with e0ca30f9057cc31863e971de8f1bbd85b6a31a91ac4a96d435e5f28480ae6224 not found: ID does not exist"
Jun 09 13:34:57.356915 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:57.356890    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5866856597-89wzq"]
Jun 09 13:34:57.363874 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:57.363856    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5866856597-89wzq"]
Jun 09 13:34:59.054085 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:34:59.054051    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f8f2d09-0c76-4594-a484-bc3513771d97" path="/var/lib/kubelet/pods/6f8f2d09-0c76-4594-a484-bc3513771d97/volumes"
Jun 09 13:35:05.258811 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:05.258761    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:05.342614 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:05.342575    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:17.496478 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:17.496440    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:17.595025 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:17.594995    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:23.263571 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:23.263507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:23.314690 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:23.314637    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:31.863135 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:31.863050    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:32.634676 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:32.634638    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:35.485165 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:35.485102    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:35.585394 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:35.585356    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:36.536529 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:36.536499    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:36.635074 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:36.635038    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:36.776896 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:36.776863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:36.869715 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:36.869637    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:40.261808 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:40.261779    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:40.657660 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:40.657578    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:42.281580 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:42.281537    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:42.381214 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:42.381171    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:46.055486 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:46.055454    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:46.155668 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:46.155629    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:47.857340 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:47.857308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:49.550517 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:49.550484    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:49.651608 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:49.651575    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:51.615124 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:51.615089    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v5bd5"]
Jun 09 13:35:51.615471 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:51.615357    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f8f2d09-0c76-4594-a484-bc3513771d97" containerName="console"
Jun 09 13:35:51.615471 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:51.615369    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f8f2d09-0c76-4594-a484-bc3513771d97" containerName="console"
Jun 09 13:35:51.615471 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:51.615421    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f8f2d09-0c76-4594-a484-bc3513771d97" containerName="console"
Jun 09 13:35:51.618061 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:51.618046    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v5bd5"
Jun 09 13:35:51.620393 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:51.620364    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 09 13:35:51.620542 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:51.620442    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 09 13:35:51.620542 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:51.620488    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bdrt9\""
Jun 09 13:35:51.635653 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:51.635625    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v5bd5"]
Jun 09 13:35:51.657284 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:51.657253    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e90addff-d312-4123-8bb4-83bf3162c63e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v5bd5\" (UID: \"e90addff-d312-4123-8bb4-83bf3162c63e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v5bd5"
Jun 09 13:35:51.657406 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:51.657339    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vjnt\" (UniqueName: \"kubernetes.io/projected/e90addff-d312-4123-8bb4-83bf3162c63e-kube-api-access-6vjnt\") pod \"openshift-lws-operator-fd8ccff4c-v5bd5\" (UID: \"e90addff-d312-4123-8bb4-83bf3162c63e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v5bd5"
Jun 09 13:35:51.758321 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:51.758283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e90addff-d312-4123-8bb4-83bf3162c63e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v5bd5\" (UID: \"e90addff-d312-4123-8bb4-83bf3162c63e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v5bd5"
Jun 09 13:35:51.758464 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:51.758345    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vjnt\" (UniqueName: \"kubernetes.io/projected/e90addff-d312-4123-8bb4-83bf3162c63e-kube-api-access-6vjnt\") pod \"openshift-lws-operator-fd8ccff4c-v5bd5\" (UID: \"e90addff-d312-4123-8bb4-83bf3162c63e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v5bd5"
Jun 09 13:35:51.758654 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:51.758635    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e90addff-d312-4123-8bb4-83bf3162c63e-tmp\") pod \"openshift-lws-operator-fd8ccff4c-v5bd5\" (UID: \"e90addff-d312-4123-8bb4-83bf3162c63e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v5bd5"
Jun 09 13:35:51.767209 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:51.767188    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vjnt\" (UniqueName: \"kubernetes.io/projected/e90addff-d312-4123-8bb4-83bf3162c63e-kube-api-access-6vjnt\") pod \"openshift-lws-operator-fd8ccff4c-v5bd5\" (UID: \"e90addff-d312-4123-8bb4-83bf3162c63e\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v5bd5"
Jun 09 13:35:51.927181 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:51.927089    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v5bd5"
Jun 09 13:35:52.054598 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:52.054568    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v5bd5"]
Jun 09 13:35:52.057470 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:35:52.057448    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode90addff_d312_4123_8bb4_83bf3162c63e.slice/crio-06fb0bd6f47950c6493b8ea1f054ccbbd73d4b6875d47952a3d5ec8057d2a68e WatchSource:0}: Error finding container 06fb0bd6f47950c6493b8ea1f054ccbbd73d4b6875d47952a3d5ec8057d2a68e: Status 404 returned error can't find the container with id 06fb0bd6f47950c6493b8ea1f054ccbbd73d4b6875d47952a3d5ec8057d2a68e
Jun 09 13:35:52.536580 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:52.536544    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v5bd5" event={"ID":"e90addff-d312-4123-8bb4-83bf3162c63e","Type":"ContainerStarted","Data":"06fb0bd6f47950c6493b8ea1f054ccbbd73d4b6875d47952a3d5ec8057d2a68e"}
Jun 09 13:35:55.551475 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:55.551436    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v5bd5" event={"ID":"e90addff-d312-4123-8bb4-83bf3162c63e","Type":"ContainerStarted","Data":"8a277c57a04e318c2df22ccf089ddf54c2a0ce77baff516375cc1e1f1d2fb86a"}
Jun 09 13:35:55.568087 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:55.568032    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-v5bd5" podStartSLOduration=1.8893666329999999 podStartE2EDuration="4.56801377s" totalImagesPullingTime="2.678647137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:35:55.566595142 +0000 UTC m=+454.941265903" watchObservedRunningTime="2026-06-09 13:35:55.56801377 +0000 UTC m=+454.942684533"
Jun 09 13:35:56.186602 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:56.186550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:56.284277 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:56.284243    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:35:57.915610 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:35:57.915574    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:13.709693 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:13.709658    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:13.818621 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:13.818585    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:14.318526 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.318489    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:14.528463 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.528422    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:14.634081 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.633990    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:14.669210 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.669179    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"]
Jun 09 13:36:14.672280 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.672264    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:14.674825 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.674802    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 09 13:36:14.674953 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.674927    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 09 13:36:14.675017 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.674929    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 09 13:36:14.675017 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.674934    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9m7tj\""
Jun 09 13:36:14.675090 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.674934    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 09 13:36:14.687238 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.687216    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"]
Jun 09 13:36:14.734209 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.734177    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60ac188a-d51c-45d8-a5ce-f370385404dc-tmp\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-gh7ks\" (UID: \"60ac188a-d51c-45d8-a5ce-f370385404dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:14.734209 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.734210    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/60ac188a-d51c-45d8-a5ce-f370385404dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-gh7ks\" (UID: \"60ac188a-d51c-45d8-a5ce-f370385404dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:14.734608 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.734236    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/60ac188a-d51c-45d8-a5ce-f370385404dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-gh7ks\" (UID: \"60ac188a-d51c-45d8-a5ce-f370385404dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:14.734608 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.734305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/60ac188a-d51c-45d8-a5ce-f370385404dc-manifests\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-gh7ks\" (UID: \"60ac188a-d51c-45d8-a5ce-f370385404dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:14.734608 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.734333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwqfq\" (UniqueName: \"kubernetes.io/projected/60ac188a-d51c-45d8-a5ce-f370385404dc-kube-api-access-nwqfq\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-gh7ks\" (UID: \"60ac188a-d51c-45d8-a5ce-f370385404dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:14.799225 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.799191    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:14.835402 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.835360    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60ac188a-d51c-45d8-a5ce-f370385404dc-tmp\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-gh7ks\" (UID: \"60ac188a-d51c-45d8-a5ce-f370385404dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:14.835402 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.835408    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/60ac188a-d51c-45d8-a5ce-f370385404dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-gh7ks\" (UID: \"60ac188a-d51c-45d8-a5ce-f370385404dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:14.835588 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.835436    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/60ac188a-d51c-45d8-a5ce-f370385404dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-gh7ks\" (UID: \"60ac188a-d51c-45d8-a5ce-f370385404dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:14.835588 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.835470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/60ac188a-d51c-45d8-a5ce-f370385404dc-manifests\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-gh7ks\" (UID: \"60ac188a-d51c-45d8-a5ce-f370385404dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:14.835588 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.835504    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwqfq\" (UniqueName: \"kubernetes.io/projected/60ac188a-d51c-45d8-a5ce-f370385404dc-kube-api-access-nwqfq\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-gh7ks\" (UID: \"60ac188a-d51c-45d8-a5ce-f370385404dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:14.835949 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.835921    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/60ac188a-d51c-45d8-a5ce-f370385404dc-manifests\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-gh7ks\" (UID: \"60ac188a-d51c-45d8-a5ce-f370385404dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:14.837873 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.837856    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60ac188a-d51c-45d8-a5ce-f370385404dc-tmp\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-gh7ks\" (UID: \"60ac188a-d51c-45d8-a5ce-f370385404dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:14.838185 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.838166    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/60ac188a-d51c-45d8-a5ce-f370385404dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-gh7ks\" (UID: \"60ac188a-d51c-45d8-a5ce-f370385404dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:14.838228 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.838166    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/60ac188a-d51c-45d8-a5ce-f370385404dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-gh7ks\" (UID: \"60ac188a-d51c-45d8-a5ce-f370385404dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:14.843469 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.843443    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwqfq\" (UniqueName: \"kubernetes.io/projected/60ac188a-d51c-45d8-a5ce-f370385404dc-kube-api-access-nwqfq\") pod \"opendatahub-operator-controller-manager-5cc7576fb9-gh7ks\" (UID: \"60ac188a-d51c-45d8-a5ce-f370385404dc\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:14.900023 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.899945    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:14.982576 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:14.982534    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:15.001313 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:15.001285    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:15.102412 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:15.102383    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:15.114652 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:15.114627    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"]
Jun 09 13:36:15.117717 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:36:15.117689    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60ac188a_d51c_45d8_a5ce_f370385404dc.slice/crio-f4a785e138d237eb61d6f04794cbc1a2f92a292f024ca0b345bab07f4889b62d WatchSource:0}: Error finding container f4a785e138d237eb61d6f04794cbc1a2f92a292f024ca0b345bab07f4889b62d: Status 404 returned error can't find the container with id f4a785e138d237eb61d6f04794cbc1a2f92a292f024ca0b345bab07f4889b62d
Jun 09 13:36:15.210632 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:15.210600    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:15.624083 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:15.624004    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks" event={"ID":"60ac188a-d51c-45d8-a5ce-f370385404dc","Type":"ContainerStarted","Data":"f4a785e138d237eb61d6f04794cbc1a2f92a292f024ca0b345bab07f4889b62d"}
Jun 09 13:36:18.636696 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:18.636607    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks" event={"ID":"60ac188a-d51c-45d8-a5ce-f370385404dc","Type":"ContainerStarted","Data":"07a80afd6b51edb7eaadd84a1f848dc7c95000c7380ae39f344a054dfd6f0159"}
Jun 09 13:36:19.641224 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:19.641142    2562 generic.go:356] "Generic (PLEG): container finished" podID="60ac188a-d51c-45d8-a5ce-f370385404dc" containerID="07a80afd6b51edb7eaadd84a1f848dc7c95000c7380ae39f344a054dfd6f0159" exitCode=0
Jun 09 13:36:19.641591 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:19.641228    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks" event={"ID":"60ac188a-d51c-45d8-a5ce-f370385404dc","Type":"ContainerDied","Data":"07a80afd6b51edb7eaadd84a1f848dc7c95000c7380ae39f344a054dfd6f0159"}
Jun 09 13:36:20.647179 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:20.647140    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks" event={"ID":"60ac188a-d51c-45d8-a5ce-f370385404dc","Type":"ContainerStarted","Data":"a847a8ca71823bd36d39ac76430d7b8c622bc44bed583396c0a261674e9f3a3f"}
Jun 09 13:36:20.647545 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:20.647244    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:20.668316 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:20.668270    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks" podStartSLOduration=2.341895405 podStartE2EDuration="6.668250212s" totalImagesPullingTime="3.393948465s" totalInitContainerRuntime="932.406342ms" isStatefulPod=false podCreationTimestamp="2026-06-09 13:36:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:36:20.666997671 +0000 UTC m=+480.041668431" watchObservedRunningTime="2026-06-09 13:36:20.668250212 +0000 UTC m=+480.042921037"
Jun 09 13:36:23.078875 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:23.078844    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:23.183804 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:23.183769    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:31.653277 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:31.653246    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cc7576fb9-gh7ks"
Jun 09 13:36:33.450621 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.450549    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:33.598576 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.598524    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:33.717509 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.717399    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:33.741123 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.741088    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7574fdcd4f-d6nnk"]
Jun 09 13:36:33.744113 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.744093    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7574fdcd4f-d6nnk"
Jun 09 13:36:33.746578 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.746557    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 09 13:36:33.746692 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.746558    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jun 09 13:36:33.746857 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.746842    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jun 09 13:36:33.747115 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.747101    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 09 13:36:33.759489 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.759463    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7574fdcd4f-d6nnk"]
Jun 09 13:36:33.844078 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.844044    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:33.889742 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.889711    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62ct2\" (UniqueName: \"kubernetes.io/projected/2f247be5-4587-44a5-9318-9f55769d9013-kube-api-access-62ct2\") pod \"kube-auth-proxy-7574fdcd4f-d6nnk\" (UID: \"2f247be5-4587-44a5-9318-9f55769d9013\") " pod="openshift-ingress/kube-auth-proxy-7574fdcd4f-d6nnk"
Jun 09 13:36:33.889858 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.889771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f247be5-4587-44a5-9318-9f55769d9013-tls-certs\") pod \"kube-auth-proxy-7574fdcd4f-d6nnk\" (UID: \"2f247be5-4587-44a5-9318-9f55769d9013\") " pod="openshift-ingress/kube-auth-proxy-7574fdcd4f-d6nnk"
Jun 09 13:36:33.889858 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.889790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f247be5-4587-44a5-9318-9f55769d9013-tmp\") pod \"kube-auth-proxy-7574fdcd4f-d6nnk\" (UID: \"2f247be5-4587-44a5-9318-9f55769d9013\") " pod="openshift-ingress/kube-auth-proxy-7574fdcd4f-d6nnk"
Jun 09 13:36:33.931409 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.931382    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:33.991089 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.991012    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62ct2\" (UniqueName: \"kubernetes.io/projected/2f247be5-4587-44a5-9318-9f55769d9013-kube-api-access-62ct2\") pod \"kube-auth-proxy-7574fdcd4f-d6nnk\" (UID: \"2f247be5-4587-44a5-9318-9f55769d9013\") " pod="openshift-ingress/kube-auth-proxy-7574fdcd4f-d6nnk"
Jun 09 13:36:33.991089 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.991068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f247be5-4587-44a5-9318-9f55769d9013-tls-certs\") pod \"kube-auth-proxy-7574fdcd4f-d6nnk\" (UID: \"2f247be5-4587-44a5-9318-9f55769d9013\") " pod="openshift-ingress/kube-auth-proxy-7574fdcd4f-d6nnk"
Jun 09 13:36:33.991252 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.991180    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f247be5-4587-44a5-9318-9f55769d9013-tmp\") pod \"kube-auth-proxy-7574fdcd4f-d6nnk\" (UID: \"2f247be5-4587-44a5-9318-9f55769d9013\") " pod="openshift-ingress/kube-auth-proxy-7574fdcd4f-d6nnk"
Jun 09 13:36:33.993538 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.993507    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f247be5-4587-44a5-9318-9f55769d9013-tmp\") pod \"kube-auth-proxy-7574fdcd4f-d6nnk\" (UID: \"2f247be5-4587-44a5-9318-9f55769d9013\") " pod="openshift-ingress/kube-auth-proxy-7574fdcd4f-d6nnk"
Jun 09 13:36:33.993687 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:33.993673    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2f247be5-4587-44a5-9318-9f55769d9013-tls-certs\") pod \"kube-auth-proxy-7574fdcd4f-d6nnk\" (UID: \"2f247be5-4587-44a5-9318-9f55769d9013\") " pod="openshift-ingress/kube-auth-proxy-7574fdcd4f-d6nnk"
Jun 09 13:36:34.000472 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.000452    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62ct2\" (UniqueName: \"kubernetes.io/projected/2f247be5-4587-44a5-9318-9f55769d9013-kube-api-access-62ct2\") pod \"kube-auth-proxy-7574fdcd4f-d6nnk\" (UID: \"2f247be5-4587-44a5-9318-9f55769d9013\") " pod="openshift-ingress/kube-auth-proxy-7574fdcd4f-d6nnk"
Jun 09 13:36:34.054521 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.054475    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7574fdcd4f-d6nnk"
Jun 09 13:36:34.181703 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.181679    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7574fdcd4f-d6nnk"]
Jun 09 13:36:34.184207 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:36:34.184183    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f247be5_4587_44a5_9318_9f55769d9013.slice/crio-89bf5ac0211fa5d855d878570c26cea9b4a187d3180a8d958bb46b09a429bbb4 WatchSource:0}: Error finding container 89bf5ac0211fa5d855d878570c26cea9b4a187d3180a8d958bb46b09a429bbb4: Status 404 returned error can't find the container with id 89bf5ac0211fa5d855d878570c26cea9b4a187d3180a8d958bb46b09a429bbb4
Jun 09 13:36:34.246788 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.246714    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-7krd5"]
Jun 09 13:36:34.250705 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.250691    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-7krd5"
Jun 09 13:36:34.253861 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.253836    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-2vbzd\""
Jun 09 13:36:34.254017 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.253997    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jun 09 13:36:34.265385 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.265364    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-7krd5"]
Jun 09 13:36:34.304391 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.304357    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:34.393696 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.393665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqwpr\" (UniqueName: \"kubernetes.io/projected/6370712b-6124-4b6a-951b-041067e08438-kube-api-access-kqwpr\") pod \"odh-model-controller-6dc94f689f-7krd5\" (UID: \"6370712b-6124-4b6a-951b-041067e08438\") " pod="opendatahub/odh-model-controller-6dc94f689f-7krd5"
Jun 09 13:36:34.393862 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.393702    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6370712b-6124-4b6a-951b-041067e08438-cert\") pod \"odh-model-controller-6dc94f689f-7krd5\" (UID: \"6370712b-6124-4b6a-951b-041067e08438\") " pod="opendatahub/odh-model-controller-6dc94f689f-7krd5"
Jun 09 13:36:34.404997 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.404972    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:34.494277 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.494235    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqwpr\" (UniqueName: \"kubernetes.io/projected/6370712b-6124-4b6a-951b-041067e08438-kube-api-access-kqwpr\") pod \"odh-model-controller-6dc94f689f-7krd5\" (UID: \"6370712b-6124-4b6a-951b-041067e08438\") " pod="opendatahub/odh-model-controller-6dc94f689f-7krd5"
Jun 09 13:36:34.494688 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.494286    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6370712b-6124-4b6a-951b-041067e08438-cert\") pod \"odh-model-controller-6dc94f689f-7krd5\" (UID: \"6370712b-6124-4b6a-951b-041067e08438\") " pod="opendatahub/odh-model-controller-6dc94f689f-7krd5"
Jun 09 13:36:34.494688 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:36:34.494383    2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jun 09 13:36:34.494688 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:36:34.494448    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6370712b-6124-4b6a-951b-041067e08438-cert podName:6370712b-6124-4b6a-951b-041067e08438 nodeName:}" failed. No retries permitted until 2026-06-09 13:36:34.994427184 +0000 UTC m=+494.369097922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/6370712b-6124-4b6a-951b-041067e08438-cert") pod "odh-model-controller-6dc94f689f-7krd5" (UID: "6370712b-6124-4b6a-951b-041067e08438") : secret "odh-model-controller-webhook-cert" not found
Jun 09 13:36:34.503918 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.503831    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:34.509401 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.509376    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqwpr\" (UniqueName: \"kubernetes.io/projected/6370712b-6124-4b6a-951b-041067e08438-kube-api-access-kqwpr\") pod \"odh-model-controller-6dc94f689f-7krd5\" (UID: \"6370712b-6124-4b6a-951b-041067e08438\") " pod="opendatahub/odh-model-controller-6dc94f689f-7krd5"
Jun 09 13:36:34.610346 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.610292    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:34.701760 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.701713    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7574fdcd4f-d6nnk" event={"ID":"2f247be5-4587-44a5-9318-9f55769d9013","Type":"ContainerStarted","Data":"89bf5ac0211fa5d855d878570c26cea9b4a187d3180a8d958bb46b09a429bbb4"}
Jun 09 13:36:34.817968 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.817882    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-2d4hc"]
Jun 09 13:36:34.820975 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.820954    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-2d4hc"
Jun 09 13:36:34.822948 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.822931    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jun 09 13:36:34.825200 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.825172    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:34.830038 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.830015    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-2d4hc"]
Jun 09 13:36:34.998534 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.998504    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcf0d7c3-623d-4820-9b35-0dcea992edc3-tls-certs\") pod \"model-serving-api-5dd488fc48-2d4hc\" (UID: \"bcf0d7c3-623d-4820-9b35-0dcea992edc3\") " pod="opendatahub/model-serving-api-5dd488fc48-2d4hc"
Jun 09 13:36:34.998706 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.998559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blwn2\" (UniqueName: \"kubernetes.io/projected/bcf0d7c3-623d-4820-9b35-0dcea992edc3-kube-api-access-blwn2\") pod \"model-serving-api-5dd488fc48-2d4hc\" (UID: \"bcf0d7c3-623d-4820-9b35-0dcea992edc3\") " pod="opendatahub/model-serving-api-5dd488fc48-2d4hc"
Jun 09 13:36:34.998706 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:34.998636    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6370712b-6124-4b6a-951b-041067e08438-cert\") pod \"odh-model-controller-6dc94f689f-7krd5\" (UID: \"6370712b-6124-4b6a-951b-041067e08438\") " pod="opendatahub/odh-model-controller-6dc94f689f-7krd5"
Jun 09 13:36:35.001212 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:35.001190    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6370712b-6124-4b6a-951b-041067e08438-cert\") pod \"odh-model-controller-6dc94f689f-7krd5\" (UID: \"6370712b-6124-4b6a-951b-041067e08438\") " pod="opendatahub/odh-model-controller-6dc94f689f-7krd5"
Jun 09 13:36:35.099410 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:35.099325    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcf0d7c3-623d-4820-9b35-0dcea992edc3-tls-certs\") pod \"model-serving-api-5dd488fc48-2d4hc\" (UID: \"bcf0d7c3-623d-4820-9b35-0dcea992edc3\") " pod="opendatahub/model-serving-api-5dd488fc48-2d4hc"
Jun 09 13:36:35.099410 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:35.099380    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blwn2\" (UniqueName: \"kubernetes.io/projected/bcf0d7c3-623d-4820-9b35-0dcea992edc3-kube-api-access-blwn2\") pod \"model-serving-api-5dd488fc48-2d4hc\" (UID: \"bcf0d7c3-623d-4820-9b35-0dcea992edc3\") " pod="opendatahub/model-serving-api-5dd488fc48-2d4hc"
Jun 09 13:36:35.099616 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:36:35.099498    2562 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jun 09 13:36:35.099616 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:36:35.099600    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf0d7c3-623d-4820-9b35-0dcea992edc3-tls-certs podName:bcf0d7c3-623d-4820-9b35-0dcea992edc3 nodeName:}" failed. No retries permitted until 2026-06-09 13:36:35.599548851 +0000 UTC m=+494.974219605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bcf0d7c3-623d-4820-9b35-0dcea992edc3-tls-certs") pod "model-serving-api-5dd488fc48-2d4hc" (UID: "bcf0d7c3-623d-4820-9b35-0dcea992edc3") : secret "model-serving-api-tls" not found
Jun 09 13:36:35.110825 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:35.110784    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-blwn2\" (UniqueName: \"kubernetes.io/projected/bcf0d7c3-623d-4820-9b35-0dcea992edc3-kube-api-access-blwn2\") pod \"model-serving-api-5dd488fc48-2d4hc\" (UID: \"bcf0d7c3-623d-4820-9b35-0dcea992edc3\") " pod="opendatahub/model-serving-api-5dd488fc48-2d4hc"
Jun 09 13:36:35.160926 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:35.160897    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-7krd5"
Jun 09 13:36:35.175961 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:35.175928    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:35.321928 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:35.321755    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-7krd5"]
Jun 09 13:36:35.325008 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:36:35.324980    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6370712b_6124_4b6a_951b_041067e08438.slice/crio-330faf16cd015a0fd48aac9d04483c7fa726c4e971c5f6376d6cd26906217df6 WatchSource:0}: Error finding container 330faf16cd015a0fd48aac9d04483c7fa726c4e971c5f6376d6cd26906217df6: Status 404 returned error can't find the container with id 330faf16cd015a0fd48aac9d04483c7fa726c4e971c5f6376d6cd26906217df6
Jun 09 13:36:35.603785 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:35.603754    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcf0d7c3-623d-4820-9b35-0dcea992edc3-tls-certs\") pod \"model-serving-api-5dd488fc48-2d4hc\" (UID: \"bcf0d7c3-623d-4820-9b35-0dcea992edc3\") " pod="opendatahub/model-serving-api-5dd488fc48-2d4hc"
Jun 09 13:36:35.607024 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:35.606997    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bcf0d7c3-623d-4820-9b35-0dcea992edc3-tls-certs\") pod \"model-serving-api-5dd488fc48-2d4hc\" (UID: \"bcf0d7c3-623d-4820-9b35-0dcea992edc3\") " pod="opendatahub/model-serving-api-5dd488fc48-2d4hc"
Jun 09 13:36:35.707432 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:35.707395    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-7krd5" event={"ID":"6370712b-6124-4b6a-951b-041067e08438","Type":"ContainerStarted","Data":"330faf16cd015a0fd48aac9d04483c7fa726c4e971c5f6376d6cd26906217df6"}
Jun 09 13:36:35.731637 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:35.731598    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-2d4hc"
Jun 09 13:36:35.875654 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:35.875572    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-2d4hc"]
Jun 09 13:36:36.614547 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:36:36.614515    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf0d7c3_623d_4820_9b35_0dcea992edc3.slice/crio-979260575e21d55a0952581520b9b8285245cfad06b157a357791369203ddcff WatchSource:0}: Error finding container 979260575e21d55a0952581520b9b8285245cfad06b157a357791369203ddcff: Status 404 returned error can't find the container with id 979260575e21d55a0952581520b9b8285245cfad06b157a357791369203ddcff
Jun 09 13:36:36.713489 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:36.713451    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-2d4hc" event={"ID":"bcf0d7c3-623d-4820-9b35-0dcea992edc3","Type":"ContainerStarted","Data":"979260575e21d55a0952581520b9b8285245cfad06b157a357791369203ddcff"}
Jun 09 13:36:37.721387 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:37.721291    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7574fdcd4f-d6nnk" event={"ID":"2f247be5-4587-44a5-9318-9f55769d9013","Type":"ContainerStarted","Data":"abc8d8d410e2854c955ba2c123ec3e1c9709b8a857f839f66d1effd93057bf72"}
Jun 09 13:36:37.738239 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:37.738183    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7574fdcd4f-d6nnk" podStartSLOduration=1.493673365 podStartE2EDuration="4.738161918s" totalImagesPullingTime="3.244488553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:36:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:36:37.73712069 +0000 UTC m=+497.111791453" watchObservedRunningTime="2026-06-09 13:36:37.738161918 +0000 UTC m=+497.112832683"
Jun 09 13:36:39.732146 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:39.732110    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-7krd5" event={"ID":"6370712b-6124-4b6a-951b-041067e08438","Type":"ContainerStarted","Data":"ee09286b56fd619f57b8d7e2e37034a075e8dd11df74fc95ff52afabc72c2375"}
Jun 09 13:36:39.732611 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:39.732233    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-7krd5"
Jun 09 13:36:39.733794 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:39.733769    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-2d4hc" event={"ID":"bcf0d7c3-623d-4820-9b35-0dcea992edc3","Type":"ContainerStarted","Data":"de389930f8adb5cb8fa283a184a48251e972535ed2fc5828c6f2875cfd5259f1"}
Jun 09 13:36:39.733896 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:39.733880    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-2d4hc"
Jun 09 13:36:39.749093 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:39.749050    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-7krd5" podStartSLOduration=1.692699511 podStartE2EDuration="5.749036258s" totalImagesPullingTime="4.056336747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:36:39.747364262 +0000 UTC m=+499.122035024" watchObservedRunningTime="2026-06-09 13:36:39.749036258 +0000 UTC m=+499.123707018"
Jun 09 13:36:39.762277 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:39.762236    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-2d4hc" podStartSLOduration=2.9982751309999998 podStartE2EDuration="5.762223287s" totalImagesPullingTime="2.763948156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:36:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:36:39.761529413 +0000 UTC m=+499.136200174" watchObservedRunningTime="2026-06-09 13:36:39.762223287 +0000 UTC m=+499.136894048"
Jun 09 13:36:41.693002 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.692963    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"]
Jun 09 13:36:41.696351 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.696330    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"
Jun 09 13:36:41.698546 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.698526    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jun 09 13:36:41.699453 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.699434    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jun 09 13:36:41.699557 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.699473    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jun 09 13:36:41.699557 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.699500    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xhfqg\""
Jun 09 13:36:41.707806 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.707786    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"]
Jun 09 13:36:41.757514 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.757483    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqwws\" (UniqueName: \"kubernetes.io/projected/94e25e38-3229-4a6c-9eaa-440cb78cfd0d-kube-api-access-qqwws\") pod \"lws-controller-manager-855cb6f887-qdxf4\" (UID: \"94e25e38-3229-4a6c-9eaa-440cb78cfd0d\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"
Jun 09 13:36:41.757672 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.757525    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/94e25e38-3229-4a6c-9eaa-440cb78cfd0d-metrics-cert\") pod \"lws-controller-manager-855cb6f887-qdxf4\" (UID: \"94e25e38-3229-4a6c-9eaa-440cb78cfd0d\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"
Jun 09 13:36:41.757672 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.757551    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/94e25e38-3229-4a6c-9eaa-440cb78cfd0d-manager-config\") pod \"lws-controller-manager-855cb6f887-qdxf4\" (UID: \"94e25e38-3229-4a6c-9eaa-440cb78cfd0d\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"
Jun 09 13:36:41.757672 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.757632    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94e25e38-3229-4a6c-9eaa-440cb78cfd0d-cert\") pod \"lws-controller-manager-855cb6f887-qdxf4\" (UID: \"94e25e38-3229-4a6c-9eaa-440cb78cfd0d\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"
Jun 09 13:36:41.858542 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.858501    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqwws\" (UniqueName: \"kubernetes.io/projected/94e25e38-3229-4a6c-9eaa-440cb78cfd0d-kube-api-access-qqwws\") pod \"lws-controller-manager-855cb6f887-qdxf4\" (UID: \"94e25e38-3229-4a6c-9eaa-440cb78cfd0d\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"
Jun 09 13:36:41.858542 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.858555    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/94e25e38-3229-4a6c-9eaa-440cb78cfd0d-metrics-cert\") pod \"lws-controller-manager-855cb6f887-qdxf4\" (UID: \"94e25e38-3229-4a6c-9eaa-440cb78cfd0d\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"
Jun 09 13:36:41.858771 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.858665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/94e25e38-3229-4a6c-9eaa-440cb78cfd0d-manager-config\") pod \"lws-controller-manager-855cb6f887-qdxf4\" (UID: \"94e25e38-3229-4a6c-9eaa-440cb78cfd0d\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"
Jun 09 13:36:41.858771 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.858704    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94e25e38-3229-4a6c-9eaa-440cb78cfd0d-cert\") pod \"lws-controller-manager-855cb6f887-qdxf4\" (UID: \"94e25e38-3229-4a6c-9eaa-440cb78cfd0d\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"
Jun 09 13:36:41.859340 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.859258    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/94e25e38-3229-4a6c-9eaa-440cb78cfd0d-manager-config\") pod \"lws-controller-manager-855cb6f887-qdxf4\" (UID: \"94e25e38-3229-4a6c-9eaa-440cb78cfd0d\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"
Jun 09 13:36:41.861106 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.861084    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/94e25e38-3229-4a6c-9eaa-440cb78cfd0d-cert\") pod \"lws-controller-manager-855cb6f887-qdxf4\" (UID: \"94e25e38-3229-4a6c-9eaa-440cb78cfd0d\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"
Jun 09 13:36:41.861215 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.861198    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/94e25e38-3229-4a6c-9eaa-440cb78cfd0d-metrics-cert\") pod \"lws-controller-manager-855cb6f887-qdxf4\" (UID: \"94e25e38-3229-4a6c-9eaa-440cb78cfd0d\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"
Jun 09 13:36:41.867485 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:41.867461    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqwws\" (UniqueName: \"kubernetes.io/projected/94e25e38-3229-4a6c-9eaa-440cb78cfd0d-kube-api-access-qqwws\") pod \"lws-controller-manager-855cb6f887-qdxf4\" (UID: \"94e25e38-3229-4a6c-9eaa-440cb78cfd0d\") " pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"
Jun 09 13:36:42.005800 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:42.005690    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"
Jun 09 13:36:42.137239 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:42.137145    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"]
Jun 09 13:36:42.139977 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:36:42.139945    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e25e38_3229_4a6c_9eaa_440cb78cfd0d.slice/crio-ff8184e93f78d5cdbd940f4bc7d391cca836350b56feac73b9b2e76392dad788 WatchSource:0}: Error finding container ff8184e93f78d5cdbd940f4bc7d391cca836350b56feac73b9b2e76392dad788: Status 404 returned error can't find the container with id ff8184e93f78d5cdbd940f4bc7d391cca836350b56feac73b9b2e76392dad788
Jun 09 13:36:42.747009 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:42.746970    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4" event={"ID":"94e25e38-3229-4a6c-9eaa-440cb78cfd0d","Type":"ContainerStarted","Data":"ff8184e93f78d5cdbd940f4bc7d391cca836350b56feac73b9b2e76392dad788"}
Jun 09 13:36:43.103539 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:43.103465    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:43.203962 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:43.203919    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:44.011411 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:44.011367    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:44.101122 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:44.101090    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:44.302417 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:44.302326    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:44.701642 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:44.701615    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:44.756722 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:44.756687    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4" event={"ID":"94e25e38-3229-4a6c-9eaa-440cb78cfd0d","Type":"ContainerStarted","Data":"9424517e3152890bf5e436fb034913bd717455289554e852699707889c201bdd"}
Jun 09 13:36:44.756931 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:44.756910    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"
Jun 09 13:36:44.773590 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:44.773537    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4" podStartSLOduration=1.812858978 podStartE2EDuration="3.773523841s" totalImagesPullingTime="1.960664863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:36:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:36:44.772464427 +0000 UTC m=+504.147135190" watchObservedRunningTime="2026-06-09 13:36:44.773523841 +0000 UTC m=+504.148194602"
Jun 09 13:36:45.273372 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:45.273339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:45.373706 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:45.373673    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:45.436070 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:45.436043    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:46.210705 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:46.210639    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:50.740480 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:50.740446    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-7krd5"
Jun 09 13:36:50.742613 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:50.742591    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-2d4hc"
Jun 09 13:36:55.762076 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:55.762044    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-855cb6f887-qdxf4"
Jun 09 13:36:56.308849 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:56.308813    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:56.406578 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:56.406540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:57.318050 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:57.318017    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:57.562722 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:57.562688    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:57.696606 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:57.696582    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:58.621948 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:58.621893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:36:58.736655 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:36:58.736621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:00.258831 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:00.258709    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:02.303674 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:02.303633    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:02.406141 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:02.406107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:04.194098 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:04.194061    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:09.960544 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:09.960506    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:10.058697 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:10.058663    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:18.441872 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:18.441840    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:18.543003 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:18.542972    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:24.620871 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:24.620837    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:24.717592 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:24.717556    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:25.191749 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:25.191681    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:28.616938 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:28.616905    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:28.670765 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:28.670716    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:28.930962 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:28.930932    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:29.173305 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:29.173271    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:29.294546 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:29.294463    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:30.145769 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:30.145708    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:34.430813 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:34.430775    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:35.103876 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:35.103837    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:35.201235 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:35.201193    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:35.300620 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:35.300585    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:36.013935 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:36.013899    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:36.221226 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:36.221191    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:40.381836 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:40.381802    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:37:58.266120 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:37:58.266080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:02.263740 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:02.263709    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:05.045949 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:05.045911    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:07.100523 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:07.100489    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:08.311182 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:08.311137    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:09.463198 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:09.463168    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:10.065143 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:10.065111    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:10.312547 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:10.312507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:12.910602 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:12.910567    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:14.681993 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:14.681952    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:14.782706 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:14.782675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:16.693947 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:16.693916    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:16.791638 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:16.791605    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:21.096678 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.096649    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hch5t"]
Jun 09 13:38:21.099927 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.099912    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hch5t"
Jun 09 13:38:21.102138 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.102111    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jun 09 13:38:21.102253 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.102217    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jun 09 13:38:21.102358 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.102344    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 09 13:38:21.102439 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.102424    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 09 13:38:21.103296 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.103272    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hjv4d\""
Jun 09 13:38:21.107654 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.107629    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:21.107877 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.107852    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hch5t"]
Jun 09 13:38:21.261094 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.261065    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cef9b5d8-6ee5-4213-bb52-12f01a7bdba8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hch5t\" (UID: \"cef9b5d8-6ee5-4213-bb52-12f01a7bdba8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hch5t"
Jun 09 13:38:21.261257 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.261104    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cef9b5d8-6ee5-4213-bb52-12f01a7bdba8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hch5t\" (UID: \"cef9b5d8-6ee5-4213-bb52-12f01a7bdba8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hch5t"
Jun 09 13:38:21.261257 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.261124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk6vm\" (UniqueName: \"kubernetes.io/projected/cef9b5d8-6ee5-4213-bb52-12f01a7bdba8-kube-api-access-tk6vm\") pod \"kuadrant-console-plugin-66b5774985-hch5t\" (UID: \"cef9b5d8-6ee5-4213-bb52-12f01a7bdba8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hch5t"
Jun 09 13:38:21.319436 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.319325    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:21.362551 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.362474    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cef9b5d8-6ee5-4213-bb52-12f01a7bdba8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hch5t\" (UID: \"cef9b5d8-6ee5-4213-bb52-12f01a7bdba8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hch5t"
Jun 09 13:38:21.362551 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.362517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cef9b5d8-6ee5-4213-bb52-12f01a7bdba8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hch5t\" (UID: \"cef9b5d8-6ee5-4213-bb52-12f01a7bdba8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hch5t"
Jun 09 13:38:21.362551 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.362536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk6vm\" (UniqueName: \"kubernetes.io/projected/cef9b5d8-6ee5-4213-bb52-12f01a7bdba8-kube-api-access-tk6vm\") pod \"kuadrant-console-plugin-66b5774985-hch5t\" (UID: \"cef9b5d8-6ee5-4213-bb52-12f01a7bdba8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hch5t"
Jun 09 13:38:21.363193 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.363168    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cef9b5d8-6ee5-4213-bb52-12f01a7bdba8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-hch5t\" (UID: \"cef9b5d8-6ee5-4213-bb52-12f01a7bdba8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hch5t"
Jun 09 13:38:21.365165 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.365147    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/cef9b5d8-6ee5-4213-bb52-12f01a7bdba8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-hch5t\" (UID: \"cef9b5d8-6ee5-4213-bb52-12f01a7bdba8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hch5t"
Jun 09 13:38:21.372098 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.372078    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk6vm\" (UniqueName: \"kubernetes.io/projected/cef9b5d8-6ee5-4213-bb52-12f01a7bdba8-kube-api-access-tk6vm\") pod \"kuadrant-console-plugin-66b5774985-hch5t\" (UID: \"cef9b5d8-6ee5-4213-bb52-12f01a7bdba8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hch5t"
Jun 09 13:38:21.408901 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.408870    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hch5t"
Jun 09 13:38:21.538557 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:21.538522    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-hch5t"]
Jun 09 13:38:21.541811 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:38:21.541782    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcef9b5d8_6ee5_4213_bb52_12f01a7bdba8.slice/crio-4cd342e1a0b09184556b422343a98582fc2ea826b911a76b4b866f6ffc0bb584 WatchSource:0}: Error finding container 4cd342e1a0b09184556b422343a98582fc2ea826b911a76b4b866f6ffc0bb584: Status 404 returned error can't find the container with id 4cd342e1a0b09184556b422343a98582fc2ea826b911a76b4b866f6ffc0bb584
Jun 09 13:38:22.059883 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:22.059850    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:22.121887 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:22.121852    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:22.140377 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:22.140351    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hch5t" event={"ID":"cef9b5d8-6ee5-4213-bb52-12f01a7bdba8","Type":"ContainerStarted","Data":"4cd342e1a0b09184556b422343a98582fc2ea826b911a76b4b866f6ffc0bb584"}
Jun 09 13:38:30.088959 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:30.088867    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:30.189619 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:30.189583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:30.290558 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:30.290522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:32.712383 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:32.712340    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:32.815954 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:32.815922    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:35.672841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:35.672795    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:35.772627 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:35.772594    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:39.671795 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:39.671756    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:39.732855 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:39.732802    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:46.249650 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:46.249614    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hch5t" event={"ID":"cef9b5d8-6ee5-4213-bb52-12f01a7bdba8","Type":"ContainerStarted","Data":"3aec458b0e3eb2f7d9f9e4e62665b24753c133861568685155fd03db28bcfd61"}
Jun 09 13:38:46.266780 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:46.266715    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-hch5t" podStartSLOduration=1.035282964 podStartE2EDuration="25.266701356s" totalImagesPullingTime="24.231418392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:38:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:38:46.265376172 +0000 UTC m=+625.640046935" watchObservedRunningTime="2026-06-09 13:38:46.266701356 +0000 UTC m=+625.641372116"
Jun 09 13:38:49.472831 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:49.472798    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:49.574613 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:49.574579    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:49.866366 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:49.866274    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:38:49.967960 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:38:49.967932    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:39:00.466715 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:00.466672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:39:00.523894 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:00.523838    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:39:04.207313 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:04.207280    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:39:11.068602 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:11.068569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:39:14.204151 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:14.204119    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:39:14.310018 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:14.309979    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:39:14.363062 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:14.363031    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:39:15.034244 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.034210    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-2vtsc"]
Jun 09 13:39:15.062660 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.062633    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:39:15.076326 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.076308    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2vtsc"
Jun 09 13:39:15.078840 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.078818    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9rdf6\""
Jun 09 13:39:15.082320 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.082299    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-2vtsc"]
Jun 09 13:39:15.160182 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.160142    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:39:15.160435 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.160415    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hd9f8"]
Jun 09 13:39:15.163594 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.163573    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hd9f8"
Jun 09 13:39:15.170680 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.170659    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hd9f8"]
Jun 09 13:39:15.211604 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.211569    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tvhg\" (UniqueName: \"kubernetes.io/projected/c70eb82b-d19e-4d48-a162-958189f80688-kube-api-access-5tvhg\") pod \"authorino-58cd955675-2vtsc\" (UID: \"c70eb82b-d19e-4d48-a162-958189f80688\") " pod="kuadrant-system/authorino-58cd955675-2vtsc"
Jun 09 13:39:15.312641 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.312559    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tvhg\" (UniqueName: \"kubernetes.io/projected/c70eb82b-d19e-4d48-a162-958189f80688-kube-api-access-5tvhg\") pod \"authorino-58cd955675-2vtsc\" (UID: \"c70eb82b-d19e-4d48-a162-958189f80688\") " pod="kuadrant-system/authorino-58cd955675-2vtsc"
Jun 09 13:39:15.312641 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.312634    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcgn2\" (UniqueName: \"kubernetes.io/projected/c3d69a6f-1fe3-4693-bacb-ceff807f9281-kube-api-access-dcgn2\") pod \"authorino-75d556bd77-hd9f8\" (UID: \"c3d69a6f-1fe3-4693-bacb-ceff807f9281\") " pod="kuadrant-system/authorino-75d556bd77-hd9f8"
Jun 09 13:39:15.321287 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.321263    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tvhg\" (UniqueName: \"kubernetes.io/projected/c70eb82b-d19e-4d48-a162-958189f80688-kube-api-access-5tvhg\") pod \"authorino-58cd955675-2vtsc\" (UID: \"c70eb82b-d19e-4d48-a162-958189f80688\") " pod="kuadrant-system/authorino-58cd955675-2vtsc"
Jun 09 13:39:15.386456 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.386426    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2vtsc"
Jun 09 13:39:15.413878 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.413843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcgn2\" (UniqueName: \"kubernetes.io/projected/c3d69a6f-1fe3-4693-bacb-ceff807f9281-kube-api-access-dcgn2\") pod \"authorino-75d556bd77-hd9f8\" (UID: \"c3d69a6f-1fe3-4693-bacb-ceff807f9281\") " pod="kuadrant-system/authorino-75d556bd77-hd9f8"
Jun 09 13:39:15.422963 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.422939    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcgn2\" (UniqueName: \"kubernetes.io/projected/c3d69a6f-1fe3-4693-bacb-ceff807f9281-kube-api-access-dcgn2\") pod \"authorino-75d556bd77-hd9f8\" (UID: \"c3d69a6f-1fe3-4693-bacb-ceff807f9281\") " pod="kuadrant-system/authorino-75d556bd77-hd9f8"
Jun 09 13:39:15.472039 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.472008    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hd9f8"
Jun 09 13:39:15.515009 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.514756    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-2vtsc"]
Jun 09 13:39:15.517304 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:39:15.517278    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc70eb82b_d19e_4d48_a162_958189f80688.slice/crio-119e324202b0d914a4eec71502491e557e7f6ed702a7fdb749e77b843f57f6b3 WatchSource:0}: Error finding container 119e324202b0d914a4eec71502491e557e7f6ed702a7fdb749e77b843f57f6b3: Status 404 returned error can't find the container with id 119e324202b0d914a4eec71502491e557e7f6ed702a7fdb749e77b843f57f6b3
Jun 09 13:39:15.600836 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:15.600761    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hd9f8"]
Jun 09 13:39:15.603310 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:39:15.603277    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3d69a6f_1fe3_4693_bacb_ceff807f9281.slice/crio-1a4920a777cd9841e32c369ba22d7c9e5c097000f04d2ca95e8f7afb3f84a997 WatchSource:0}: Error finding container 1a4920a777cd9841e32c369ba22d7c9e5c097000f04d2ca95e8f7afb3f84a997: Status 404 returned error can't find the container with id 1a4920a777cd9841e32c369ba22d7c9e5c097000f04d2ca95e8f7afb3f84a997
Jun 09 13:39:16.373325 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:16.373287    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hd9f8" event={"ID":"c3d69a6f-1fe3-4693-bacb-ceff807f9281","Type":"ContainerStarted","Data":"1a4920a777cd9841e32c369ba22d7c9e5c097000f04d2ca95e8f7afb3f84a997"}
Jun 09 13:39:16.375083 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:16.375052    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2vtsc" event={"ID":"c70eb82b-d19e-4d48-a162-958189f80688","Type":"ContainerStarted","Data":"119e324202b0d914a4eec71502491e557e7f6ed702a7fdb749e77b843f57f6b3"}
Jun 09 13:39:19.209155 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:19.209119    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:39:19.266411 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:19.266364    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:39:19.388173 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:19.388072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hd9f8" event={"ID":"c3d69a6f-1fe3-4693-bacb-ceff807f9281","Type":"ContainerStarted","Data":"f03652c036589a396959d09c85dda99914107a44aa76b03fd0d3b48e983be73a"}
Jun 09 13:39:19.389475 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:19.389453    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2vtsc" event={"ID":"c70eb82b-d19e-4d48-a162-958189f80688","Type":"ContainerStarted","Data":"ea9a701ce4987b7a8f520260a7dd16e6cd5901fc9b3eec0aea527e373db3e5bc"}
Jun 09 13:39:19.403248 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:19.403209    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hd9f8" podStartSLOduration=0.904643582 podStartE2EDuration="4.403195605s" totalImagesPullingTime="3.498552023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:39:19.401984174 +0000 UTC m=+658.776654938" watchObservedRunningTime="2026-06-09 13:39:19.403195605 +0000 UTC m=+658.777866366"
Jun 09 13:39:19.415683 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:19.415642    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-2vtsc" podStartSLOduration=0.82125696 podStartE2EDuration="4.415628277s" totalImagesPullingTime="3.594371317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:39:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:39:19.414479232 +0000 UTC m=+658.789149993" watchObservedRunningTime="2026-06-09 13:39:19.415628277 +0000 UTC m=+658.790299041"
Jun 09 13:39:19.438441 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:19.438414    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-2vtsc"]
Jun 09 13:39:21.396781 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:21.396721    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-2vtsc" podUID="c70eb82b-d19e-4d48-a162-958189f80688" containerName="authorino" containerID="cri-o://ea9a701ce4987b7a8f520260a7dd16e6cd5901fc9b3eec0aea527e373db3e5bc" gracePeriod=30
Jun 09 13:39:21.430832 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:39:21.430798    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc70eb82b_d19e_4d48_a162_958189f80688.slice/crio-conmon-ea9a701ce4987b7a8f520260a7dd16e6cd5901fc9b3eec0aea527e373db3e5bc.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc70eb82b_d19e_4d48_a162_958189f80688.slice/crio-ea9a701ce4987b7a8f520260a7dd16e6cd5901fc9b3eec0aea527e373db3e5bc.scope\": RecentStats: unable to find data in memory cache]"
Jun 09 13:39:21.651167 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:21.651107    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2vtsc"
Jun 09 13:39:21.767113 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:21.767076    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tvhg\" (UniqueName: \"kubernetes.io/projected/c70eb82b-d19e-4d48-a162-958189f80688-kube-api-access-5tvhg\") pod \"c70eb82b-d19e-4d48-a162-958189f80688\" (UID: \"c70eb82b-d19e-4d48-a162-958189f80688\") "
Jun 09 13:39:21.769448 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:21.769420    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c70eb82b-d19e-4d48-a162-958189f80688-kube-api-access-5tvhg" (OuterVolumeSpecName: "kube-api-access-5tvhg") pod "c70eb82b-d19e-4d48-a162-958189f80688" (UID: "c70eb82b-d19e-4d48-a162-958189f80688"). InnerVolumeSpecName "kube-api-access-5tvhg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 13:39:21.867967 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:21.867927    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tvhg\" (UniqueName: \"kubernetes.io/projected/c70eb82b-d19e-4d48-a162-958189f80688-kube-api-access-5tvhg\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:39:22.401695 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:22.401652    2562 generic.go:356] "Generic (PLEG): container finished" podID="c70eb82b-d19e-4d48-a162-958189f80688" containerID="ea9a701ce4987b7a8f520260a7dd16e6cd5901fc9b3eec0aea527e373db3e5bc" exitCode=0
Jun 09 13:39:22.402124 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:22.401711    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2vtsc"
Jun 09 13:39:22.402124 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:22.401715    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2vtsc" event={"ID":"c70eb82b-d19e-4d48-a162-958189f80688","Type":"ContainerDied","Data":"ea9a701ce4987b7a8f520260a7dd16e6cd5901fc9b3eec0aea527e373db3e5bc"}
Jun 09 13:39:22.402124 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:22.401782    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2vtsc" event={"ID":"c70eb82b-d19e-4d48-a162-958189f80688","Type":"ContainerDied","Data":"119e324202b0d914a4eec71502491e557e7f6ed702a7fdb749e77b843f57f6b3"}
Jun 09 13:39:22.402124 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:22.401804    2562 scope.go:117] "RemoveContainer" containerID="ea9a701ce4987b7a8f520260a7dd16e6cd5901fc9b3eec0aea527e373db3e5bc"
Jun 09 13:39:22.410634 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:22.410613    2562 scope.go:117] "RemoveContainer" containerID="ea9a701ce4987b7a8f520260a7dd16e6cd5901fc9b3eec0aea527e373db3e5bc"
Jun 09 13:39:22.410925 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:39:22.410908    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea9a701ce4987b7a8f520260a7dd16e6cd5901fc9b3eec0aea527e373db3e5bc\": container with ID starting with ea9a701ce4987b7a8f520260a7dd16e6cd5901fc9b3eec0aea527e373db3e5bc not found: ID does not exist" containerID="ea9a701ce4987b7a8f520260a7dd16e6cd5901fc9b3eec0aea527e373db3e5bc"
Jun 09 13:39:22.410972 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:22.410934    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea9a701ce4987b7a8f520260a7dd16e6cd5901fc9b3eec0aea527e373db3e5bc"} err="failed to get container status \"ea9a701ce4987b7a8f520260a7dd16e6cd5901fc9b3eec0aea527e373db3e5bc\": rpc error: code = NotFound desc = could not find container \"ea9a701ce4987b7a8f520260a7dd16e6cd5901fc9b3eec0aea527e373db3e5bc\": container with ID starting with ea9a701ce4987b7a8f520260a7dd16e6cd5901fc9b3eec0aea527e373db3e5bc not found: ID does not exist"
Jun 09 13:39:22.423243 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:22.423212    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-2vtsc"]
Jun 09 13:39:22.427416 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:22.427395    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-2vtsc"]
Jun 09 13:39:23.054308 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:23.054277    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c70eb82b-d19e-4d48-a162-958189f80688" path="/var/lib/kubelet/pods/c70eb82b-d19e-4d48-a162-958189f80688/volumes"
Jun 09 13:39:30.922587 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:30.922555    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:39:35.498215 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:35.498176    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:39:42.809960 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:42.809922    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:39:42.909329 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:42.909294    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:39:43.056303 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:43.056268    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:39:54.613145 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:39:54.613112    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:40:12.485466 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:12.485382    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:40:12.586002 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:12.585968    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:40:12.974483 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:12.974428    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 09 13:40:12.974761 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:12.974748    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c70eb82b-d19e-4d48-a162-958189f80688" containerName="authorino"
Jun 09 13:40:12.974820 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:12.974763    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c70eb82b-d19e-4d48-a162-958189f80688" containerName="authorino"
Jun 09 13:40:12.974820 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:12.974818    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c70eb82b-d19e-4d48-a162-958189f80688" containerName="authorino"
Jun 09 13:40:12.977623 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:12.977608    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 09 13:40:12.979767 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:12.979724    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 09 13:40:12.980511 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:12.980497    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-s4pkd\""
Jun 09 13:40:12.980580 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:12.980502    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 09 13:40:12.980580 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:12.980544    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 09 13:40:12.986155 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:12.986132    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 09 13:40:13.058694 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:13.058666    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj4l2\" (UniqueName: \"kubernetes.io/projected/87ee207d-65a8-44a3-a97b-243e6f8ff677-kube-api-access-rj4l2\") pod \"maas-keycloak-0\" (UID: \"87ee207d-65a8-44a3-a97b-243e6f8ff677\") " pod="keycloak-system/maas-keycloak-0"
Jun 09 13:40:13.159658 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:13.159625    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj4l2\" (UniqueName: \"kubernetes.io/projected/87ee207d-65a8-44a3-a97b-243e6f8ff677-kube-api-access-rj4l2\") pod \"maas-keycloak-0\" (UID: \"87ee207d-65a8-44a3-a97b-243e6f8ff677\") " pod="keycloak-system/maas-keycloak-0"
Jun 09 13:40:13.168073 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:13.168041    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj4l2\" (UniqueName: \"kubernetes.io/projected/87ee207d-65a8-44a3-a97b-243e6f8ff677-kube-api-access-rj4l2\") pod \"maas-keycloak-0\" (UID: \"87ee207d-65a8-44a3-a97b-243e6f8ff677\") " pod="keycloak-system/maas-keycloak-0"
Jun 09 13:40:13.287796 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:13.287663    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 09 13:40:13.422987 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:13.422953    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 09 13:40:13.425703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:40:13.425675    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ee207d_65a8_44a3_a97b_243e6f8ff677.slice/crio-06b5a3824121e328c177ea68d36e484196cf9aa31e5345f2bfd04b7c9d4e7ed4 WatchSource:0}: Error finding container 06b5a3824121e328c177ea68d36e484196cf9aa31e5345f2bfd04b7c9d4e7ed4: Status 404 returned error can't find the container with id 06b5a3824121e328c177ea68d36e484196cf9aa31e5345f2bfd04b7c9d4e7ed4
Jun 09 13:40:13.427296 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:13.427276    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 09 13:40:13.612622 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:13.612528    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"87ee207d-65a8-44a3-a97b-243e6f8ff677","Type":"ContainerStarted","Data":"06b5a3824121e328c177ea68d36e484196cf9aa31e5345f2bfd04b7c9d4e7ed4"}
Jun 09 13:40:18.642560 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:18.642517    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"87ee207d-65a8-44a3-a97b-243e6f8ff677","Type":"ContainerStarted","Data":"3eab580d8dee2d8e7160cafdfdcd36df7cb95e9682b129afa2fcc06deb7dfe4b"}
Jun 09 13:40:19.288585 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:19.288524    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 09 13:40:19.290507 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:19.290462    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="87ee207d-65a8-44a3-a97b-243e6f8ff677" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused"
Jun 09 13:40:20.288641 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:20.288591    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="87ee207d-65a8-44a3-a97b-243e6f8ff677" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused"
Jun 09 13:40:21.289021 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:21.288968    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="87ee207d-65a8-44a3-a97b-243e6f8ff677" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused"
Jun 09 13:40:22.288441 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:22.288384    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="87ee207d-65a8-44a3-a97b-243e6f8ff677" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused"
Jun 09 13:40:23.288070 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:23.288025    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 09 13:40:23.288691 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:23.288342    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="87ee207d-65a8-44a3-a97b-243e6f8ff677" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused"
Jun 09 13:40:24.288808 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:24.288762    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="87ee207d-65a8-44a3-a97b-243e6f8ff677" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused"
Jun 09 13:40:25.288833 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:25.288785    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="87ee207d-65a8-44a3-a97b-243e6f8ff677" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused"
Jun 09 13:40:26.288578 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:26.288531    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="87ee207d-65a8-44a3-a97b-243e6f8ff677" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused"
Jun 09 13:40:27.289079 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:27.289026    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="87ee207d-65a8-44a3-a97b-243e6f8ff677" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused"
Jun 09 13:40:28.289160 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:28.289107    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="87ee207d-65a8-44a3-a97b-243e6f8ff677" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused"
Jun 09 13:40:29.288389 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:29.288345    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="87ee207d-65a8-44a3-a97b-243e6f8ff677" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.24:9000/health/started\": dial tcp 10.134.0.24:9000: connect: connection refused"
Jun 09 13:40:30.376479 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:30.376441    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 09 13:40:30.390628 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:30.390585    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="87ee207d-65a8-44a3-a97b-243e6f8ff677" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 13:40:30.394582 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:30.394517    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=14.045477321 podStartE2EDuration="18.394495642s" totalImagesPullingTime="4.349018321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:40:18.660115253 +0000 UTC m=+718.034786016" watchObservedRunningTime="2026-06-09 13:40:30.394495642 +0000 UTC m=+729.769166407"
Jun 09 13:40:40.382817 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:40.382776    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 09 13:40:41.048261 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.048220    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:40:41.225022 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.224993    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:40:41.295862 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.295821    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kc8mj"]
Jun 09 13:40:41.301297 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.301232    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kc8mj"
Jun 09 13:40:41.305974 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.305949    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kc8mj"]
Jun 09 13:40:41.416539 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.416506    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x85jn\" (UniqueName: \"kubernetes.io/projected/461d4da6-3903-4cf2-a160-24d6f593ba07-kube-api-access-x85jn\") pod \"authorino-5d4b67c446-kc8mj\" (UID: \"461d4da6-3903-4cf2-a160-24d6f593ba07\") " pod="kuadrant-system/authorino-5d4b67c446-kc8mj"
Jun 09 13:40:41.517834 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.517798    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x85jn\" (UniqueName: \"kubernetes.io/projected/461d4da6-3903-4cf2-a160-24d6f593ba07-kube-api-access-x85jn\") pod \"authorino-5d4b67c446-kc8mj\" (UID: \"461d4da6-3903-4cf2-a160-24d6f593ba07\") " pod="kuadrant-system/authorino-5d4b67c446-kc8mj"
Jun 09 13:40:41.529034 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.529010    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x85jn\" (UniqueName: \"kubernetes.io/projected/461d4da6-3903-4cf2-a160-24d6f593ba07-kube-api-access-x85jn\") pod \"authorino-5d4b67c446-kc8mj\" (UID: \"461d4da6-3903-4cf2-a160-24d6f593ba07\") " pod="kuadrant-system/authorino-5d4b67c446-kc8mj"
Jun 09 13:40:41.558696 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.558617    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kc8mj"]
Jun 09 13:40:41.558877 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.558865    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kc8mj"
Jun 09 13:40:41.582757 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.582691    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7448575897-l6vxx"]
Jun 09 13:40:41.584879 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.584860    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7448575897-l6vxx"
Jun 09 13:40:41.586976 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.586955    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jun 09 13:40:41.592957 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.592794    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7448575897-l6vxx"]
Jun 09 13:40:41.618287 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.618259    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjtzk\" (UniqueName: \"kubernetes.io/projected/8b62889c-5837-46a7-ae2c-34e8a00daaf6-kube-api-access-sjtzk\") pod \"authorino-7448575897-l6vxx\" (UID: \"8b62889c-5837-46a7-ae2c-34e8a00daaf6\") " pod="kuadrant-system/authorino-7448575897-l6vxx"
Jun 09 13:40:41.618411 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.618301    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8b62889c-5837-46a7-ae2c-34e8a00daaf6-tls-cert\") pod \"authorino-7448575897-l6vxx\" (UID: \"8b62889c-5837-46a7-ae2c-34e8a00daaf6\") " pod="kuadrant-system/authorino-7448575897-l6vxx"
Jun 09 13:40:41.686572 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.686542    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kc8mj"]
Jun 09 13:40:41.689882 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:40:41.689854    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod461d4da6_3903_4cf2_a160_24d6f593ba07.slice/crio-6a26c16d97953eb23fa1024a4487986dc327cfb4049b270424e01d17b09c21a1 WatchSource:0}: Error finding container 6a26c16d97953eb23fa1024a4487986dc327cfb4049b270424e01d17b09c21a1: Status 404 returned error can't find the container with id 6a26c16d97953eb23fa1024a4487986dc327cfb4049b270424e01d17b09c21a1
Jun 09 13:40:41.719378 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.719353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjtzk\" (UniqueName: \"kubernetes.io/projected/8b62889c-5837-46a7-ae2c-34e8a00daaf6-kube-api-access-sjtzk\") pod \"authorino-7448575897-l6vxx\" (UID: \"8b62889c-5837-46a7-ae2c-34e8a00daaf6\") " pod="kuadrant-system/authorino-7448575897-l6vxx"
Jun 09 13:40:41.719493 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.719383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8b62889c-5837-46a7-ae2c-34e8a00daaf6-tls-cert\") pod \"authorino-7448575897-l6vxx\" (UID: \"8b62889c-5837-46a7-ae2c-34e8a00daaf6\") " pod="kuadrant-system/authorino-7448575897-l6vxx"
Jun 09 13:40:41.721778 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.721757    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8b62889c-5837-46a7-ae2c-34e8a00daaf6-tls-cert\") pod \"authorino-7448575897-l6vxx\" (UID: \"8b62889c-5837-46a7-ae2c-34e8a00daaf6\") " pod="kuadrant-system/authorino-7448575897-l6vxx"
Jun 09 13:40:41.731987 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.731966    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjtzk\" (UniqueName: \"kubernetes.io/projected/8b62889c-5837-46a7-ae2c-34e8a00daaf6-kube-api-access-sjtzk\") pod \"authorino-7448575897-l6vxx\" (UID: \"8b62889c-5837-46a7-ae2c-34e8a00daaf6\") " pod="kuadrant-system/authorino-7448575897-l6vxx"
Jun 09 13:40:41.769260 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.769223    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kc8mj" event={"ID":"461d4da6-3903-4cf2-a160-24d6f593ba07","Type":"ContainerStarted","Data":"6a26c16d97953eb23fa1024a4487986dc327cfb4049b270424e01d17b09c21a1"}
Jun 09 13:40:41.895891 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:41.895808    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7448575897-l6vxx"
Jun 09 13:40:42.019697 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:42.019663    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7448575897-l6vxx"]
Jun 09 13:40:42.022703 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:40:42.022678    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b62889c_5837_46a7_ae2c_34e8a00daaf6.slice/crio-7519d8daa8f4c7f4158a541efe19dc8fd354cf67469560753e57105f83986a57 WatchSource:0}: Error finding container 7519d8daa8f4c7f4158a541efe19dc8fd354cf67469560753e57105f83986a57: Status 404 returned error can't find the container with id 7519d8daa8f4c7f4158a541efe19dc8fd354cf67469560753e57105f83986a57
Jun 09 13:40:42.774690 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:42.774650    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7448575897-l6vxx" event={"ID":"8b62889c-5837-46a7-ae2c-34e8a00daaf6","Type":"ContainerStarted","Data":"05f9476a40d7453cb032a211e0a21bb007a85b56d850d8f94829124b4b16d94f"}
Jun 09 13:40:42.775199 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:42.774698    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7448575897-l6vxx" event={"ID":"8b62889c-5837-46a7-ae2c-34e8a00daaf6","Type":"ContainerStarted","Data":"7519d8daa8f4c7f4158a541efe19dc8fd354cf67469560753e57105f83986a57"}
Jun 09 13:40:42.776075 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:42.776051    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kc8mj" event={"ID":"461d4da6-3903-4cf2-a160-24d6f593ba07","Type":"ContainerStarted","Data":"fabb26fd244ef2ae7bbc0622fb000b451cb3d198b25cd5f4e5cbf0c0eae34de5"}
Jun 09 13:40:42.776183 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:42.776105    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-kc8mj" podUID="461d4da6-3903-4cf2-a160-24d6f593ba07" containerName="authorino" containerID="cri-o://fabb26fd244ef2ae7bbc0622fb000b451cb3d198b25cd5f4e5cbf0c0eae34de5" gracePeriod=30
Jun 09 13:40:42.789841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:42.789795    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7448575897-l6vxx" podStartSLOduration=1.517157772 podStartE2EDuration="1.789711956s" totalImagesPullingTime="272.554184ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:40:42.789088788 +0000 UTC m=+742.163759541" watchObservedRunningTime="2026-06-09 13:40:42.789711956 +0000 UTC m=+742.164382717"
Jun 09 13:40:42.811859 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:42.811679    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-kc8mj" podStartSLOduration=1.45018778 podStartE2EDuration="1.811660212s" totalImagesPullingTime="361.472432ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:40:42.809948143 +0000 UTC m=+742.184618904" watchObservedRunningTime="2026-06-09 13:40:42.811660212 +0000 UTC m=+742.186330975"
Jun 09 13:40:42.816331 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:42.816299    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hd9f8"]
Jun 09 13:40:42.816536 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:42.816510    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hd9f8" podUID="c3d69a6f-1fe3-4693-bacb-ceff807f9281" containerName="authorino" containerID="cri-o://f03652c036589a396959d09c85dda99914107a44aa76b03fd0d3b48e983be73a" gracePeriod=30
Jun 09 13:40:42.843539 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:40:42.843513    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3d69a6f_1fe3_4693_bacb_ceff807f9281.slice/crio-f03652c036589a396959d09c85dda99914107a44aa76b03fd0d3b48e983be73a.scope\": RecentStats: unable to find data in memory cache]"
Jun 09 13:40:43.082434 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.082409    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kc8mj"
Jun 09 13:40:43.084340 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.084320    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hd9f8"
Jun 09 13:40:43.129980 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.129953    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcgn2\" (UniqueName: \"kubernetes.io/projected/c3d69a6f-1fe3-4693-bacb-ceff807f9281-kube-api-access-dcgn2\") pod \"c3d69a6f-1fe3-4693-bacb-ceff807f9281\" (UID: \"c3d69a6f-1fe3-4693-bacb-ceff807f9281\") "
Jun 09 13:40:43.130126 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.129992    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x85jn\" (UniqueName: \"kubernetes.io/projected/461d4da6-3903-4cf2-a160-24d6f593ba07-kube-api-access-x85jn\") pod \"461d4da6-3903-4cf2-a160-24d6f593ba07\" (UID: \"461d4da6-3903-4cf2-a160-24d6f593ba07\") "
Jun 09 13:40:43.132234 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.132208    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/461d4da6-3903-4cf2-a160-24d6f593ba07-kube-api-access-x85jn" (OuterVolumeSpecName: "kube-api-access-x85jn") pod "461d4da6-3903-4cf2-a160-24d6f593ba07" (UID: "461d4da6-3903-4cf2-a160-24d6f593ba07"). InnerVolumeSpecName "kube-api-access-x85jn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 13:40:43.132234 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.132224    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3d69a6f-1fe3-4693-bacb-ceff807f9281-kube-api-access-dcgn2" (OuterVolumeSpecName: "kube-api-access-dcgn2") pod "c3d69a6f-1fe3-4693-bacb-ceff807f9281" (UID: "c3d69a6f-1fe3-4693-bacb-ceff807f9281"). InnerVolumeSpecName "kube-api-access-dcgn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 13:40:43.230514 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.230484    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcgn2\" (UniqueName: \"kubernetes.io/projected/c3d69a6f-1fe3-4693-bacb-ceff807f9281-kube-api-access-dcgn2\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:40:43.230514 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.230508    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x85jn\" (UniqueName: \"kubernetes.io/projected/461d4da6-3903-4cf2-a160-24d6f593ba07-kube-api-access-x85jn\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:40:43.781120 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.781085    2562 generic.go:356] "Generic (PLEG): container finished" podID="461d4da6-3903-4cf2-a160-24d6f593ba07" containerID="fabb26fd244ef2ae7bbc0622fb000b451cb3d198b25cd5f4e5cbf0c0eae34de5" exitCode=0
Jun 09 13:40:43.781593 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.781129    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-kc8mj"
Jun 09 13:40:43.781593 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.781174    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kc8mj" event={"ID":"461d4da6-3903-4cf2-a160-24d6f593ba07","Type":"ContainerDied","Data":"fabb26fd244ef2ae7bbc0622fb000b451cb3d198b25cd5f4e5cbf0c0eae34de5"}
Jun 09 13:40:43.781593 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.781219    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-kc8mj" event={"ID":"461d4da6-3903-4cf2-a160-24d6f593ba07","Type":"ContainerDied","Data":"6a26c16d97953eb23fa1024a4487986dc327cfb4049b270424e01d17b09c21a1"}
Jun 09 13:40:43.781593 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.781243    2562 scope.go:117] "RemoveContainer" containerID="fabb26fd244ef2ae7bbc0622fb000b451cb3d198b25cd5f4e5cbf0c0eae34de5"
Jun 09 13:40:43.782589 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.782454    2562 generic.go:356] "Generic (PLEG): container finished" podID="c3d69a6f-1fe3-4693-bacb-ceff807f9281" containerID="f03652c036589a396959d09c85dda99914107a44aa76b03fd0d3b48e983be73a" exitCode=0
Jun 09 13:40:43.782589 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.782491    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hd9f8"
Jun 09 13:40:43.782589 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.782525    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hd9f8" event={"ID":"c3d69a6f-1fe3-4693-bacb-ceff807f9281","Type":"ContainerDied","Data":"f03652c036589a396959d09c85dda99914107a44aa76b03fd0d3b48e983be73a"}
Jun 09 13:40:43.782589 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.782559    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hd9f8" event={"ID":"c3d69a6f-1fe3-4693-bacb-ceff807f9281","Type":"ContainerDied","Data":"1a4920a777cd9841e32c369ba22d7c9e5c097000f04d2ca95e8f7afb3f84a997"}
Jun 09 13:40:43.791050 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.791035    2562 scope.go:117] "RemoveContainer" containerID="fabb26fd244ef2ae7bbc0622fb000b451cb3d198b25cd5f4e5cbf0c0eae34de5"
Jun 09 13:40:43.791340 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:40:43.791320    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fabb26fd244ef2ae7bbc0622fb000b451cb3d198b25cd5f4e5cbf0c0eae34de5\": container with ID starting with fabb26fd244ef2ae7bbc0622fb000b451cb3d198b25cd5f4e5cbf0c0eae34de5 not found: ID does not exist" containerID="fabb26fd244ef2ae7bbc0622fb000b451cb3d198b25cd5f4e5cbf0c0eae34de5"
Jun 09 13:40:43.791389 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.791349    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fabb26fd244ef2ae7bbc0622fb000b451cb3d198b25cd5f4e5cbf0c0eae34de5"} err="failed to get container status \"fabb26fd244ef2ae7bbc0622fb000b451cb3d198b25cd5f4e5cbf0c0eae34de5\": rpc error: code = NotFound desc = could not find container \"fabb26fd244ef2ae7bbc0622fb000b451cb3d198b25cd5f4e5cbf0c0eae34de5\": container with ID starting with fabb26fd244ef2ae7bbc0622fb000b451cb3d198b25cd5f4e5cbf0c0eae34de5 not found: ID does not exist"
Jun 09 13:40:43.791389 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.791368    2562 scope.go:117] "RemoveContainer" containerID="f03652c036589a396959d09c85dda99914107a44aa76b03fd0d3b48e983be73a"
Jun 09 13:40:43.798905 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.798889    2562 scope.go:117] "RemoveContainer" containerID="f03652c036589a396959d09c85dda99914107a44aa76b03fd0d3b48e983be73a"
Jun 09 13:40:43.799146 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:40:43.799129    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f03652c036589a396959d09c85dda99914107a44aa76b03fd0d3b48e983be73a\": container with ID starting with f03652c036589a396959d09c85dda99914107a44aa76b03fd0d3b48e983be73a not found: ID does not exist" containerID="f03652c036589a396959d09c85dda99914107a44aa76b03fd0d3b48e983be73a"
Jun 09 13:40:43.799190 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.799153    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f03652c036589a396959d09c85dda99914107a44aa76b03fd0d3b48e983be73a"} err="failed to get container status \"f03652c036589a396959d09c85dda99914107a44aa76b03fd0d3b48e983be73a\": rpc error: code = NotFound desc = could not find container \"f03652c036589a396959d09c85dda99914107a44aa76b03fd0d3b48e983be73a\": container with ID starting with f03652c036589a396959d09c85dda99914107a44aa76b03fd0d3b48e983be73a not found: ID does not exist"
Jun 09 13:40:43.801861 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.801841    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kc8mj"]
Jun 09 13:40:43.807355 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.807338    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-kc8mj"]
Jun 09 13:40:43.817546 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.817524    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hd9f8"]
Jun 09 13:40:43.821575 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:43.821547    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hd9f8"]
Jun 09 13:40:45.054464 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:45.054431    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="461d4da6-3903-4cf2-a160-24d6f593ba07" path="/var/lib/kubelet/pods/461d4da6-3903-4cf2-a160-24d6f593ba07/volumes"
Jun 09 13:40:45.054845 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:45.054752    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3d69a6f-1fe3-4693-bacb-ceff807f9281" path="/var/lib/kubelet/pods/c3d69a6f-1fe3-4693-bacb-ceff807f9281/volumes"
Jun 09 13:40:46.399568 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.399540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:40:46.412884 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.412854    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-864fd557f6-65xf2"]
Jun 09 13:40:46.413157 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.413145    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3d69a6f-1fe3-4693-bacb-ceff807f9281" containerName="authorino"
Jun 09 13:40:46.413202 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.413159    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3d69a6f-1fe3-4693-bacb-ceff807f9281" containerName="authorino"
Jun 09 13:40:46.413202 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.413178    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="461d4da6-3903-4cf2-a160-24d6f593ba07" containerName="authorino"
Jun 09 13:40:46.413202 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.413184    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="461d4da6-3903-4cf2-a160-24d6f593ba07" containerName="authorino"
Jun 09 13:40:46.413311 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.413234    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="461d4da6-3903-4cf2-a160-24d6f593ba07" containerName="authorino"
Jun 09 13:40:46.413311 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.413244    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3d69a6f-1fe3-4693-bacb-ceff807f9281" containerName="authorino"
Jun 09 13:40:46.417215 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.417196    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-864fd557f6-65xf2"
Jun 09 13:40:46.419409 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.419385    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jun 09 13:40:46.419517 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.419407    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 09 13:40:46.419517 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.419417    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qblt8\""
Jun 09 13:40:46.426618 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.426598    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-864fd557f6-65xf2"]
Jun 09 13:40:46.461954 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.461915    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4f5bd\" (UniqueName: \"kubernetes.io/projected/ee719752-a5d9-40c1-ad5f-96b2aa5033be-kube-api-access-4f5bd\") pod \"maas-controller-864fd557f6-65xf2\" (UID: \"ee719752-a5d9-40c1-ad5f-96b2aa5033be\") " pod="opendatahub/maas-controller-864fd557f6-65xf2"
Jun 09 13:40:46.462104 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.461971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee719752-a5d9-40c1-ad5f-96b2aa5033be-webhook-cert\") pod \"maas-controller-864fd557f6-65xf2\" (UID: \"ee719752-a5d9-40c1-ad5f-96b2aa5033be\") " pod="opendatahub/maas-controller-864fd557f6-65xf2"
Jun 09 13:40:46.477407 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.477353    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:40:46.531408 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.531376    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:40:46.562612 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.562576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4f5bd\" (UniqueName: \"kubernetes.io/projected/ee719752-a5d9-40c1-ad5f-96b2aa5033be-kube-api-access-4f5bd\") pod \"maas-controller-864fd557f6-65xf2\" (UID: \"ee719752-a5d9-40c1-ad5f-96b2aa5033be\") " pod="opendatahub/maas-controller-864fd557f6-65xf2"
Jun 09 13:40:46.562820 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.562642    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee719752-a5d9-40c1-ad5f-96b2aa5033be-webhook-cert\") pod \"maas-controller-864fd557f6-65xf2\" (UID: \"ee719752-a5d9-40c1-ad5f-96b2aa5033be\") " pod="opendatahub/maas-controller-864fd557f6-65xf2"
Jun 09 13:40:46.562820 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:40:46.562783    2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jun 09 13:40:46.562947 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:40:46.562856    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee719752-a5d9-40c1-ad5f-96b2aa5033be-webhook-cert podName:ee719752-a5d9-40c1-ad5f-96b2aa5033be nodeName:}" failed. No retries permitted until 2026-06-09 13:40:47.06283497 +0000 UTC m=+746.437505712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/ee719752-a5d9-40c1-ad5f-96b2aa5033be-webhook-cert") pod "maas-controller-864fd557f6-65xf2" (UID: "ee719752-a5d9-40c1-ad5f-96b2aa5033be") : secret "maas-controller-webhook-cert" not found
Jun 09 13:40:46.577241 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.577213    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4f5bd\" (UniqueName: \"kubernetes.io/projected/ee719752-a5d9-40c1-ad5f-96b2aa5033be-kube-api-access-4f5bd\") pod \"maas-controller-864fd557f6-65xf2\" (UID: \"ee719752-a5d9-40c1-ad5f-96b2aa5033be\") " pod="opendatahub/maas-controller-864fd557f6-65xf2"
Jun 09 13:40:46.584288 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.584262    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7569bf7bf4-4z456"]
Jun 09 13:40:46.587331 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.587315    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7569bf7bf4-4z456"
Jun 09 13:40:46.598501 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.598477    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7569bf7bf4-4z456"]
Jun 09 13:40:46.664135 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.664048    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgcs2\" (UniqueName: \"kubernetes.io/projected/ba9b6528-be44-4434-a514-2ba3de93dd5c-kube-api-access-bgcs2\") pod \"maas-controller-7569bf7bf4-4z456\" (UID: \"ba9b6528-be44-4434-a514-2ba3de93dd5c\") " pod="opendatahub/maas-controller-7569bf7bf4-4z456"
Jun 09 13:40:46.664293 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.664105    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba9b6528-be44-4434-a514-2ba3de93dd5c-webhook-cert\") pod \"maas-controller-7569bf7bf4-4z456\" (UID: \"ba9b6528-be44-4434-a514-2ba3de93dd5c\") " pod="opendatahub/maas-controller-7569bf7bf4-4z456"
Jun 09 13:40:46.770115 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.770074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgcs2\" (UniqueName: \"kubernetes.io/projected/ba9b6528-be44-4434-a514-2ba3de93dd5c-kube-api-access-bgcs2\") pod \"maas-controller-7569bf7bf4-4z456\" (UID: \"ba9b6528-be44-4434-a514-2ba3de93dd5c\") " pod="opendatahub/maas-controller-7569bf7bf4-4z456"
Jun 09 13:40:46.770281 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.770132    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba9b6528-be44-4434-a514-2ba3de93dd5c-webhook-cert\") pod \"maas-controller-7569bf7bf4-4z456\" (UID: \"ba9b6528-be44-4434-a514-2ba3de93dd5c\") " pod="opendatahub/maas-controller-7569bf7bf4-4z456"
Jun 09 13:40:46.770281 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:40:46.770234    2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jun 09 13:40:46.770349 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:40:46.770290    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba9b6528-be44-4434-a514-2ba3de93dd5c-webhook-cert podName:ba9b6528-be44-4434-a514-2ba3de93dd5c nodeName:}" failed. No retries permitted until 2026-06-09 13:40:47.270274957 +0000 UTC m=+746.644945699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/ba9b6528-be44-4434-a514-2ba3de93dd5c-webhook-cert") pod "maas-controller-7569bf7bf4-4z456" (UID: "ba9b6528-be44-4434-a514-2ba3de93dd5c") : secret "maas-controller-webhook-cert" not found
Jun 09 13:40:46.781326 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:46.781294    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgcs2\" (UniqueName: \"kubernetes.io/projected/ba9b6528-be44-4434-a514-2ba3de93dd5c-kube-api-access-bgcs2\") pod \"maas-controller-7569bf7bf4-4z456\" (UID: \"ba9b6528-be44-4434-a514-2ba3de93dd5c\") " pod="opendatahub/maas-controller-7569bf7bf4-4z456"
Jun 09 13:40:47.051691 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:47.051654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:40:47.073427 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:47.073392    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee719752-a5d9-40c1-ad5f-96b2aa5033be-webhook-cert\") pod \"maas-controller-864fd557f6-65xf2\" (UID: \"ee719752-a5d9-40c1-ad5f-96b2aa5033be\") " pod="opendatahub/maas-controller-864fd557f6-65xf2"
Jun 09 13:40:47.075980 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:47.075955    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee719752-a5d9-40c1-ad5f-96b2aa5033be-webhook-cert\") pod \"maas-controller-864fd557f6-65xf2\" (UID: \"ee719752-a5d9-40c1-ad5f-96b2aa5033be\") " pod="opendatahub/maas-controller-864fd557f6-65xf2"
Jun 09 13:40:47.275381 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:47.275341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba9b6528-be44-4434-a514-2ba3de93dd5c-webhook-cert\") pod \"maas-controller-7569bf7bf4-4z456\" (UID: \"ba9b6528-be44-4434-a514-2ba3de93dd5c\") " pod="opendatahub/maas-controller-7569bf7bf4-4z456"
Jun 09 13:40:47.278054 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:47.278034    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba9b6528-be44-4434-a514-2ba3de93dd5c-webhook-cert\") pod \"maas-controller-7569bf7bf4-4z456\" (UID: \"ba9b6528-be44-4434-a514-2ba3de93dd5c\") " pod="opendatahub/maas-controller-7569bf7bf4-4z456"
Jun 09 13:40:47.328758 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:47.328651    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-864fd557f6-65xf2"
Jun 09 13:40:47.467623 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:47.467597    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-864fd557f6-65xf2"]
Jun 09 13:40:47.469952 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:40:47.469926    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee719752_a5d9_40c1_ad5f_96b2aa5033be.slice/crio-69ab4d7c89059e5d26c0f52ffd5c5306b12f91c4b357e9c87425dc20e92eb329 WatchSource:0}: Error finding container 69ab4d7c89059e5d26c0f52ffd5c5306b12f91c4b357e9c87425dc20e92eb329: Status 404 returned error can't find the container with id 69ab4d7c89059e5d26c0f52ffd5c5306b12f91c4b357e9c87425dc20e92eb329
Jun 09 13:40:47.497215 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:47.497193    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7569bf7bf4-4z456"
Jun 09 13:40:47.625015 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:47.624941    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7569bf7bf4-4z456"]
Jun 09 13:40:47.627814 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:40:47.627783    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9b6528_be44_4434_a514_2ba3de93dd5c.slice/crio-43652625e51818b72377235b6a9e5142ddb97fc05128f15f184d03b0b1430aac WatchSource:0}: Error finding container 43652625e51818b72377235b6a9e5142ddb97fc05128f15f184d03b0b1430aac: Status 404 returned error can't find the container with id 43652625e51818b72377235b6a9e5142ddb97fc05128f15f184d03b0b1430aac
Jun 09 13:40:47.802339 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:47.802302    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7569bf7bf4-4z456" event={"ID":"ba9b6528-be44-4434-a514-2ba3de93dd5c","Type":"ContainerStarted","Data":"43652625e51818b72377235b6a9e5142ddb97fc05128f15f184d03b0b1430aac"}
Jun 09 13:40:47.803391 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:47.803368    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-864fd557f6-65xf2" event={"ID":"ee719752-a5d9-40c1-ad5f-96b2aa5033be","Type":"ContainerStarted","Data":"69ab4d7c89059e5d26c0f52ffd5c5306b12f91c4b357e9c87425dc20e92eb329"}
Jun 09 13:40:50.283195 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:50.283161    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:40:50.410966 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:50.410879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:40:50.823575 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:50.823541    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-864fd557f6-65xf2" event={"ID":"ee719752-a5d9-40c1-ad5f-96b2aa5033be","Type":"ContainerStarted","Data":"f27c6817049f2e053ebb07f44db98f46b2749c51fbcf005ed5c0db33c2e92c41"}
Jun 09 13:40:50.823791 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:50.823664    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-864fd557f6-65xf2"
Jun 09 13:40:50.825071 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:50.825044    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7569bf7bf4-4z456" event={"ID":"ba9b6528-be44-4434-a514-2ba3de93dd5c","Type":"ContainerStarted","Data":"7d307b15101c94fcccf1e1b9e0dee85308808300911c389285b6d1b9a80d6612"}
Jun 09 13:40:50.825175 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:50.825166    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7569bf7bf4-4z456"
Jun 09 13:40:50.842029 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:50.841985    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-864fd557f6-65xf2" podStartSLOduration=2.238534122 podStartE2EDuration="4.84197176s" totalImagesPullingTime="2.603437638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:40:50.840550926 +0000 UTC m=+750.215221692" watchObservedRunningTime="2026-06-09 13:40:50.84197176 +0000 UTC m=+750.216642520"
Jun 09 13:40:50.856009 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:40:50.855954    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7569bf7bf4-4z456" podStartSLOduration=2.403597546 podStartE2EDuration="4.85593745s" totalImagesPullingTime="2.452339904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:40:50.855481795 +0000 UTC m=+750.230152557" watchObservedRunningTime="2026-06-09 13:40:50.85593745 +0000 UTC m=+750.230608213"
Jun 09 13:41:01.834602 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:01.834575    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7569bf7bf4-4z456"
Jun 09 13:41:01.835014 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:01.834681    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-864fd557f6-65xf2"
Jun 09 13:41:01.895148 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:01.895117    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-864fd557f6-65xf2"]
Jun 09 13:41:01.895319 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:01.895297    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-864fd557f6-65xf2" podUID="ee719752-a5d9-40c1-ad5f-96b2aa5033be" containerName="manager" containerID="cri-o://f27c6817049f2e053ebb07f44db98f46b2749c51fbcf005ed5c0db33c2e92c41" gracePeriod=30
Jun 09 13:41:02.133406 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:02.133381    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-864fd557f6-65xf2"
Jun 09 13:41:02.295775 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:02.295723    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee719752-a5d9-40c1-ad5f-96b2aa5033be-webhook-cert\") pod \"ee719752-a5d9-40c1-ad5f-96b2aa5033be\" (UID: \"ee719752-a5d9-40c1-ad5f-96b2aa5033be\") "
Jun 09 13:41:02.295946 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:02.295802    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4f5bd\" (UniqueName: \"kubernetes.io/projected/ee719752-a5d9-40c1-ad5f-96b2aa5033be-kube-api-access-4f5bd\") pod \"ee719752-a5d9-40c1-ad5f-96b2aa5033be\" (UID: \"ee719752-a5d9-40c1-ad5f-96b2aa5033be\") "
Jun 09 13:41:02.298002 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:02.297966    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee719752-a5d9-40c1-ad5f-96b2aa5033be-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ee719752-a5d9-40c1-ad5f-96b2aa5033be" (UID: "ee719752-a5d9-40c1-ad5f-96b2aa5033be"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 13:41:02.298112 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:02.297996    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee719752-a5d9-40c1-ad5f-96b2aa5033be-kube-api-access-4f5bd" (OuterVolumeSpecName: "kube-api-access-4f5bd") pod "ee719752-a5d9-40c1-ad5f-96b2aa5033be" (UID: "ee719752-a5d9-40c1-ad5f-96b2aa5033be"). InnerVolumeSpecName "kube-api-access-4f5bd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 13:41:02.397320 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:02.397226    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee719752-a5d9-40c1-ad5f-96b2aa5033be-webhook-cert\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:41:02.397320 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:02.397269    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4f5bd\" (UniqueName: \"kubernetes.io/projected/ee719752-a5d9-40c1-ad5f-96b2aa5033be-kube-api-access-4f5bd\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:41:02.876317 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:02.876277    2562 generic.go:356] "Generic (PLEG): container finished" podID="ee719752-a5d9-40c1-ad5f-96b2aa5033be" containerID="f27c6817049f2e053ebb07f44db98f46b2749c51fbcf005ed5c0db33c2e92c41" exitCode=0
Jun 09 13:41:02.876843 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:02.876344    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-864fd557f6-65xf2"
Jun 09 13:41:02.876843 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:02.876353    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-864fd557f6-65xf2" event={"ID":"ee719752-a5d9-40c1-ad5f-96b2aa5033be","Type":"ContainerDied","Data":"f27c6817049f2e053ebb07f44db98f46b2749c51fbcf005ed5c0db33c2e92c41"}
Jun 09 13:41:02.876843 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:02.876433    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-864fd557f6-65xf2" event={"ID":"ee719752-a5d9-40c1-ad5f-96b2aa5033be","Type":"ContainerDied","Data":"69ab4d7c89059e5d26c0f52ffd5c5306b12f91c4b357e9c87425dc20e92eb329"}
Jun 09 13:41:02.876843 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:02.876456    2562 scope.go:117] "RemoveContainer" containerID="f27c6817049f2e053ebb07f44db98f46b2749c51fbcf005ed5c0db33c2e92c41"
Jun 09 13:41:02.885530 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:02.885509    2562 scope.go:117] "RemoveContainer" containerID="f27c6817049f2e053ebb07f44db98f46b2749c51fbcf005ed5c0db33c2e92c41"
Jun 09 13:41:02.885845 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:41:02.885826    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f27c6817049f2e053ebb07f44db98f46b2749c51fbcf005ed5c0db33c2e92c41\": container with ID starting with f27c6817049f2e053ebb07f44db98f46b2749c51fbcf005ed5c0db33c2e92c41 not found: ID does not exist" containerID="f27c6817049f2e053ebb07f44db98f46b2749c51fbcf005ed5c0db33c2e92c41"
Jun 09 13:41:02.885926 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:02.885851    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f27c6817049f2e053ebb07f44db98f46b2749c51fbcf005ed5c0db33c2e92c41"} err="failed to get container status \"f27c6817049f2e053ebb07f44db98f46b2749c51fbcf005ed5c0db33c2e92c41\": rpc error: code = NotFound desc = could not find container \"f27c6817049f2e053ebb07f44db98f46b2749c51fbcf005ed5c0db33c2e92c41\": container with ID starting with f27c6817049f2e053ebb07f44db98f46b2749c51fbcf005ed5c0db33c2e92c41 not found: ID does not exist"
Jun 09 13:41:02.897455 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:02.897435    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-864fd557f6-65xf2"]
Jun 09 13:41:02.901604 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:02.901581    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-864fd557f6-65xf2"]
Jun 09 13:41:03.054490 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:03.054456    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee719752-a5d9-40c1-ad5f-96b2aa5033be" path="/var/lib/kubelet/pods/ee719752-a5d9-40c1-ad5f-96b2aa5033be/volumes"
Jun 09 13:41:21.412833 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.412741    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:41:21.453482 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.453452    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-867b78df65-hcrrx"]
Jun 09 13:41:21.453811 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.453797    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee719752-a5d9-40c1-ad5f-96b2aa5033be" containerName="manager"
Jun 09 13:41:21.453857 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.453813    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee719752-a5d9-40c1-ad5f-96b2aa5033be" containerName="manager"
Jun 09 13:41:21.453894 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.453867    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee719752-a5d9-40c1-ad5f-96b2aa5033be" containerName="manager"
Jun 09 13:41:21.458167 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.458152    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-867b78df65-hcrrx"
Jun 09 13:41:21.460266 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.460238    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jun 09 13:41:21.460376 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.460363    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xq296\""
Jun 09 13:41:21.465477 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.465131    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-867b78df65-hcrrx"]
Jun 09 13:41:21.551746 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.551703    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2899057-eff8-4331-bd84-b916da4a122f-maas-api-tls\") pod \"maas-api-867b78df65-hcrrx\" (UID: \"f2899057-eff8-4331-bd84-b916da4a122f\") " pod="opendatahub/maas-api-867b78df65-hcrrx"
Jun 09 13:41:21.551934 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.551840    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68g7c\" (UniqueName: \"kubernetes.io/projected/f2899057-eff8-4331-bd84-b916da4a122f-kube-api-access-68g7c\") pod \"maas-api-867b78df65-hcrrx\" (UID: \"f2899057-eff8-4331-bd84-b916da4a122f\") " pod="opendatahub/maas-api-867b78df65-hcrrx"
Jun 09 13:41:21.600425 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.600394    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:41:21.652208 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.652175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68g7c\" (UniqueName: \"kubernetes.io/projected/f2899057-eff8-4331-bd84-b916da4a122f-kube-api-access-68g7c\") pod \"maas-api-867b78df65-hcrrx\" (UID: \"f2899057-eff8-4331-bd84-b916da4a122f\") " pod="opendatahub/maas-api-867b78df65-hcrrx"
Jun 09 13:41:21.652397 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.652224    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2899057-eff8-4331-bd84-b916da4a122f-maas-api-tls\") pod \"maas-api-867b78df65-hcrrx\" (UID: \"f2899057-eff8-4331-bd84-b916da4a122f\") " pod="opendatahub/maas-api-867b78df65-hcrrx"
Jun 09 13:41:21.654805 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.654782    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2899057-eff8-4331-bd84-b916da4a122f-maas-api-tls\") pod \"maas-api-867b78df65-hcrrx\" (UID: \"f2899057-eff8-4331-bd84-b916da4a122f\") " pod="opendatahub/maas-api-867b78df65-hcrrx"
Jun 09 13:41:21.662190 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.662164    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68g7c\" (UniqueName: \"kubernetes.io/projected/f2899057-eff8-4331-bd84-b916da4a122f-kube-api-access-68g7c\") pod \"maas-api-867b78df65-hcrrx\" (UID: \"f2899057-eff8-4331-bd84-b916da4a122f\") " pod="opendatahub/maas-api-867b78df65-hcrrx"
Jun 09 13:41:21.769650 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.769617    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-867b78df65-hcrrx"
Jun 09 13:41:21.840878 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.840851    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:41:21.908886 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.908854    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-867b78df65-hcrrx"]
Jun 09 13:41:21.911654 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:41:21.911624    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2899057_eff8_4331_bd84_b916da4a122f.slice/crio-035fa375f748712690e643d7caefea8545c2a02fd86d640a3fa6b6adb5ba981d WatchSource:0}: Error finding container 035fa375f748712690e643d7caefea8545c2a02fd86d640a3fa6b6adb5ba981d: Status 404 returned error can't find the container with id 035fa375f748712690e643d7caefea8545c2a02fd86d640a3fa6b6adb5ba981d
Jun 09 13:41:21.912386 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.912364    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:41:21.940257 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.940227    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-vnjpm"]
Jun 09 13:41:21.944500 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.944484    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-vnjpm"
Jun 09 13:41:21.946692 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.946672    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jun 09 13:41:21.953347 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.953323    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-vnjpm"]
Jun 09 13:41:21.955319 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.955299    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvqrs\" (UniqueName: \"kubernetes.io/projected/e68a784f-4ded-4d5b-9f8b-eff0775c7c48-kube-api-access-bvqrs\") pod \"payload-pre-processing-67d7689b65-vnjpm\" (UID: \"e68a784f-4ded-4d5b-9f8b-eff0775c7c48\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-vnjpm"
Jun 09 13:41:21.958095 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:21.958072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-867b78df65-hcrrx" event={"ID":"f2899057-eff8-4331-bd84-b916da4a122f","Type":"ContainerStarted","Data":"035fa375f748712690e643d7caefea8545c2a02fd86d640a3fa6b6adb5ba981d"}
Jun 09 13:41:22.055880 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:22.055804    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvqrs\" (UniqueName: \"kubernetes.io/projected/e68a784f-4ded-4d5b-9f8b-eff0775c7c48-kube-api-access-bvqrs\") pod \"payload-pre-processing-67d7689b65-vnjpm\" (UID: \"e68a784f-4ded-4d5b-9f8b-eff0775c7c48\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-vnjpm"
Jun 09 13:41:22.066430 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:22.066405    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvqrs\" (UniqueName: \"kubernetes.io/projected/e68a784f-4ded-4d5b-9f8b-eff0775c7c48-kube-api-access-bvqrs\") pod \"payload-pre-processing-67d7689b65-vnjpm\" (UID: \"e68a784f-4ded-4d5b-9f8b-eff0775c7c48\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-vnjpm"
Jun 09 13:41:22.255470 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:22.255435    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-vnjpm"
Jun 09 13:41:22.385853 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:22.385827    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-vnjpm"]
Jun 09 13:41:22.388377 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:41:22.388349    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68a784f_4ded_4d5b_9f8b_eff0775c7c48.slice/crio-02d8fbcfe7c08c0234ddf7bc49a4c6ba43fca3f5b6fb72b51afe750c030dabc1 WatchSource:0}: Error finding container 02d8fbcfe7c08c0234ddf7bc49a4c6ba43fca3f5b6fb72b51afe750c030dabc1: Status 404 returned error can't find the container with id 02d8fbcfe7c08c0234ddf7bc49a4c6ba43fca3f5b6fb72b51afe750c030dabc1
Jun 09 13:41:22.964039 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:22.963999    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-vnjpm" event={"ID":"e68a784f-4ded-4d5b-9f8b-eff0775c7c48","Type":"ContainerStarted","Data":"02d8fbcfe7c08c0234ddf7bc49a4c6ba43fca3f5b6fb72b51afe750c030dabc1"}
Jun 09 13:41:24.974112 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:24.974064    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-867b78df65-hcrrx" event={"ID":"f2899057-eff8-4331-bd84-b916da4a122f","Type":"ContainerStarted","Data":"d0ac5ee03124700da94356eb50e52b5de19184cabfedea997127bd37d34befb8"}
Jun 09 13:41:24.974504 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:24.974130    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-867b78df65-hcrrx"
Jun 09 13:41:24.975488 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:24.975464    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-vnjpm" event={"ID":"e68a784f-4ded-4d5b-9f8b-eff0775c7c48","Type":"ContainerStarted","Data":"e3d058d1ef560ca21dc0ee8d551bfcf6b55db35894e3790d05239456f09f3db4"}
Jun 09 13:41:24.975620 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:24.975515    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-vnjpm"
Jun 09 13:41:24.991148 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:24.991101    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-867b78df65-hcrrx" podStartSLOduration=1.924458076 podStartE2EDuration="3.9910826s" totalImagesPullingTime="2.066624524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:41:24.989354274 +0000 UTC m=+784.364025034" watchObservedRunningTime="2026-06-09 13:41:24.9910826 +0000 UTC m=+784.365753361"
Jun 09 13:41:25.005514 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:25.005456    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-vnjpm" podStartSLOduration=2.413614768 podStartE2EDuration="4.005440037s" totalImagesPullingTime="1.591825269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:41:25.004342096 +0000 UTC m=+784.379012858" watchObservedRunningTime="2026-06-09 13:41:25.005440037 +0000 UTC m=+784.380110799"
Jun 09 13:41:30.984338 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:30.984306    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-867b78df65-hcrrx"
Jun 09 13:41:32.762851 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:32.762816    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 09 13:41:32.763241 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:32.763014    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="87ee207d-65a8-44a3-a97b-243e6f8ff677" containerName="keycloak" containerID="cri-o://3eab580d8dee2d8e7160cafdfdcd36df7cb95e9682b129afa2fcc06deb7dfe4b" gracePeriod=30
Jun 09 13:41:34.411381 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:34.411352    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 09 13:41:34.459549 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:34.459512    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj4l2\" (UniqueName: \"kubernetes.io/projected/87ee207d-65a8-44a3-a97b-243e6f8ff677-kube-api-access-rj4l2\") pod \"87ee207d-65a8-44a3-a97b-243e6f8ff677\" (UID: \"87ee207d-65a8-44a3-a97b-243e6f8ff677\") "
Jun 09 13:41:34.461912 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:34.461878    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87ee207d-65a8-44a3-a97b-243e6f8ff677-kube-api-access-rj4l2" (OuterVolumeSpecName: "kube-api-access-rj4l2") pod "87ee207d-65a8-44a3-a97b-243e6f8ff677" (UID: "87ee207d-65a8-44a3-a97b-243e6f8ff677"). InnerVolumeSpecName "kube-api-access-rj4l2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 13:41:34.560259 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:34.560229    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj4l2\" (UniqueName: \"kubernetes.io/projected/87ee207d-65a8-44a3-a97b-243e6f8ff677-kube-api-access-rj4l2\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:41:35.019617 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.019584    2562 generic.go:356] "Generic (PLEG): container finished" podID="87ee207d-65a8-44a3-a97b-243e6f8ff677" containerID="3eab580d8dee2d8e7160cafdfdcd36df7cb95e9682b129afa2fcc06deb7dfe4b" exitCode=143
Jun 09 13:41:35.019802 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.019636    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"87ee207d-65a8-44a3-a97b-243e6f8ff677","Type":"ContainerDied","Data":"3eab580d8dee2d8e7160cafdfdcd36df7cb95e9682b129afa2fcc06deb7dfe4b"}
Jun 09 13:41:35.019802 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.019639    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 09 13:41:35.019802 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.019702    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"87ee207d-65a8-44a3-a97b-243e6f8ff677","Type":"ContainerDied","Data":"06b5a3824121e328c177ea68d36e484196cf9aa31e5345f2bfd04b7c9d4e7ed4"}
Jun 09 13:41:35.019802 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.019722    2562 scope.go:117] "RemoveContainer" containerID="3eab580d8dee2d8e7160cafdfdcd36df7cb95e9682b129afa2fcc06deb7dfe4b"
Jun 09 13:41:35.029627 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.029611    2562 scope.go:117] "RemoveContainer" containerID="3eab580d8dee2d8e7160cafdfdcd36df7cb95e9682b129afa2fcc06deb7dfe4b"
Jun 09 13:41:35.029911 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:41:35.029889    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eab580d8dee2d8e7160cafdfdcd36df7cb95e9682b129afa2fcc06deb7dfe4b\": container with ID starting with 3eab580d8dee2d8e7160cafdfdcd36df7cb95e9682b129afa2fcc06deb7dfe4b not found: ID does not exist" containerID="3eab580d8dee2d8e7160cafdfdcd36df7cb95e9682b129afa2fcc06deb7dfe4b"
Jun 09 13:41:35.029961 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.029919    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eab580d8dee2d8e7160cafdfdcd36df7cb95e9682b129afa2fcc06deb7dfe4b"} err="failed to get container status \"3eab580d8dee2d8e7160cafdfdcd36df7cb95e9682b129afa2fcc06deb7dfe4b\": rpc error: code = NotFound desc = could not find container \"3eab580d8dee2d8e7160cafdfdcd36df7cb95e9682b129afa2fcc06deb7dfe4b\": container with ID starting with 3eab580d8dee2d8e7160cafdfdcd36df7cb95e9682b129afa2fcc06deb7dfe4b not found: ID does not exist"
Jun 09 13:41:35.041101 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.041076    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 09 13:41:35.045114 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.045095    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 09 13:41:35.054531 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.054511    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87ee207d-65a8-44a3-a97b-243e6f8ff677" path="/var/lib/kubelet/pods/87ee207d-65a8-44a3-a97b-243e6f8ff677/volumes"
Jun 09 13:41:35.067537 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.067513    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 09 13:41:35.067826 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.067813    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87ee207d-65a8-44a3-a97b-243e6f8ff677" containerName="keycloak"
Jun 09 13:41:35.067880 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.067828    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="87ee207d-65a8-44a3-a97b-243e6f8ff677" containerName="keycloak"
Jun 09 13:41:35.067913 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.067897    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="87ee207d-65a8-44a3-a97b-243e6f8ff677" containerName="keycloak"
Jun 09 13:41:35.071815 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.071801    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 09 13:41:35.074424 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.074380    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 09 13:41:35.074424 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.074383    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 09 13:41:35.074424 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.074406    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\""
Jun 09 13:41:35.074668 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.074652    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-s4pkd\""
Jun 09 13:41:35.074718 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.074682    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 09 13:41:35.083041 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.083016    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 09 13:41:35.165968 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.165938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/571302f2-a8bd-435d-a534-e86de5a488f9-test-realms\") pod \"maas-keycloak-0\" (UID: \"571302f2-a8bd-435d-a534-e86de5a488f9\") " pod="keycloak-system/maas-keycloak-0"
Jun 09 13:41:35.166139 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.165986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54k8w\" (UniqueName: \"kubernetes.io/projected/571302f2-a8bd-435d-a534-e86de5a488f9-kube-api-access-54k8w\") pod \"maas-keycloak-0\" (UID: \"571302f2-a8bd-435d-a534-e86de5a488f9\") " pod="keycloak-system/maas-keycloak-0"
Jun 09 13:41:35.266848 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.266813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/571302f2-a8bd-435d-a534-e86de5a488f9-test-realms\") pod \"maas-keycloak-0\" (UID: \"571302f2-a8bd-435d-a534-e86de5a488f9\") " pod="keycloak-system/maas-keycloak-0"
Jun 09 13:41:35.267020 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.266860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54k8w\" (UniqueName: \"kubernetes.io/projected/571302f2-a8bd-435d-a534-e86de5a488f9-kube-api-access-54k8w\") pod \"maas-keycloak-0\" (UID: \"571302f2-a8bd-435d-a534-e86de5a488f9\") " pod="keycloak-system/maas-keycloak-0"
Jun 09 13:41:35.267501 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.267480    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/571302f2-a8bd-435d-a534-e86de5a488f9-test-realms\") pod \"maas-keycloak-0\" (UID: \"571302f2-a8bd-435d-a534-e86de5a488f9\") " pod="keycloak-system/maas-keycloak-0"
Jun 09 13:41:35.276103 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.276041    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54k8w\" (UniqueName: \"kubernetes.io/projected/571302f2-a8bd-435d-a534-e86de5a488f9-kube-api-access-54k8w\") pod \"maas-keycloak-0\" (UID: \"571302f2-a8bd-435d-a534-e86de5a488f9\") " pod="keycloak-system/maas-keycloak-0"
Jun 09 13:41:35.381121 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.381082    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 09 13:41:35.509871 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.509845    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 09 13:41:35.512726 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:41:35.512701    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod571302f2_a8bd_435d_a534_e86de5a488f9.slice/crio-10be279043f3e8094492f629d21c46d26b1f70825ac74a574e1e65df929060ec WatchSource:0}: Error finding container 10be279043f3e8094492f629d21c46d26b1f70825ac74a574e1e65df929060ec: Status 404 returned error can't find the container with id 10be279043f3e8094492f629d21c46d26b1f70825ac74a574e1e65df929060ec
Jun 09 13:41:35.981678 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:35.981653    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-vnjpm"
Jun 09 13:41:36.027877 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:36.027831    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"571302f2-a8bd-435d-a534-e86de5a488f9","Type":"ContainerStarted","Data":"3dd93933d68b9860e978be2c875d4f0ccb67fea5aed8841083d4fdcd0032ab54"}
Jun 09 13:41:36.027877 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:36.027883    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"571302f2-a8bd-435d-a534-e86de5a488f9","Type":"ContainerStarted","Data":"10be279043f3e8094492f629d21c46d26b1f70825ac74a574e1e65df929060ec"}
Jun 09 13:41:36.046624 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:36.046568    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.64789163 podStartE2EDuration="1.046551065s" totalImagesPullingTime="398.659435ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:41:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:41:36.044841942 +0000 UTC m=+795.419512704" watchObservedRunningTime="2026-06-09 13:41:36.046551065 +0000 UTC m=+795.421221826"
Jun 09 13:41:36.381539 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:36.381492    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 09 13:41:36.383122 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:36.383089    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="571302f2-a8bd-435d-a534-e86de5a488f9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused"
Jun 09 13:41:37.381635 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:37.381583    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="571302f2-a8bd-435d-a534-e86de5a488f9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused"
Jun 09 13:41:38.382675 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:38.382631    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="571302f2-a8bd-435d-a534-e86de5a488f9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused"
Jun 09 13:41:39.381711 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:39.381651    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="571302f2-a8bd-435d-a534-e86de5a488f9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused"
Jun 09 13:41:40.382408 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:40.382361    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="571302f2-a8bd-435d-a534-e86de5a488f9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused"
Jun 09 13:41:41.381686 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:41.381632    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="571302f2-a8bd-435d-a534-e86de5a488f9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused"
Jun 09 13:41:42.382556 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:42.382501    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="571302f2-a8bd-435d-a534-e86de5a488f9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused"
Jun 09 13:41:43.382633 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:43.382580    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="571302f2-a8bd-435d-a534-e86de5a488f9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused"
Jun 09 13:41:44.381791 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:44.381745    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="571302f2-a8bd-435d-a534-e86de5a488f9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused"
Jun 09 13:41:45.382060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:45.382014    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 09 13:41:45.382561 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:45.382312    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="571302f2-a8bd-435d-a534-e86de5a488f9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused"
Jun 09 13:41:46.382107 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:46.382062    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="571302f2-a8bd-435d-a534-e86de5a488f9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused"
Jun 09 13:41:47.382301 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:47.382261    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="571302f2-a8bd-435d-a534-e86de5a488f9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused"
Jun 09 13:41:48.382318 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:48.382265    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="571302f2-a8bd-435d-a534-e86de5a488f9" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.31:9000/health/started\": dial tcp 10.134.0.31:9000: connect: connection refused"
Jun 09 13:41:49.508768 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:49.508081    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 09 13:41:49.526798 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:49.526720    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="571302f2-a8bd-435d-a534-e86de5a488f9" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 09 13:41:59.514181 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:41:59.514140    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 09 13:42:10.208360 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:10.208329    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54db447f7c-27n4q"]
Jun 09 13:42:10.211817 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:10.211796    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54db447f7c-27n4q"
Jun 09 13:42:10.214067 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:10.214040    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\""
Jun 09 13:42:10.220292 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:10.220271    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54db447f7c-27n4q"]
Jun 09 13:42:10.301595 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:10.301560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-oidc-ca\") pod \"authorino-54db447f7c-27n4q\" (UID: \"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b\") " pod="kuadrant-system/authorino-54db447f7c-27n4q"
Jun 09 13:42:10.301768 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:10.301600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7krp\" (UniqueName: \"kubernetes.io/projected/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-kube-api-access-j7krp\") pod \"authorino-54db447f7c-27n4q\" (UID: \"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b\") " pod="kuadrant-system/authorino-54db447f7c-27n4q"
Jun 09 13:42:10.301768 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:10.301683    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-tls-cert\") pod \"authorino-54db447f7c-27n4q\" (UID: \"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b\") " pod="kuadrant-system/authorino-54db447f7c-27n4q"
Jun 09 13:42:10.403064 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:10.403025    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-tls-cert\") pod \"authorino-54db447f7c-27n4q\" (UID: \"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b\") " pod="kuadrant-system/authorino-54db447f7c-27n4q"
Jun 09 13:42:10.403235 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:10.403101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-oidc-ca\") pod \"authorino-54db447f7c-27n4q\" (UID: \"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b\") " pod="kuadrant-system/authorino-54db447f7c-27n4q"
Jun 09 13:42:10.403235 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:10.403124    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7krp\" (UniqueName: \"kubernetes.io/projected/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-kube-api-access-j7krp\") pod \"authorino-54db447f7c-27n4q\" (UID: \"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b\") " pod="kuadrant-system/authorino-54db447f7c-27n4q"
Jun 09 13:42:10.403835 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:10.403817    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-oidc-ca\") pod \"authorino-54db447f7c-27n4q\" (UID: \"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b\") " pod="kuadrant-system/authorino-54db447f7c-27n4q"
Jun 09 13:42:10.405541 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:10.405522    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-tls-cert\") pod \"authorino-54db447f7c-27n4q\" (UID: \"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b\") " pod="kuadrant-system/authorino-54db447f7c-27n4q"
Jun 09 13:42:10.411609 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:10.411582    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7krp\" (UniqueName: \"kubernetes.io/projected/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-kube-api-access-j7krp\") pod \"authorino-54db447f7c-27n4q\" (UID: \"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b\") " pod="kuadrant-system/authorino-54db447f7c-27n4q"
Jun 09 13:42:10.521172 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:10.521094    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54db447f7c-27n4q"
Jun 09 13:42:10.648559 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:10.648531    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54db447f7c-27n4q"]
Jun 09 13:42:10.650951 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:42:10.650926    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2d78c78_bab8_455a_b8d8_7942fe8c9e5b.slice/crio-dfdd03821931688f1fb6dd8f9acaee68efda9872ae69111ef0d018ba2a540fa7 WatchSource:0}: Error finding container dfdd03821931688f1fb6dd8f9acaee68efda9872ae69111ef0d018ba2a540fa7: Status 404 returned error can't find the container with id dfdd03821931688f1fb6dd8f9acaee68efda9872ae69111ef0d018ba2a540fa7
Jun 09 13:42:11.217059 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:11.217023    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54db447f7c-27n4q" event={"ID":"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b","Type":"ContainerStarted","Data":"951ca71fe706640feeaf8af441f28aa909a5b18306337b3f8128b83c16a22dc9"}
Jun 09 13:42:11.217403 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:11.217077    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54db447f7c-27n4q" event={"ID":"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b","Type":"ContainerStarted","Data":"dfdd03821931688f1fb6dd8f9acaee68efda9872ae69111ef0d018ba2a540fa7"}
Jun 09 13:42:11.232547 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:11.232492    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54db447f7c-27n4q" podStartSLOduration=0.736099883 podStartE2EDuration="1.232474014s" totalImagesPullingTime="496.374131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:42:11.23145925 +0000 UTC m=+830.606130011" watchObservedRunningTime="2026-06-09 13:42:11.232474014 +0000 UTC m=+830.607144777"
Jun 09 13:42:11.258632 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:11.258598    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7448575897-l6vxx"]
Jun 09 13:42:11.258984 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:11.258956    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7448575897-l6vxx" podUID="8b62889c-5837-46a7-ae2c-34e8a00daaf6" containerName="authorino" containerID="cri-o://05f9476a40d7453cb032a211e0a21bb007a85b56d850d8f94829124b4b16d94f" gracePeriod=30
Jun 09 13:42:11.533350 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:11.533320    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7448575897-l6vxx"
Jun 09 13:42:11.618901 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:11.618871    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjtzk\" (UniqueName: \"kubernetes.io/projected/8b62889c-5837-46a7-ae2c-34e8a00daaf6-kube-api-access-sjtzk\") pod \"8b62889c-5837-46a7-ae2c-34e8a00daaf6\" (UID: \"8b62889c-5837-46a7-ae2c-34e8a00daaf6\") "
Jun 09 13:42:11.619087 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:11.618926    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8b62889c-5837-46a7-ae2c-34e8a00daaf6-tls-cert\") pod \"8b62889c-5837-46a7-ae2c-34e8a00daaf6\" (UID: \"8b62889c-5837-46a7-ae2c-34e8a00daaf6\") "
Jun 09 13:42:11.623091 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:11.623038    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b62889c-5837-46a7-ae2c-34e8a00daaf6-kube-api-access-sjtzk" (OuterVolumeSpecName: "kube-api-access-sjtzk") pod "8b62889c-5837-46a7-ae2c-34e8a00daaf6" (UID: "8b62889c-5837-46a7-ae2c-34e8a00daaf6"). InnerVolumeSpecName "kube-api-access-sjtzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 13:42:11.632470 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:11.632418    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b62889c-5837-46a7-ae2c-34e8a00daaf6-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8b62889c-5837-46a7-ae2c-34e8a00daaf6" (UID: "8b62889c-5837-46a7-ae2c-34e8a00daaf6"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 13:42:11.657368 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:11.657328    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:42:11.720181 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:11.720142    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjtzk\" (UniqueName: \"kubernetes.io/projected/8b62889c-5837-46a7-ae2c-34e8a00daaf6-kube-api-access-sjtzk\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:42:11.720181 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:11.720176    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8b62889c-5837-46a7-ae2c-34e8a00daaf6-tls-cert\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:42:11.760119 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:11.760077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:42:12.222519 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:12.222487    2562 generic.go:356] "Generic (PLEG): container finished" podID="8b62889c-5837-46a7-ae2c-34e8a00daaf6" containerID="05f9476a40d7453cb032a211e0a21bb007a85b56d850d8f94829124b4b16d94f" exitCode=0
Jun 09 13:42:12.222992 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:12.222530    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7448575897-l6vxx"
Jun 09 13:42:12.222992 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:12.222582    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7448575897-l6vxx" event={"ID":"8b62889c-5837-46a7-ae2c-34e8a00daaf6","Type":"ContainerDied","Data":"05f9476a40d7453cb032a211e0a21bb007a85b56d850d8f94829124b4b16d94f"}
Jun 09 13:42:12.222992 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:12.222619    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7448575897-l6vxx" event={"ID":"8b62889c-5837-46a7-ae2c-34e8a00daaf6","Type":"ContainerDied","Data":"7519d8daa8f4c7f4158a541efe19dc8fd354cf67469560753e57105f83986a57"}
Jun 09 13:42:12.222992 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:12.222637    2562 scope.go:117] "RemoveContainer" containerID="05f9476a40d7453cb032a211e0a21bb007a85b56d850d8f94829124b4b16d94f"
Jun 09 13:42:12.231330 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:12.231310    2562 scope.go:117] "RemoveContainer" containerID="05f9476a40d7453cb032a211e0a21bb007a85b56d850d8f94829124b4b16d94f"
Jun 09 13:42:12.231600 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:42:12.231582    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05f9476a40d7453cb032a211e0a21bb007a85b56d850d8f94829124b4b16d94f\": container with ID starting with 05f9476a40d7453cb032a211e0a21bb007a85b56d850d8f94829124b4b16d94f not found: ID does not exist" containerID="05f9476a40d7453cb032a211e0a21bb007a85b56d850d8f94829124b4b16d94f"
Jun 09 13:42:12.231666 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:12.231613    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05f9476a40d7453cb032a211e0a21bb007a85b56d850d8f94829124b4b16d94f"} err="failed to get container status \"05f9476a40d7453cb032a211e0a21bb007a85b56d850d8f94829124b4b16d94f\": rpc error: code = NotFound desc = could not find container \"05f9476a40d7453cb032a211e0a21bb007a85b56d850d8f94829124b4b16d94f\": container with ID starting with 05f9476a40d7453cb032a211e0a21bb007a85b56d850d8f94829124b4b16d94f not found: ID does not exist"
Jun 09 13:42:12.247126 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:12.247104    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7448575897-l6vxx"]
Jun 09 13:42:12.251489 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:12.251469    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7448575897-l6vxx"]
Jun 09 13:42:13.055037 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:13.055004    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b62889c-5837-46a7-ae2c-34e8a00daaf6" path="/var/lib/kubelet/pods/8b62889c-5837-46a7-ae2c-34e8a00daaf6/volumes"
Jun 09 13:42:15.484342 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.484302    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"]
Jun 09 13:42:15.484712 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.484693    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b62889c-5837-46a7-ae2c-34e8a00daaf6" containerName="authorino"
Jun 09 13:42:15.484712 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.484705    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b62889c-5837-46a7-ae2c-34e8a00daaf6" containerName="authorino"
Jun 09 13:42:15.484819 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.484780    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b62889c-5837-46a7-ae2c-34e8a00daaf6" containerName="authorino"
Jun 09 13:42:15.489250 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.489231    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.492337 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.492315    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5bns2\""
Jun 09 13:42:15.492337 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.492330    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 09 13:42:15.492524 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.492320    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jun 09 13:42:15.492524 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.492397    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 09 13:42:15.498300 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.498278    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"]
Jun 09 13:42:15.519791 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.519751    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:42:15.551095 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.551061    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d323659b-4eaf-47b0-970b-3b653b473fe1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.551232 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.551103    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d323659b-4eaf-47b0-970b-3b653b473fe1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.551232 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.551154    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d323659b-4eaf-47b0-970b-3b653b473fe1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.551232 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.551193    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d323659b-4eaf-47b0-970b-3b653b473fe1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.551351 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.551231    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d323659b-4eaf-47b0-970b-3b653b473fe1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.551351 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.551248    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt4np\" (UniqueName: \"kubernetes.io/projected/d323659b-4eaf-47b0-970b-3b653b473fe1-kube-api-access-pt4np\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.652401 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.652360    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d323659b-4eaf-47b0-970b-3b653b473fe1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.652401 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.652407    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d323659b-4eaf-47b0-970b-3b653b473fe1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.652613 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.652433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d323659b-4eaf-47b0-970b-3b653b473fe1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.652613 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.652460    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d323659b-4eaf-47b0-970b-3b653b473fe1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.652613 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.652491    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d323659b-4eaf-47b0-970b-3b653b473fe1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.652613 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.652515    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt4np\" (UniqueName: \"kubernetes.io/projected/d323659b-4eaf-47b0-970b-3b653b473fe1-kube-api-access-pt4np\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.652865 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.652839    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d323659b-4eaf-47b0-970b-3b653b473fe1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.652941 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.652924    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d323659b-4eaf-47b0-970b-3b653b473fe1-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.653002 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.652962    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d323659b-4eaf-47b0-970b-3b653b473fe1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.654947 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.654925    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d323659b-4eaf-47b0-970b-3b653b473fe1-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.655063 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.655022    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d323659b-4eaf-47b0-970b-3b653b473fe1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.661369 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.661345    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt4np\" (UniqueName: \"kubernetes.io/projected/d323659b-4eaf-47b0-970b-3b653b473fe1-kube-api-access-pt4np\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk\" (UID: \"d323659b-4eaf-47b0-970b-3b653b473fe1\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.800419 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.800334    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"
Jun 09 13:42:15.933128 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:15.933105    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk"]
Jun 09 13:42:15.935664 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:42:15.935640    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd323659b_4eaf_47b0_970b_3b653b473fe1.slice/crio-e01ecb037f4eec3731b0109b351db4fcc645ce00c3e81e1737f70d9c180384ea WatchSource:0}: Error finding container e01ecb037f4eec3731b0109b351db4fcc645ce00c3e81e1737f70d9c180384ea: Status 404 returned error can't find the container with id e01ecb037f4eec3731b0109b351db4fcc645ce00c3e81e1737f70d9c180384ea
Jun 09 13:42:16.242509 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:16.242473    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk" event={"ID":"d323659b-4eaf-47b0-970b-3b653b473fe1","Type":"ContainerStarted","Data":"e01ecb037f4eec3731b0109b351db4fcc645ce00c3e81e1737f70d9c180384ea"}
Jun 09 13:42:19.825215 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:19.825182    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:42:20.263760 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:20.263699    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk" event={"ID":"d323659b-4eaf-47b0-970b-3b653b473fe1","Type":"ContainerStarted","Data":"ae7cb0f8274b01405875746fa6bb0c7305c61a6728fd5079cdca31a0116cdd21"}
Jun 09 13:42:29.283707 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.283676    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"]
Jun 09 13:42:29.289385 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.289364    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.291579 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.291558    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jun 09 13:42:29.298312 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.298289    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"]
Jun 09 13:42:29.317742 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.317710    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:42:29.369744 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.369706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdvwj\" (UniqueName: \"kubernetes.io/projected/ecb58e9a-eda4-446d-970f-4d16d2f882ea-kube-api-access-sdvwj\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.369860 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.369796    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecb58e9a-eda4-446d-970f-4d16d2f882ea-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.369860 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.369823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ecb58e9a-eda4-446d-970f-4d16d2f882ea-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.369965 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.369867    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecb58e9a-eda4-446d-970f-4d16d2f882ea-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.369965 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.369904    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecb58e9a-eda4-446d-970f-4d16d2f882ea-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.369965 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.369920    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecb58e9a-eda4-446d-970f-4d16d2f882ea-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.470346 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.470305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdvwj\" (UniqueName: \"kubernetes.io/projected/ecb58e9a-eda4-446d-970f-4d16d2f882ea-kube-api-access-sdvwj\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.470519 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.470362    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecb58e9a-eda4-446d-970f-4d16d2f882ea-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.470519 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.470393    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ecb58e9a-eda4-446d-970f-4d16d2f882ea-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.470519 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.470439    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecb58e9a-eda4-446d-970f-4d16d2f882ea-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.470519 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.470473    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecb58e9a-eda4-446d-970f-4d16d2f882ea-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.470519 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.470497    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecb58e9a-eda4-446d-970f-4d16d2f882ea-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.470834 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.470810    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ecb58e9a-eda4-446d-970f-4d16d2f882ea-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.470897 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.470868    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecb58e9a-eda4-446d-970f-4d16d2f882ea-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.470948 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.470896    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecb58e9a-eda4-446d-970f-4d16d2f882ea-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.472914 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.472882    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecb58e9a-eda4-446d-970f-4d16d2f882ea-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.473177 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.473158    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecb58e9a-eda4-446d-970f-4d16d2f882ea-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.478495 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.478474    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdvwj\" (UniqueName: \"kubernetes.io/projected/ecb58e9a-eda4-446d-970f-4d16d2f882ea-kube-api-access-sdvwj\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg\" (UID: \"ecb58e9a-eda4-446d-970f-4d16d2f882ea\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.602902 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.602821    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:29.730848 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:29.730825    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"]
Jun 09 13:42:30.307129 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:30.307086    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg" event={"ID":"ecb58e9a-eda4-446d-970f-4d16d2f882ea","Type":"ContainerStarted","Data":"83fba0c3bd11515b1634715a12fd67a23c5281785b34e2c9d4c02629b262118a"}
Jun 09 13:42:30.307572 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:30.307187    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg" event={"ID":"ecb58e9a-eda4-446d-970f-4d16d2f882ea","Type":"ContainerStarted","Data":"c182048d4c8e6065fc1fcca1fd61a9e860ecab5764b4688b5e863052493099c5"}
Jun 09 13:42:31.312528 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:31.312492    2562 generic.go:356] "Generic (PLEG): container finished" podID="ecb58e9a-eda4-446d-970f-4d16d2f882ea" containerID="83fba0c3bd11515b1634715a12fd67a23c5281785b34e2c9d4c02629b262118a" exitCode=0
Jun 09 13:42:31.313023 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:31.312531    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg" event={"ID":"ecb58e9a-eda4-446d-970f-4d16d2f882ea","Type":"ContainerDied","Data":"83fba0c3bd11515b1634715a12fd67a23c5281785b34e2c9d4c02629b262118a"}
Jun 09 13:42:33.325035 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:33.325000    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg" event={"ID":"ecb58e9a-eda4-446d-970f-4d16d2f882ea","Type":"ContainerStarted","Data":"b33030cf89e42a978ea30008dd6684fe11d79a50fd47b4d9df988da3292a9369"}
Jun 09 13:42:33.345599 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:33.345539    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg" podStartSLOduration=1.426119248 podStartE2EDuration="4.345522232s" totalImagesPullingTime="1.561535254s" totalInitContainerRuntime="1.35786773s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:42:33.344592874 +0000 UTC m=+852.719263636" watchObservedRunningTime="2026-06-09 13:42:33.345522232 +0000 UTC m=+852.720192993"
Jun 09 13:42:36.189725 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.189690    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"]
Jun 09 13:42:36.195077 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.195043    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.197777 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.197755    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jun 09 13:42:36.205559 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.205533    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"]
Jun 09 13:42:36.213518 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.213490    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:42:36.329961 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.329917    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a57a539-3e56-45c5-b682-3bae18a1a583-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.330146 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.329991    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a57a539-3e56-45c5-b682-3bae18a1a583-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.330146 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.330022    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a57a539-3e56-45c5-b682-3bae18a1a583-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.330146 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.330046    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjpsp\" (UniqueName: \"kubernetes.io/projected/9a57a539-3e56-45c5-b682-3bae18a1a583-kube-api-access-gjpsp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.330146 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.330098    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a57a539-3e56-45c5-b682-3bae18a1a583-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.330146 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.330138    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a57a539-3e56-45c5-b682-3bae18a1a583-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.430590 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.430556    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a57a539-3e56-45c5-b682-3bae18a1a583-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.430590 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.430593    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a57a539-3e56-45c5-b682-3bae18a1a583-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.430887 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.430615    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjpsp\" (UniqueName: \"kubernetes.io/projected/9a57a539-3e56-45c5-b682-3bae18a1a583-kube-api-access-gjpsp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.430887 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.430640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a57a539-3e56-45c5-b682-3bae18a1a583-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.430887 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.430666    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a57a539-3e56-45c5-b682-3bae18a1a583-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.430887 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.430725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a57a539-3e56-45c5-b682-3bae18a1a583-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.431078 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.431014    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a57a539-3e56-45c5-b682-3bae18a1a583-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.431078 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.431058    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a57a539-3e56-45c5-b682-3bae18a1a583-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.431250 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.431222    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9a57a539-3e56-45c5-b682-3bae18a1a583-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.433004 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.432979    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a57a539-3e56-45c5-b682-3bae18a1a583-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.433233 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.433213    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a57a539-3e56-45c5-b682-3bae18a1a583-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.439412 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.439391    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjpsp\" (UniqueName: \"kubernetes.io/projected/9a57a539-3e56-45c5-b682-3bae18a1a583-kube-api-access-gjpsp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh\" (UID: \"9a57a539-3e56-45c5-b682-3bae18a1a583\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.508187 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.508108    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:36.678597 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:36.678571    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"]
Jun 09 13:42:36.680842 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:42:36.680812    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a57a539_3e56_45c5_b682_3bae18a1a583.slice/crio-3c04b9bb8570668040361e46a49e5aae4666b07f6844dcc2e31314ab7cc42ec2 WatchSource:0}: Error finding container 3c04b9bb8570668040361e46a49e5aae4666b07f6844dcc2e31314ab7cc42ec2: Status 404 returned error can't find the container with id 3c04b9bb8570668040361e46a49e5aae4666b07f6844dcc2e31314ab7cc42ec2
Jun 09 13:42:37.344012 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:37.343975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh" event={"ID":"9a57a539-3e56-45c5-b682-3bae18a1a583","Type":"ContainerStarted","Data":"b02e6d7b6ded6f8737f5b70187c4dff7d022d43f80be3fcd541d5048323a4faf"}
Jun 09 13:42:37.344440 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:37.344039    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh" event={"ID":"9a57a539-3e56-45c5-b682-3bae18a1a583","Type":"ContainerStarted","Data":"3c04b9bb8570668040361e46a49e5aae4666b07f6844dcc2e31314ab7cc42ec2"}
Jun 09 13:42:39.354416 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:39.354382    2562 generic.go:356] "Generic (PLEG): container finished" podID="9a57a539-3e56-45c5-b682-3bae18a1a583" containerID="b02e6d7b6ded6f8737f5b70187c4dff7d022d43f80be3fcd541d5048323a4faf" exitCode=0
Jun 09 13:42:39.354809 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:39.354452    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh" event={"ID":"9a57a539-3e56-45c5-b682-3bae18a1a583","Type":"ContainerDied","Data":"b02e6d7b6ded6f8737f5b70187c4dff7d022d43f80be3fcd541d5048323a4faf"}
Jun 09 13:42:39.603661 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:39.603626    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:39.603856 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:39.603691    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:39.616445 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:39.616374    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:40.360584 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:40.360545    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh" event={"ID":"9a57a539-3e56-45c5-b682-3bae18a1a583","Type":"ContainerStarted","Data":"1cb727f7cd1dbefe0705075411e7450486219e161fe8094d9966660bb5d9222a"}
Jun 09 13:42:40.371954 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:40.371929    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg"
Jun 09 13:42:40.381364 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:40.381323    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh" podStartSLOduration=2.379802477 podStartE2EDuration="4.3813087s" totalImagesPullingTime="376.350563ms" totalInitContainerRuntime="1.62515566s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:42:40.378761999 +0000 UTC m=+859.753432757" watchObservedRunningTime="2026-06-09 13:42:40.3813087 +0000 UTC m=+859.755979460"
Jun 09 13:42:46.405018 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:46.404985    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:42:46.508649 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:46.508611    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:46.508806 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:46.508713    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:46.521141 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:46.521117    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:47.403863 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:47.403836    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh"
Jun 09 13:42:55.790379 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:55.790339    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"]
Jun 09 13:42:55.796125 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:55.796104    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:55.798337 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:55.798311    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jun 09 13:42:55.802649 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:55.802624    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"]
Jun 09 13:42:55.828132 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:55.828097    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:42:55.900339 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:55.900309    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbvcg\" (UniqueName: \"kubernetes.io/projected/96db4699-3df6-46e9-be3d-cffae96c0b18-kube-api-access-zbvcg\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:55.900468 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:55.900360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96db4699-3df6-46e9-be3d-cffae96c0b18-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:55.900468 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:55.900381    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96db4699-3df6-46e9-be3d-cffae96c0b18-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:55.900588 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:55.900469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96db4699-3df6-46e9-be3d-cffae96c0b18-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:55.900588 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:55.900531    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96db4699-3df6-46e9-be3d-cffae96c0b18-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:55.900588 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:55.900562    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96db4699-3df6-46e9-be3d-cffae96c0b18-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:56.001360 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:56.001323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96db4699-3df6-46e9-be3d-cffae96c0b18-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:56.001360 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:56.001364    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96db4699-3df6-46e9-be3d-cffae96c0b18-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:56.001559 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:56.001399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96db4699-3df6-46e9-be3d-cffae96c0b18-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:56.001559 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:56.001437    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96db4699-3df6-46e9-be3d-cffae96c0b18-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:56.001559 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:56.001455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96db4699-3df6-46e9-be3d-cffae96c0b18-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:56.001700 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:56.001627    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbvcg\" (UniqueName: \"kubernetes.io/projected/96db4699-3df6-46e9-be3d-cffae96c0b18-kube-api-access-zbvcg\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:56.001820 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:56.001789    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/96db4699-3df6-46e9-be3d-cffae96c0b18-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:56.001906 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:56.001824    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/96db4699-3df6-46e9-be3d-cffae96c0b18-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:56.001906 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:56.001845    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/96db4699-3df6-46e9-be3d-cffae96c0b18-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:56.003942 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:56.003922    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/96db4699-3df6-46e9-be3d-cffae96c0b18-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:56.004107 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:56.004088    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/96db4699-3df6-46e9-be3d-cffae96c0b18-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:56.009845 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:56.009829    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbvcg\" (UniqueName: \"kubernetes.io/projected/96db4699-3df6-46e9-be3d-cffae96c0b18-kube-api-access-zbvcg\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-s4kwt\" (UID: \"96db4699-3df6-46e9-be3d-cffae96c0b18\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:56.125065 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:56.124977    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:42:56.256385 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:56.256358    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"]
Jun 09 13:42:56.258444 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:42:56.258412    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96db4699_3df6_46e9_be3d_cffae96c0b18.slice/crio-f431da2052aa0e98cf34605da253f44ec076eb1bd0d7baf96664d1b81c920de1 WatchSource:0}: Error finding container f431da2052aa0e98cf34605da253f44ec076eb1bd0d7baf96664d1b81c920de1: Status 404 returned error can't find the container with id f431da2052aa0e98cf34605da253f44ec076eb1bd0d7baf96664d1b81c920de1
Jun 09 13:42:56.434059 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:56.434018    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt" event={"ID":"96db4699-3df6-46e9-be3d-cffae96c0b18","Type":"ContainerStarted","Data":"c6eac9d49f0b7442295c211947e9db84441788ca43857b71312c575f9400151b"}
Jun 09 13:42:56.434059 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:42:56.434064    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt" event={"ID":"96db4699-3df6-46e9-be3d-cffae96c0b18","Type":"ContainerStarted","Data":"f431da2052aa0e98cf34605da253f44ec076eb1bd0d7baf96664d1b81c920de1"}
Jun 09 13:43:01.756676 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:01.756589    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:43:23.255594 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:23.255559    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:43:24.501433 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.501398    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-649ffd46b7-8mnfz"]
Jun 09 13:43:24.504696 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.504679    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.515939 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.515918    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-649ffd46b7-8mnfz"]
Jun 09 13:43:24.561773 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.561745    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:43:24.563001 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.562983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/831edb12-cc2b-44a5-be84-8185cd68c7a0-trusted-ca-bundle\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.563075 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.563015    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc8k5\" (UniqueName: \"kubernetes.io/projected/831edb12-cc2b-44a5-be84-8185cd68c7a0-kube-api-access-hc8k5\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.563125 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.563075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/831edb12-cc2b-44a5-be84-8185cd68c7a0-console-config\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.563125 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.563094    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/831edb12-cc2b-44a5-be84-8185cd68c7a0-service-ca\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.563125 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.563114    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/831edb12-cc2b-44a5-be84-8185cd68c7a0-console-oauth-config\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.563272 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.563250    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/831edb12-cc2b-44a5-be84-8185cd68c7a0-oauth-serving-cert\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.563326 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.563305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/831edb12-cc2b-44a5-be84-8185cd68c7a0-console-serving-cert\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.627509 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.627474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:43:24.664555 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.664526    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/831edb12-cc2b-44a5-be84-8185cd68c7a0-oauth-serving-cert\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.664687 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.664568    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/831edb12-cc2b-44a5-be84-8185cd68c7a0-console-serving-cert\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.664777 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.664700    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/831edb12-cc2b-44a5-be84-8185cd68c7a0-trusted-ca-bundle\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.664841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.664770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc8k5\" (UniqueName: \"kubernetes.io/projected/831edb12-cc2b-44a5-be84-8185cd68c7a0-kube-api-access-hc8k5\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.664841 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.664826    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/831edb12-cc2b-44a5-be84-8185cd68c7a0-console-config\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.665018 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.664853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/831edb12-cc2b-44a5-be84-8185cd68c7a0-service-ca\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.665018 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.664878    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/831edb12-cc2b-44a5-be84-8185cd68c7a0-console-oauth-config\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.665304 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.665276    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/831edb12-cc2b-44a5-be84-8185cd68c7a0-oauth-serving-cert\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.665532 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.665510    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/831edb12-cc2b-44a5-be84-8185cd68c7a0-trusted-ca-bundle\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.665600 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.665522    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/831edb12-cc2b-44a5-be84-8185cd68c7a0-service-ca\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.665839 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.665815    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/831edb12-cc2b-44a5-be84-8185cd68c7a0-console-config\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.667350 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.667325    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/831edb12-cc2b-44a5-be84-8185cd68c7a0-console-oauth-config\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.667437 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.667339    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/831edb12-cc2b-44a5-be84-8185cd68c7a0-console-serving-cert\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.673223 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.673201    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc8k5\" (UniqueName: \"kubernetes.io/projected/831edb12-cc2b-44a5-be84-8185cd68c7a0-kube-api-access-hc8k5\") pod \"console-649ffd46b7-8mnfz\" (UID: \"831edb12-cc2b-44a5-be84-8185cd68c7a0\") " pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.698409 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.698374    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:43:24.814189 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.814107    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:24.945840 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:24.945809    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-649ffd46b7-8mnfz"]
Jun 09 13:43:24.947951 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:43:24.947922    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831edb12_cc2b_44a5_be84_8185cd68c7a0.slice/crio-b5a3c8012fc464c2c1f1dc5b858232ccb0c2a2c86e402a8b9e7e96fad2ee2d6a WatchSource:0}: Error finding container b5a3c8012fc464c2c1f1dc5b858232ccb0c2a2c86e402a8b9e7e96fad2ee2d6a: Status 404 returned error can't find the container with id b5a3c8012fc464c2c1f1dc5b858232ccb0c2a2c86e402a8b9e7e96fad2ee2d6a
Jun 09 13:43:25.295432 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:25.295396    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:43:25.350207 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:25.350155    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:43:25.563683 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:25.563599    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649ffd46b7-8mnfz" event={"ID":"831edb12-cc2b-44a5-be84-8185cd68c7a0","Type":"ContainerStarted","Data":"7321a4ed737c96a6bd85e6614bd5a3435561fea9274b2ef5807050a388f27510"}
Jun 09 13:43:25.563683 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:25.563648    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-649ffd46b7-8mnfz" event={"ID":"831edb12-cc2b-44a5-be84-8185cd68c7a0","Type":"ContainerStarted","Data":"b5a3c8012fc464c2c1f1dc5b858232ccb0c2a2c86e402a8b9e7e96fad2ee2d6a"}
Jun 09 13:43:25.581502 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:25.581455    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-649ffd46b7-8mnfz" podStartSLOduration=1.5814407780000002 podStartE2EDuration="1.581440778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:43:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:43:25.57915325 +0000 UTC m=+904.953824011" watchObservedRunningTime="2026-06-09 13:43:25.581440778 +0000 UTC m=+904.956111596"
Jun 09 13:43:34.814531 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:34.814496    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:34.815150 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:34.814585    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:34.819427 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:34.819408    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:35.246911 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:35.246881    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:43:35.614309 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:35.614232    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-649ffd46b7-8mnfz"
Jun 09 13:43:35.670192 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:35.670162    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64989789db-68ss7"]
Jun 09 13:43:35.775454 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:35.775421    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:43:35.878395 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:35.878304    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:43:35.979143 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:35.979113    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:43:49.675595 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:49.675561    2562 generic.go:356] "Generic (PLEG): container finished" podID="96db4699-3df6-46e9-be3d-cffae96c0b18" containerID="c6eac9d49f0b7442295c211947e9db84441788ca43857b71312c575f9400151b" exitCode=0
Jun 09 13:43:49.676033 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:49.675605    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt" event={"ID":"96db4699-3df6-46e9-be3d-cffae96c0b18","Type":"ContainerDied","Data":"c6eac9d49f0b7442295c211947e9db84441788ca43857b71312c575f9400151b"}
Jun 09 13:43:50.682856 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:50.682818    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt" event={"ID":"96db4699-3df6-46e9-be3d-cffae96c0b18","Type":"ContainerStarted","Data":"07e8601093dc98794dfa08f55e4b6bb3d9d9a62853913bdaeb0399d4ec4643fe"}
Jun 09 13:43:50.704358 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:50.704311    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt" podStartSLOduration=2.8733754989999998 podStartE2EDuration="55.704295887s" totalImagesPullingTime="319.335907ms" totalInitContainerRuntime="52.511584481s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:43:50.703791592 +0000 UTC m=+930.078462354" watchObservedRunningTime="2026-06-09 13:43:50.704295887 +0000 UTC m=+930.078966648"
Jun 09 13:43:55.664602 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:55.664567    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:43:56.125603 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:56.125558    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:43:56.125857 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:56.125625    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:43:56.138152 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:56.138124    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:43:56.720268 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:56.720234    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-s4kwt"
Jun 09 13:43:57.369154 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:57.369121    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:43:57.427187 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:43:57.427154    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:44:00.697107 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:00.697060    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-64989789db-68ss7" podUID="308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2" containerName="console" containerID="cri-o://54bf7fe15ef25e91e9c9930c555494982790c8e6881c68927ae9635a9d9cf592" gracePeriod=15
Jun 09 13:44:00.951896 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:00.951836    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:44:01.103133 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.103100    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-trusted-ca-bundle\") pod \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") "
Jun 09 13:44:01.103309 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.103171    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-serving-cert\") pod \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") "
Jun 09 13:44:01.103309 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.103232    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-service-ca\") pod \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") "
Jun 09 13:44:01.103309 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.103277    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-config\") pod \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") "
Jun 09 13:44:01.103309 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.103307    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnzmk\" (UniqueName: \"kubernetes.io/projected/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-kube-api-access-bnzmk\") pod \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") "
Jun 09 13:44:01.103513 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.103449    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-oauth-config\") pod \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") "
Jun 09 13:44:01.103513 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.103502    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-oauth-serving-cert\") pod \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\" (UID: \"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2\") "
Jun 09 13:44:01.103621 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.103469    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2" (UID: "308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 13:44:01.103678 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.103634    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-service-ca" (OuterVolumeSpecName: "service-ca") pod "308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2" (UID: "308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 13:44:01.103761 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.103688    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-config" (OuterVolumeSpecName: "console-config") pod "308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2" (UID: "308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 13:44:01.103983 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.103824    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-service-ca\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:44:01.103983 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.103848    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-config\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:44:01.103983 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.103862    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-trusted-ca-bundle\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:44:01.103983 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.103939    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2" (UID: "308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 13:44:01.105527 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.105497    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2" (UID: "308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 13:44:01.105653 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.105622    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2" (UID: "308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 13:44:01.105789 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.105767    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-kube-api-access-bnzmk" (OuterVolumeSpecName: "kube-api-access-bnzmk") pod "308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2" (UID: "308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2"). InnerVolumeSpecName "kube-api-access-bnzmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 13:44:01.204479 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.204392    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnzmk\" (UniqueName: \"kubernetes.io/projected/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-kube-api-access-bnzmk\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:44:01.204479 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.204420    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-oauth-config\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:44:01.204479 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.204433    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-oauth-serving-cert\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:44:01.204479 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.204446    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2-console-serving-cert\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:44:01.732530 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.732498    2562 generic.go:356] "Generic (PLEG): container finished" podID="308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2" containerID="54bf7fe15ef25e91e9c9930c555494982790c8e6881c68927ae9635a9d9cf592" exitCode=0
Jun 09 13:44:01.732943 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.732544    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64989789db-68ss7"
Jun 09 13:44:01.732943 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.732587    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64989789db-68ss7" event={"ID":"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2","Type":"ContainerDied","Data":"54bf7fe15ef25e91e9c9930c555494982790c8e6881c68927ae9635a9d9cf592"}
Jun 09 13:44:01.732943 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.732638    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64989789db-68ss7" event={"ID":"308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2","Type":"ContainerDied","Data":"def80b146a41bf3124eb4ca6ebf3400cc3a87fccb868013f603e1d3bb1328b70"}
Jun 09 13:44:01.732943 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.732658    2562 scope.go:117] "RemoveContainer" containerID="54bf7fe15ef25e91e9c9930c555494982790c8e6881c68927ae9635a9d9cf592"
Jun 09 13:44:01.741773 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.741754    2562 scope.go:117] "RemoveContainer" containerID="54bf7fe15ef25e91e9c9930c555494982790c8e6881c68927ae9635a9d9cf592"
Jun 09 13:44:01.742059 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:44:01.742039    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54bf7fe15ef25e91e9c9930c555494982790c8e6881c68927ae9635a9d9cf592\": container with ID starting with 54bf7fe15ef25e91e9c9930c555494982790c8e6881c68927ae9635a9d9cf592 not found: ID does not exist" containerID="54bf7fe15ef25e91e9c9930c555494982790c8e6881c68927ae9635a9d9cf592"
Jun 09 13:44:01.742110 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.742069    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54bf7fe15ef25e91e9c9930c555494982790c8e6881c68927ae9635a9d9cf592"} err="failed to get container status \"54bf7fe15ef25e91e9c9930c555494982790c8e6881c68927ae9635a9d9cf592\": rpc error: code = NotFound desc = could not find container \"54bf7fe15ef25e91e9c9930c555494982790c8e6881c68927ae9635a9d9cf592\": container with ID starting with 54bf7fe15ef25e91e9c9930c555494982790c8e6881c68927ae9635a9d9cf592 not found: ID does not exist"
Jun 09 13:44:01.756128 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.756106    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64989789db-68ss7"]
Jun 09 13:44:01.760323 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:01.760300    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64989789db-68ss7"]
Jun 09 13:44:03.054502 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:03.054471    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2" path="/var/lib/kubelet/pods/308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2/volumes"
Jun 09 13:44:06.959645 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:06.959606    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-854c66d7fb-qhsqw"]
Jun 09 13:44:06.960229 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:06.959966    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2" containerName="console"
Jun 09 13:44:06.960229 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:06.959978    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2" containerName="console"
Jun 09 13:44:06.960229 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:06.960043    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="308ac3cc-a81f-4ea5-a6b0-5baf69e5c2b2" containerName="console"
Jun 09 13:44:06.963175 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:06.963159    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-854c66d7fb-qhsqw"
Jun 09 13:44:06.972349 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:06.972326    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-854c66d7fb-qhsqw"]
Jun 09 13:44:07.053675 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:07.053646    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6b147b3c-950c-4129-90ef-58049142a77c-oidc-ca\") pod \"authorino-854c66d7fb-qhsqw\" (UID: \"6b147b3c-950c-4129-90ef-58049142a77c\") " pod="kuadrant-system/authorino-854c66d7fb-qhsqw"
Jun 09 13:44:07.053893 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:07.053762    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b147b3c-950c-4129-90ef-58049142a77c-tls-cert\") pod \"authorino-854c66d7fb-qhsqw\" (UID: \"6b147b3c-950c-4129-90ef-58049142a77c\") " pod="kuadrant-system/authorino-854c66d7fb-qhsqw"
Jun 09 13:44:07.053893 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:07.053799    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kppjs\" (UniqueName: \"kubernetes.io/projected/6b147b3c-950c-4129-90ef-58049142a77c-kube-api-access-kppjs\") pod \"authorino-854c66d7fb-qhsqw\" (UID: \"6b147b3c-950c-4129-90ef-58049142a77c\") " pod="kuadrant-system/authorino-854c66d7fb-qhsqw"
Jun 09 13:44:07.154563 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:07.154522    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6b147b3c-950c-4129-90ef-58049142a77c-oidc-ca\") pod \"authorino-854c66d7fb-qhsqw\" (UID: \"6b147b3c-950c-4129-90ef-58049142a77c\") " pod="kuadrant-system/authorino-854c66d7fb-qhsqw"
Jun 09 13:44:07.154800 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:07.154593    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b147b3c-950c-4129-90ef-58049142a77c-tls-cert\") pod \"authorino-854c66d7fb-qhsqw\" (UID: \"6b147b3c-950c-4129-90ef-58049142a77c\") " pod="kuadrant-system/authorino-854c66d7fb-qhsqw"
Jun 09 13:44:07.154800 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:07.154625    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kppjs\" (UniqueName: \"kubernetes.io/projected/6b147b3c-950c-4129-90ef-58049142a77c-kube-api-access-kppjs\") pod \"authorino-854c66d7fb-qhsqw\" (UID: \"6b147b3c-950c-4129-90ef-58049142a77c\") " pod="kuadrant-system/authorino-854c66d7fb-qhsqw"
Jun 09 13:44:07.155284 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:07.155262    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/6b147b3c-950c-4129-90ef-58049142a77c-oidc-ca\") pod \"authorino-854c66d7fb-qhsqw\" (UID: \"6b147b3c-950c-4129-90ef-58049142a77c\") " pod="kuadrant-system/authorino-854c66d7fb-qhsqw"
Jun 09 13:44:07.157136 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:07.157111    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6b147b3c-950c-4129-90ef-58049142a77c-tls-cert\") pod \"authorino-854c66d7fb-qhsqw\" (UID: \"6b147b3c-950c-4129-90ef-58049142a77c\") " pod="kuadrant-system/authorino-854c66d7fb-qhsqw"
Jun 09 13:44:07.165663 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:07.165644    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kppjs\" (UniqueName: \"kubernetes.io/projected/6b147b3c-950c-4129-90ef-58049142a77c-kube-api-access-kppjs\") pod \"authorino-854c66d7fb-qhsqw\" (UID: \"6b147b3c-950c-4129-90ef-58049142a77c\") " pod="kuadrant-system/authorino-854c66d7fb-qhsqw"
Jun 09 13:44:07.273447 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:07.273363    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-854c66d7fb-qhsqw"
Jun 09 13:44:07.407154 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:07.407132    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-854c66d7fb-qhsqw"]
Jun 09 13:44:07.409309 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:44:07.409279    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b147b3c_950c_4129_90ef_58049142a77c.slice/crio-9fbc520435b04ee460b30aa0320fdbec996adfdd39e2346cb026e3dfd79a50bd WatchSource:0}: Error finding container 9fbc520435b04ee460b30aa0320fdbec996adfdd39e2346cb026e3dfd79a50bd: Status 404 returned error can't find the container with id 9fbc520435b04ee460b30aa0320fdbec996adfdd39e2346cb026e3dfd79a50bd
Jun 09 13:44:07.685353 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:07.685314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:44:07.761050 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:07.761024    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-854c66d7fb-qhsqw" event={"ID":"6b147b3c-950c-4129-90ef-58049142a77c","Type":"ContainerStarted","Data":"9fbc520435b04ee460b30aa0320fdbec996adfdd39e2346cb026e3dfd79a50bd"}
Jun 09 13:44:07.778971 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:07.778946    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:44:08.766995 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:08.766955    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-854c66d7fb-qhsqw" event={"ID":"6b147b3c-950c-4129-90ef-58049142a77c","Type":"ContainerStarted","Data":"9ce789647c3b550fc2f285ea87ffd8bcfadc59c4f5271659246fde5d68f1ca40"}
Jun 09 13:44:08.782138 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:08.782092    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-854c66d7fb-qhsqw" podStartSLOduration=2.44408598 podStartE2EDuration="2.782077698s" totalImagesPullingTime="337.991718ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 13:44:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:44:08.780845201 +0000 UTC m=+948.155515962" watchObservedRunningTime="2026-06-09 13:44:08.782077698 +0000 UTC m=+948.156748460"
Jun 09 13:44:08.804045 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:08.804016    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54db447f7c-27n4q"]
Jun 09 13:44:08.804222 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:08.804202    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-54db447f7c-27n4q" podUID="a2d78c78-bab8-455a-b8d8-7942fe8c9e5b" containerName="authorino" containerID="cri-o://951ca71fe706640feeaf8af441f28aa909a5b18306337b3f8128b83c16a22dc9" gracePeriod=30
Jun 09 13:44:09.012246 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.012216    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:44:09.067178 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.067152    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54db447f7c-27n4q"
Jun 09 13:44:09.072960 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.072938    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-oidc-ca\") pod \"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b\" (UID: \"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b\") "
Jun 09 13:44:09.073093 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.073041    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7krp\" (UniqueName: \"kubernetes.io/projected/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-kube-api-access-j7krp\") pod \"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b\" (UID: \"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b\") "
Jun 09 13:44:09.073093 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.073079    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-tls-cert\") pod \"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b\" (UID: \"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b\") "
Jun 09 13:44:09.075160 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.075135    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-kube-api-access-j7krp" (OuterVolumeSpecName: "kube-api-access-j7krp") pod "a2d78c78-bab8-455a-b8d8-7942fe8c9e5b" (UID: "a2d78c78-bab8-455a-b8d8-7942fe8c9e5b"). InnerVolumeSpecName "kube-api-access-j7krp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 13:44:09.077521 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.077502    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "a2d78c78-bab8-455a-b8d8-7942fe8c9e5b" (UID: "a2d78c78-bab8-455a-b8d8-7942fe8c9e5b"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 09 13:44:09.085426 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.085394    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a2d78c78-bab8-455a-b8d8-7942fe8c9e5b" (UID: "a2d78c78-bab8-455a-b8d8-7942fe8c9e5b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 13:44:09.088118 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.088088    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:44:09.174064 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.174035    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7krp\" (UniqueName: \"kubernetes.io/projected/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-kube-api-access-j7krp\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:44:09.174064 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.174063    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-tls-cert\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:44:09.174239 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.174074    2562 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b-oidc-ca\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:44:09.773370 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.773330    2562 generic.go:356] "Generic (PLEG): container finished" podID="a2d78c78-bab8-455a-b8d8-7942fe8c9e5b" containerID="951ca71fe706640feeaf8af441f28aa909a5b18306337b3f8128b83c16a22dc9" exitCode=0
Jun 09 13:44:09.773866 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.773368    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54db447f7c-27n4q" event={"ID":"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b","Type":"ContainerDied","Data":"951ca71fe706640feeaf8af441f28aa909a5b18306337b3f8128b83c16a22dc9"}
Jun 09 13:44:09.773866 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.773386    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54db447f7c-27n4q"
Jun 09 13:44:09.773866 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.773416    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54db447f7c-27n4q" event={"ID":"a2d78c78-bab8-455a-b8d8-7942fe8c9e5b","Type":"ContainerDied","Data":"dfdd03821931688f1fb6dd8f9acaee68efda9872ae69111ef0d018ba2a540fa7"}
Jun 09 13:44:09.773866 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.773437    2562 scope.go:117] "RemoveContainer" containerID="951ca71fe706640feeaf8af441f28aa909a5b18306337b3f8128b83c16a22dc9"
Jun 09 13:44:09.782512 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.782495    2562 scope.go:117] "RemoveContainer" containerID="951ca71fe706640feeaf8af441f28aa909a5b18306337b3f8128b83c16a22dc9"
Jun 09 13:44:09.782816 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:44:09.782794    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"951ca71fe706640feeaf8af441f28aa909a5b18306337b3f8128b83c16a22dc9\": container with ID starting with 951ca71fe706640feeaf8af441f28aa909a5b18306337b3f8128b83c16a22dc9 not found: ID does not exist" containerID="951ca71fe706640feeaf8af441f28aa909a5b18306337b3f8128b83c16a22dc9"
Jun 09 13:44:09.782944 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.782829    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"951ca71fe706640feeaf8af441f28aa909a5b18306337b3f8128b83c16a22dc9"} err="failed to get container status \"951ca71fe706640feeaf8af441f28aa909a5b18306337b3f8128b83c16a22dc9\": rpc error: code = NotFound desc = could not find container \"951ca71fe706640feeaf8af441f28aa909a5b18306337b3f8128b83c16a22dc9\": container with ID starting with 951ca71fe706640feeaf8af441f28aa909a5b18306337b3f8128b83c16a22dc9 not found: ID does not exist"
Jun 09 13:44:09.795043 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.795019    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-54db447f7c-27n4q"]
Jun 09 13:44:09.798940 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:09.798922    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-54db447f7c-27n4q"]
Jun 09 13:44:11.057459 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:44:11.057420    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2d78c78-bab8-455a-b8d8-7942fe8c9e5b" path="/var/lib/kubelet/pods/a2d78c78-bab8-455a-b8d8-7942fe8c9e5b/volumes"
Jun 09 13:45:48.479022 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:48.478981    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:45:48.558111 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:48.558074    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7569bf7bf4-4z456"]
Jun 09 13:45:48.558298 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:48.558277    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-7569bf7bf4-4z456" podUID="ba9b6528-be44-4434-a514-2ba3de93dd5c" containerName="manager" containerID="cri-o://7d307b15101c94fcccf1e1b9e0dee85308808300911c389285b6d1b9a80d6612" gracePeriod=30
Jun 09 13:45:48.805782 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:48.805758    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7569bf7bf4-4z456"
Jun 09 13:45:48.857466 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:48.857439    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba9b6528-be44-4434-a514-2ba3de93dd5c-webhook-cert\") pod \"ba9b6528-be44-4434-a514-2ba3de93dd5c\" (UID: \"ba9b6528-be44-4434-a514-2ba3de93dd5c\") "
Jun 09 13:45:48.857659 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:48.857500    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgcs2\" (UniqueName: \"kubernetes.io/projected/ba9b6528-be44-4434-a514-2ba3de93dd5c-kube-api-access-bgcs2\") pod \"ba9b6528-be44-4434-a514-2ba3de93dd5c\" (UID: \"ba9b6528-be44-4434-a514-2ba3de93dd5c\") "
Jun 09 13:45:48.859574 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:48.859543    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba9b6528-be44-4434-a514-2ba3de93dd5c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ba9b6528-be44-4434-a514-2ba3de93dd5c" (UID: "ba9b6528-be44-4434-a514-2ba3de93dd5c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 09 13:45:48.859687 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:48.859621    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba9b6528-be44-4434-a514-2ba3de93dd5c-kube-api-access-bgcs2" (OuterVolumeSpecName: "kube-api-access-bgcs2") pod "ba9b6528-be44-4434-a514-2ba3de93dd5c" (UID: "ba9b6528-be44-4434-a514-2ba3de93dd5c"). InnerVolumeSpecName "kube-api-access-bgcs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 09 13:45:48.958420 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:48.958383    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba9b6528-be44-4434-a514-2ba3de93dd5c-webhook-cert\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:45:48.958420 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:48.958415    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgcs2\" (UniqueName: \"kubernetes.io/projected/ba9b6528-be44-4434-a514-2ba3de93dd5c-kube-api-access-bgcs2\") on node \"ip-10-0-130-81.ec2.internal\" DevicePath \"\""
Jun 09 13:45:49.219511 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:49.219477    2562 generic.go:356] "Generic (PLEG): container finished" podID="ba9b6528-be44-4434-a514-2ba3de93dd5c" containerID="7d307b15101c94fcccf1e1b9e0dee85308808300911c389285b6d1b9a80d6612" exitCode=0
Jun 09 13:45:49.219674 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:49.219526    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7569bf7bf4-4z456"
Jun 09 13:45:49.219674 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:49.219536    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7569bf7bf4-4z456" event={"ID":"ba9b6528-be44-4434-a514-2ba3de93dd5c","Type":"ContainerDied","Data":"7d307b15101c94fcccf1e1b9e0dee85308808300911c389285b6d1b9a80d6612"}
Jun 09 13:45:49.219674 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:49.219593    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7569bf7bf4-4z456" event={"ID":"ba9b6528-be44-4434-a514-2ba3de93dd5c","Type":"ContainerDied","Data":"43652625e51818b72377235b6a9e5142ddb97fc05128f15f184d03b0b1430aac"}
Jun 09 13:45:49.219674 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:49.219615    2562 scope.go:117] "RemoveContainer" containerID="7d307b15101c94fcccf1e1b9e0dee85308808300911c389285b6d1b9a80d6612"
Jun 09 13:45:49.227704 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:49.227688    2562 scope.go:117] "RemoveContainer" containerID="7d307b15101c94fcccf1e1b9e0dee85308808300911c389285b6d1b9a80d6612"
Jun 09 13:45:49.227982 ip-10-0-130-81 kubenswrapper[2562]: E0609 13:45:49.227964    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d307b15101c94fcccf1e1b9e0dee85308808300911c389285b6d1b9a80d6612\": container with ID starting with 7d307b15101c94fcccf1e1b9e0dee85308808300911c389285b6d1b9a80d6612 not found: ID does not exist" containerID="7d307b15101c94fcccf1e1b9e0dee85308808300911c389285b6d1b9a80d6612"
Jun 09 13:45:49.228031 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:49.227990    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d307b15101c94fcccf1e1b9e0dee85308808300911c389285b6d1b9a80d6612"} err="failed to get container status \"7d307b15101c94fcccf1e1b9e0dee85308808300911c389285b6d1b9a80d6612\": rpc error: code = NotFound desc = could not find container \"7d307b15101c94fcccf1e1b9e0dee85308808300911c389285b6d1b9a80d6612\": container with ID starting with 7d307b15101c94fcccf1e1b9e0dee85308808300911c389285b6d1b9a80d6612 not found: ID does not exist"
Jun 09 13:45:49.237095 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:49.237072    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7569bf7bf4-4z456"]
Jun 09 13:45:49.240328 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:49.240306    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7569bf7bf4-4z456"]
Jun 09 13:45:49.880442 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:49.880400    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:45:51.054688 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:45:51.054649    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba9b6528-be44-4434-a514-2ba3de93dd5c" path="/var/lib/kubelet/pods/ba9b6528-be44-4434-a514-2ba3de93dd5c/volumes"
Jun 09 13:46:31.314923 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:46:31.314881    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:46:31.417160 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:46:31.417119    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:46:39.829018 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:46:39.828979    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:46:45.853305 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:46:45.853270    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:46:45.954447 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:46:45.954412    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:47:13.052107 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:47:13.052068    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:47:13.152344 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:47:13.152312    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:47:17.999159 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:47:17.999121    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:47:18.099801 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:47:18.099762    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:47:41.983118 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:47:41.983084    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:47:47.938893 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:47:47.938852    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:47:48.040490 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:47:48.040452    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:47:48.138505 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:47:48.138464    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:47:48.302179 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:47:48.302094    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:47:48.401940 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:47:48.401906    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:48:04.786158 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:48:04.786123    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:48:05.732161 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:48:05.732128    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:48:11.166822 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:48:11.166784    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:48:11.222108 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:48:11.222071    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:48:19.313588 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:48:19.313545    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:48:19.408596 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:48:19.408554    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:48:19.511580 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:48:19.511532    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:48:19.609282 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:48:19.609164    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:48:36.077407 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:48:36.077365    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:48:36.174524 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:48:36.174480    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:48:36.276620 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:48:36.276583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:48:42.140560 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:48:42.140522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:48:42.242060 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:48:42.242024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:49:02.640506 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:49:02.640412    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:49:02.745505 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:49:02.745468    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:49:02.893491 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:49:02.893404    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:49:08.654236 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:49:08.654204    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:49:08.755111 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:49:08.755073    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:49:08.852526 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:49:08.852480    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:49:09.050566 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:49:09.050533    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:49:14.933558 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:49:14.933505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:49:15.035380 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:49:15.035345    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:49:46.117641 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:49:46.117606    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:52:54.672878 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:52:54.672847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:53:23.183704 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:53:23.183671    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:54:02.111309 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:02.111269    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-854c66d7fb-qhsqw_6b147b3c-950c-4129-90ef-58049142a77c/authorino/0.log"
Jun 09 13:54:07.247921 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:07.247891    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-867b78df65-hcrrx_f2899057-eff8-4331-bd84-b916da4a122f/maas-api/0.log"
Jun 09 13:54:07.607543 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:07.607469    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-2d4hc_bcf0d7c3-623d-4820-9b35-0dcea992edc3/server/0.log"
Jun 09 13:54:07.737507 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:07.737466    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-7krd5_6370712b-6124-4b6a-951b-041067e08438/manager/0.log"
Jun 09 13:54:08.103309 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:08.103279    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc7576fb9-gh7ks_60ac188a-d51c-45d8-a5ce-f370385404dc/copy-manifests/0.log"
Jun 09 13:54:08.110302 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:08.110281    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc7576fb9-gh7ks_60ac188a-d51c-45d8-a5ce-f370385404dc/manager/0.log"
Jun 09 13:54:09.528596 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:09.528565    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-854c66d7fb-qhsqw_6b147b3c-950c-4129-90ef-58049142a77c/authorino/0.log"
Jun 09 13:54:09.868484 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:09.868405    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hch5t_cef9b5d8-6ee5-4213-bb52-12f01a7bdba8/kuadrant-console-plugin/0.log"
Jun 09 13:54:11.033510 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:11.033471    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7574fdcd4f-d6nnk_2f247be5-4587-44a5-9318-9f55769d9013/kube-auth-proxy/0.log"
Jun 09 13:54:11.271489 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:11.271462    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-vnjpm_e68a784f-4ded-4d5b-9f8b-eff0775c7c48/payload-pre-processing/0.log"
Jun 09 13:54:11.853794 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:11.853754    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-vfjjk_d323659b-4eaf-47b0-970b-3b653b473fe1/storage-initializer/0.log"
Jun 09 13:54:12.128774 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:12.128657    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg_ecb58e9a-eda4-446d-970f-4d16d2f882ea/storage-initializer/0.log"
Jun 09 13:54:12.142032 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:12.142007    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-jtwqg_ecb58e9a-eda4-446d-970f-4d16d2f882ea/main/0.log"
Jun 09 13:54:12.285202 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:12.285174    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh_9a57a539-3e56-45c5-b682-3bae18a1a583/main/0.log"
Jun 09 13:54:12.296451 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:12.296431    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c28fzh_9a57a539-3e56-45c5-b682-3bae18a1a583/storage-initializer/0.log"
Jun 09 13:54:12.532429 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:12.532398    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-s4kwt_96db4699-3df6-46e9-be3d-cffae96c0b18/storage-initializer/0.log"
Jun 09 13:54:12.540642 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:12.540620    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-s4kwt_96db4699-3df6-46e9-be3d-cffae96c0b18/main/0.log"
Jun 09 13:54:16.335351 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:16.335319    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:54:16.437366 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:16.437332    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log" limit=1024
Jun 09 13:54:19.386862 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:19.386826    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sf96c_4f3a9543-145b-4b8e-9d9d-dd8c15d5f1b5/global-pull-secret-syncer/0.log"
Jun 09 13:54:19.470096 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:19.470067    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-cfjjj_aafe4ec3-c2bc-4c0a-b90f-7246208c42dc/konnectivity-agent/0.log"
Jun 09 13:54:19.544301 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:19.544268    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-81.ec2.internal_aea07464dfd29937372692ed2802aec2/haproxy/0.log"
Jun 09 13:54:25.192095 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:25.192058    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-854c66d7fb-qhsqw_6b147b3c-950c-4129-90ef-58049142a77c/authorino/0.log"
Jun 09 13:54:25.282936 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:25.282909    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-hch5t_cef9b5d8-6ee5-4213-bb52-12f01a7bdba8/kuadrant-console-plugin/0.log"
Jun 09 13:54:27.672777 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:27.672724    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vnv6l_f5b44b25-0e65-49ed-b57f-098ca40c57ed/node-exporter/0.log"
Jun 09 13:54:27.693827 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:27.693793    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vnv6l_f5b44b25-0e65-49ed-b57f-098ca40c57ed/kube-rbac-proxy/0.log"
Jun 09 13:54:27.715952 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:27.715929    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vnv6l_f5b44b25-0e65-49ed-b57f-098ca40c57ed/init-textfile/0.log"
Jun 09 13:54:28.170038 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:28.170007    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7799bf4fc-d9wgk_3687e302-44f4-4a4d-8b80-65b538150cab/thanos-query/0.log"
Jun 09 13:54:28.192466 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:28.192444    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7799bf4fc-d9wgk_3687e302-44f4-4a4d-8b80-65b538150cab/kube-rbac-proxy-web/0.log"
Jun 09 13:54:28.225634 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:28.225609    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7799bf4fc-d9wgk_3687e302-44f4-4a4d-8b80-65b538150cab/kube-rbac-proxy/0.log"
Jun 09 13:54:28.252209 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:28.252186    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7799bf4fc-d9wgk_3687e302-44f4-4a4d-8b80-65b538150cab/prom-label-proxy/0.log"
Jun 09 13:54:28.274642 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:28.274622    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7799bf4fc-d9wgk_3687e302-44f4-4a4d-8b80-65b538150cab/kube-rbac-proxy-rules/0.log"
Jun 09 13:54:28.299539 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:28.299511    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7799bf4fc-d9wgk_3687e302-44f4-4a4d-8b80-65b538150cab/kube-rbac-proxy-metrics/0.log"
Jun 09 13:54:30.551694 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.551660    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"]
Jun 09 13:54:30.552196 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.552091    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba9b6528-be44-4434-a514-2ba3de93dd5c" containerName="manager"
Jun 09 13:54:30.552196 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.552111    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba9b6528-be44-4434-a514-2ba3de93dd5c" containerName="manager"
Jun 09 13:54:30.552196 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.552139    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2d78c78-bab8-455a-b8d8-7942fe8c9e5b" containerName="authorino"
Jun 09 13:54:30.552196 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.552148    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2d78c78-bab8-455a-b8d8-7942fe8c9e5b" containerName="authorino"
Jun 09 13:54:30.552393 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.552235    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba9b6528-be44-4434-a514-2ba3de93dd5c" containerName="manager"
Jun 09 13:54:30.552393 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.552252    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2d78c78-bab8-455a-b8d8-7942fe8c9e5b" containerName="authorino"
Jun 09 13:54:30.555391 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.555372    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:30.557598 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.557573    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fjgn8\"/\"openshift-service-ca.crt\""
Jun 09 13:54:30.557598 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.557584    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fjgn8\"/\"default-dockercfg-4f482\""
Jun 09 13:54:30.557803 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.557573    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fjgn8\"/\"kube-root-ca.crt\""
Jun 09 13:54:30.561391 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.561360    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"]
Jun 09 13:54:30.638118 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.638083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8291cf04-ea92-4122-af2c-7e9c603e9a84-podres\") pod \"perf-node-gather-daemonset-8g65j\" (UID: \"8291cf04-ea92-4122-af2c-7e9c603e9a84\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:30.638288 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.638128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8291cf04-ea92-4122-af2c-7e9c603e9a84-sys\") pod \"perf-node-gather-daemonset-8g65j\" (UID: \"8291cf04-ea92-4122-af2c-7e9c603e9a84\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:30.638288 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.638148    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8291cf04-ea92-4122-af2c-7e9c603e9a84-lib-modules\") pod \"perf-node-gather-daemonset-8g65j\" (UID: \"8291cf04-ea92-4122-af2c-7e9c603e9a84\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:30.638288 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.638231    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8291cf04-ea92-4122-af2c-7e9c603e9a84-proc\") pod \"perf-node-gather-daemonset-8g65j\" (UID: \"8291cf04-ea92-4122-af2c-7e9c603e9a84\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:30.638400 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.638288    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5q6k\" (UniqueName: \"kubernetes.io/projected/8291cf04-ea92-4122-af2c-7e9c603e9a84-kube-api-access-w5q6k\") pod \"perf-node-gather-daemonset-8g65j\" (UID: \"8291cf04-ea92-4122-af2c-7e9c603e9a84\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:30.739478 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.739439    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8291cf04-ea92-4122-af2c-7e9c603e9a84-podres\") pod \"perf-node-gather-daemonset-8g65j\" (UID: \"8291cf04-ea92-4122-af2c-7e9c603e9a84\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:30.739684 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.739507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8291cf04-ea92-4122-af2c-7e9c603e9a84-sys\") pod \"perf-node-gather-daemonset-8g65j\" (UID: \"8291cf04-ea92-4122-af2c-7e9c603e9a84\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:30.739684 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.739532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8291cf04-ea92-4122-af2c-7e9c603e9a84-lib-modules\") pod \"perf-node-gather-daemonset-8g65j\" (UID: \"8291cf04-ea92-4122-af2c-7e9c603e9a84\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:30.739684 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.739593    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8291cf04-ea92-4122-af2c-7e9c603e9a84-proc\") pod \"perf-node-gather-daemonset-8g65j\" (UID: \"8291cf04-ea92-4122-af2c-7e9c603e9a84\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:30.739684 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.739614    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8291cf04-ea92-4122-af2c-7e9c603e9a84-podres\") pod \"perf-node-gather-daemonset-8g65j\" (UID: \"8291cf04-ea92-4122-af2c-7e9c603e9a84\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:30.739684 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.739614    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8291cf04-ea92-4122-af2c-7e9c603e9a84-sys\") pod \"perf-node-gather-daemonset-8g65j\" (UID: \"8291cf04-ea92-4122-af2c-7e9c603e9a84\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:30.739684 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.739679    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5q6k\" (UniqueName: \"kubernetes.io/projected/8291cf04-ea92-4122-af2c-7e9c603e9a84-kube-api-access-w5q6k\") pod \"perf-node-gather-daemonset-8g65j\" (UID: \"8291cf04-ea92-4122-af2c-7e9c603e9a84\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:30.739999 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.739694    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8291cf04-ea92-4122-af2c-7e9c603e9a84-lib-modules\") pod \"perf-node-gather-daemonset-8g65j\" (UID: \"8291cf04-ea92-4122-af2c-7e9c603e9a84\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:30.739999 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.739697    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8291cf04-ea92-4122-af2c-7e9c603e9a84-proc\") pod \"perf-node-gather-daemonset-8g65j\" (UID: \"8291cf04-ea92-4122-af2c-7e9c603e9a84\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:30.748614 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.748590    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5q6k\" (UniqueName: \"kubernetes.io/projected/8291cf04-ea92-4122-af2c-7e9c603e9a84-kube-api-access-w5q6k\") pod \"perf-node-gather-daemonset-8g65j\" (UID: \"8291cf04-ea92-4122-af2c-7e9c603e9a84\") " pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:30.782205 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.782177    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-649ffd46b7-8mnfz_831edb12-cc2b-44a5-be84-8185cd68c7a0/console/0.log"
Jun 09 13:54:30.866129 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.866039    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:30.995029 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:30.995007    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"]
Jun 09 13:54:30.997040 ip-10-0-130-81 kubenswrapper[2562]: W0609 13:54:30.997018    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8291cf04_ea92_4122_af2c_7e9c603e9a84.slice/crio-2f6af26f2045090ff1c5b27979ef7f28965373782b498e392d02737313c757ac WatchSource:0}: Error finding container 2f6af26f2045090ff1c5b27979ef7f28965373782b498e392d02737313c757ac: Status 404 returned error can't find the container with id 2f6af26f2045090ff1c5b27979ef7f28965373782b498e392d02737313c757ac
Jun 09 13:54:31.521389 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:31.521350    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j" event={"ID":"8291cf04-ea92-4122-af2c-7e9c603e9a84","Type":"ContainerStarted","Data":"d30bbde90503434288c878f424c11f1efdb4a438bbd0ba474734e3bc7d84f923"}
Jun 09 13:54:31.521574 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:31.521414    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j" event={"ID":"8291cf04-ea92-4122-af2c-7e9c603e9a84","Type":"ContainerStarted","Data":"2f6af26f2045090ff1c5b27979ef7f28965373782b498e392d02737313c757ac"}
Jun 09 13:54:31.521574 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:31.521490    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:31.536651 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:31.536565    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j" podStartSLOduration=1.5365456769999999 podStartE2EDuration="1.536545677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 13:54:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 13:54:31.535919379 +0000 UTC m=+1570.910590142" watchObservedRunningTime="2026-06-09 13:54:31.536545677 +0000 UTC m=+1570.911216439"
Jun 09 13:54:32.639050 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:32.639021    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mxqtr_f2243267-ba22-40c2-b0d8-57c36d93f33c/dns/0.log"
Jun 09 13:54:32.661108 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:32.661081    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mxqtr_f2243267-ba22-40c2-b0d8-57c36d93f33c/kube-rbac-proxy/0.log"
Jun 09 13:54:32.710270 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:32.710242    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9bbb6_c9ed8bc4-1037-41b7-ac71-9b6aae568b79/dns-node-resolver/0.log"
Jun 09 13:54:33.360481 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:33.360453    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zl45c_0e9007b1-6e07-49ff-b1a5-d40904431d90/node-ca/0.log"
Jun 09 13:54:34.419193 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:34.419161    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7574fdcd4f-d6nnk_2f247be5-4587-44a5-9318-9f55769d9013/kube-auth-proxy/0.log"
Jun 09 13:54:34.509698 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:34.509670    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-vnjpm_e68a784f-4ded-4d5b-9f8b-eff0775c7c48/payload-pre-processing/0.log"
Jun 09 13:54:35.291694 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:35.291659    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rjnj2_73f59fdc-d918-48d3-bf11-81f7344ba09b/serve-healthcheck-canary/0.log"
Jun 09 13:54:35.961433 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:35.961405    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mzckz_68169161-9efc-4393-82dc-26216149a02f/kube-rbac-proxy/0.log"
Jun 09 13:54:35.991653 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:35.991625    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mzckz_68169161-9efc-4393-82dc-26216149a02f/exporter/0.log"
Jun 09 13:54:36.026980 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:36.026951    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mzckz_68169161-9efc-4393-82dc-26216149a02f/extractor/0.log"
Jun 09 13:54:37.536256 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:37.536228    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fjgn8/perf-node-gather-daemonset-8g65j"
Jun 09 13:54:38.498175 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:38.498144    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-867b78df65-hcrrx_f2899057-eff8-4331-bd84-b916da4a122f/maas-api/0.log"
Jun 09 13:54:38.593815 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:38.593786    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-2d4hc_bcf0d7c3-623d-4820-9b35-0dcea992edc3/server/0.log"
Jun 09 13:54:38.648716 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:38.648688    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-7krd5_6370712b-6124-4b6a-951b-041067e08438/manager/0.log"
Jun 09 13:54:38.830719 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:38.830637    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc7576fb9-gh7ks_60ac188a-d51c-45d8-a5ce-f370385404dc/manager/0.log"
Jun 09 13:54:38.855526 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:38.855503    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc7576fb9-gh7ks_60ac188a-d51c-45d8-a5ce-f370385404dc/copy-manifests/0.log"
Jun 09 13:54:40.713521 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:40.713480    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-855cb6f887-qdxf4_94e25e38-3229-4a6c-9eaa-440cb78cfd0d/manager/0.log"
Jun 09 13:54:40.771372 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:40.771339    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-v5bd5_e90addff-d312-4123-8bb4-83bf3162c63e/openshift-lws-operator/0.log"
Jun 09 13:54:44.456522 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:44.456495    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7574fdcd4f-d6nnk_2f247be5-4587-44a5-9318-9f55769d9013/kube-auth-proxy/0.log"
Jun 09 13:54:44.524047 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:44.524015    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-vnjpm_e68a784f-4ded-4d5b-9f8b-eff0775c7c48/payload-pre-processing/0.log"
Jun 09 13:54:45.792468 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:45.792441    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7574fdcd4f-d6nnk_2f247be5-4587-44a5-9318-9f55769d9013/kube-auth-proxy/0.log"
Jun 09 13:54:45.873413 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:45.873384    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-vnjpm_e68a784f-4ded-4d5b-9f8b-eff0775c7c48/payload-pre-processing/0.log"
Jun 09 13:54:47.847661 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:47.847629    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7574fdcd4f-d6nnk_2f247be5-4587-44a5-9318-9f55769d9013/kube-auth-proxy/0.log"
Jun 09 13:54:47.916132 ip-10-0-130-81 kubenswrapper[2562]: I0609 13:54:47.916104    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-vnjpm_e68a784f-4ded-4d5b-9f8b-eff0775c7c48/payload-pre-processing/0.log"