Jul 02 21:31:06.846271 ip-10-0-139-110 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 21:31:07.251774 ip-10-0-139-110 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 21:31:07.251774 ip-10-0-139-110 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 21:31:07.251774 ip-10-0-139-110 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 21:31:07.251774 ip-10-0-139-110 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 21:31:07.251774 ip-10-0-139-110 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 21:31:07.252429 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.251781    2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 21:31:07.255977 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.255961    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:31:07.255977 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.255978    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.255982    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.255985    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.255988    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.255991    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.255994    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.255997    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.255999    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256017    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256020    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256023    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256025    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256028    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256030    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256033    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256036    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256038    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256041    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256050    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:31:07.256059 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256055    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256059    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256062    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256065    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256068    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256071    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256074    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256076    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256079    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256082    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256086    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256088    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256091    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256094    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256096    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256099    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256101    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256103    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256106    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256109    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:31:07.256519 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256111    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256114    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256116    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256119    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256121    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256123    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256126    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256128    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256131    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256133    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256136    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256138    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256141    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256143    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256147    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256149    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256153    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256155    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256159    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256163    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:31:07.256988 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256166    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256168    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256171    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256174    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256178    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256180    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256183    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256186    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256188    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256191    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256193    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256197    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256199    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256201    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256205    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256207    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256210    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256212    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256215    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256217    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:31:07.257493 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256219    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256222    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256224    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256227    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256229    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256232    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256236    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256238    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256241    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256244    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256246    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256249    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256251    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256254    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256257    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256259    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256262    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256264    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256267    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256937    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:31:07.257974 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256943    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256946    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256949    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256951    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256954    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256957    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256960    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256962    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256965    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256968    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256970    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256973    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256975    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256978    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256980    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256983    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256985    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256988    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256991    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256994    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:31:07.258461 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.256997    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257000    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257016    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257019    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257022    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257025    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257027    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257030    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257032    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257035    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257037    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257040    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257042    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257045    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257047    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257051    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257056    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257059    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257062    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:31:07.259062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257065    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257068    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257070    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257072    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257075    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257078    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257080    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257082    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257085    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257087    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257090    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257094    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257097    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257101    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257105    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257107    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257110    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257112    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257115    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:31:07.259527 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257117    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257119    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257122    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257125    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257127    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257130    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257132    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257136    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257138    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257141    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257143    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257145    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257148    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257151    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257153    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257156    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257158    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257161    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257163    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:31:07.259995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257165    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257168    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257172    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257175    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257178    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257182    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257185    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257187    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257190    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257193    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257195    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257198    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257201    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257203    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257206    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257208    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257211    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257213    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257216    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:31:07.260479 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257218    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257220    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257609    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257614    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257617    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257619    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257623    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257625    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257630    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257633    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257638    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257641    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257645    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257648    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257652    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257655    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257657    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257660    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257663    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:31:07.260939 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257666    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257669    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257671    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257674    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257677    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257679    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257682    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257685    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257687    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257689    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257692    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257694    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257697    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257699    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257702    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257704    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257706    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257709    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257711    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257714    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:31:07.261413 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257716    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257719    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257721    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257724    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257727    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257729    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257732    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257734    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257736    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257738    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257741    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257746    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257749    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257751    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257754    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257757    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257759    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257762    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257764    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257767    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:31:07.261923 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257769    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257772    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257774    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257777    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257779    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257782    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257784    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257787    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257789    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257792    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257794    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257797    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257800    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257805    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257808    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257811    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257814    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257817    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257820    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257822    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:31:07.262432 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257824    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257827    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257830    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257835    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257838    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257840    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257843    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257845    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257847    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257850    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257852    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257855    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257858    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257860    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257863    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257865    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257867    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257870    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257872    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257875    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:31:07.262949 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257877    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.257879    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.257948    2575 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.257954    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.257960    2575 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.257964    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.257968    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.257972    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.257976    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.257980    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.257983    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.257986    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.257990    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.257995    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.257998    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258015    2575 flags.go:64] FLAG: --cgroup-root=""
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258019    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258022    2575 flags.go:64] FLAG: --client-ca-file=""
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258025    2575 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258028    2575 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258031    2575 flags.go:64] FLAG: --cluster-domain=""
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258034    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258037    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258040    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 21:31:07.263442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258043    2575 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258060    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258063    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258066    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258070    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258073    2575 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258076    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258079    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258082    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258085    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258089    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258092    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258094    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258097    2575 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258100    2575 flags.go:64] FLAG: --enable-server="true"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258104    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258109    2575 flags.go:64] FLAG: --event-burst="100"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258112    2575 flags.go:64] FLAG: --event-qps="50"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258115    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258118    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258120    2575 flags.go:64] FLAG: --eviction-hard=""
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258125    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258128    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258132    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258136    2575 flags.go:64] FLAG: --eviction-soft=""
Jul 02 21:31:07.264048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258138    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258142    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258145    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258147    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258150    2575 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258153    2575 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258156    2575 flags.go:64] FLAG: --feature-gates=""
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258160    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258162    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258166    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258169    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258172    2575 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258175    2575 flags.go:64] FLAG: --help="false"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258178    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258181    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258183    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258186    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258189    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258193    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258195    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258198    2575 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258201    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258204    2575 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 21:31:07.264650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258207    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258210    2575 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258213    2575 flags.go:64] FLAG: --kube-reserved=""
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258216    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258218    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258224    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258227    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258231    2575 flags.go:64] FLAG: --lock-file=""
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258233    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258236    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258239    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258244    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258247    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258249    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258252    2575 flags.go:64] FLAG: --logging-format="text"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258255    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258258    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258261    2575 flags.go:64] FLAG: --manifest-url=""
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258263    2575 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258270    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258273    2575 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258277    2575 flags.go:64] FLAG: --max-pods="110"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258280    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258282    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258285    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 21:31:07.265274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258288    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258291    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258294    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258297    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258303    2575 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258306    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258309    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258312    2575 flags.go:64] FLAG: --pod-cidr=""
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258315    2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258320    2575 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258323    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258326    2575 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258330    2575 flags.go:64] FLAG: --port="10250"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258333    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258336    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08083198da9109912"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258340    2575 flags.go:64] FLAG: --qos-reserved=""
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258343    2575 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258346    2575 flags.go:64] FLAG: --register-node="true"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258349    2575 flags.go:64] FLAG: --register-with-taints=""
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258352    2575 flags.go:64] FLAG: --registry-burst="10"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258355    2575 flags.go:64] FLAG: --registry-qps="5"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258358    2575 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258361    2575 flags.go:64] FLAG: --reserved-memory=""
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258364    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258367    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 21:31:07.266019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258370    2575 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258373    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258376    2575 flags.go:64] FLAG: --runonce="false"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258378    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258381    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258384    2575 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258387    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258389    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258392    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258396    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258398    2575 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258401    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258404    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258406    2575 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258409    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258412    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258415    2575 flags.go:64] FLAG: --system-cgroups=""
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258418    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258423    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258427    2575 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258429    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258433    2575 flags.go:64] FLAG: --tls-min-version=""
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258437    2575 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258440    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258443    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 21:31:07.266764 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258445    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258448    2575 flags.go:64] FLAG: --v="2"
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258452    2575 flags.go:64] FLAG: --version="false"
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258455    2575 flags.go:64] FLAG: --vmodule=""
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258458    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.258462    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258563    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258567    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258570    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258573    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258576    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258578    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258582    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258585    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258587    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258590    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258592    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258594    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258597    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258599    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258601    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:31:07.267467 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258604    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258606    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258609    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258612    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258614    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258618    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258622    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258624    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258628    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258630    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258634    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258637    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258640    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258643    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258646    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258649    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258651    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258654    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:31:07.268062 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258656    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258659    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258661    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258664    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258666    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258669    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258671    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258673    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258676    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258678    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258681    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258683    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258686    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258688    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258691    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258693    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258696    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258698    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258701    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:31:07.268518 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258704    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258706    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258709    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258712    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258714    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258717    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258719    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258721    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258724    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258726    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258729    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258731    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258734    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258737    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258740    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258743    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258746    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258749    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258751    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:31:07.268995 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258754    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258756    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258759    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258761    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258764    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258766    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258769    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258771    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258773    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258776    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258778    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258781    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258783    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258786    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258789    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258791    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258793    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258796    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258798    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258800    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:31:07.269529 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258803    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:31:07.270054 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258805    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:31:07.270054 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258807    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:31:07.270054 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258810    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:31:07.270054 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258813    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:31:07.270054 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258815    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:31:07.270054 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258818    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:31:07.270054 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.258820    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:31:07.270054 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.259309    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 21:31:07.270054 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.265630    2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 21:31:07.270054 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.265644    2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 21:31:07.270054 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.266454    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 21:31:07.270054 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.266462    2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 21:31:07.270054 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266525    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:31:07.270054 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266530    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:31:07.270054 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266534    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266537    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266540    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266542    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266545    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266548    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266551    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266554    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266557    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266560    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266568    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266571    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266574    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266577    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266579    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266582    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266584    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266587    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266589    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266592    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:31:07.270425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266594    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266597    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266599    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266602    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266605    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266607    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266610    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266613    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266616    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266618    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266621    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266624    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266626    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266630    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266635    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266637    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266640    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266643    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266645    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266648    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:31:07.270944 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266651    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266653    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266656    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266664    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266667    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266669    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266672    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266675    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266677    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266680    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266682    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266684    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266687    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266689    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266692    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266695    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266698    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266700    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266703    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266706    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:31:07.271443 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266708    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266711    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266713    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266716    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266718    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266721    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266723    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266726    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266728    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266731    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266735    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266738    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266741    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266744    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266747    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266749    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266763    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266766    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266769    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:31:07.271925 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266771    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:31:07.272417 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266775    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:31:07.272417 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266777    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:31:07.272417 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266780    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:31:07.272417 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266783    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:31:07.272417 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266785    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:31:07.272417 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266788    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:31:07.272417 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266791    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:31:07.272417 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266794    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:31:07.272417 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266796    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:31:07.272417 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266799    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:31:07.272417 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266801    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:31:07.272417 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266806    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:31:07.272417 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266809    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:31:07.272417 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266812    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:31:07.272417 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266814    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:31:07.272417 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266817    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:31:07.272417 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266819    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:31:07.272834 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.266824    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 21:31:07.272834 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266980    2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 21:31:07.272834 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266984    2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 21:31:07.272834 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266987    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 21:31:07.272834 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266990    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 21:31:07.272834 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266992    2575 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 21:31:07.272834 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266995    2575 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 21:31:07.272834 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.266997    2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 21:31:07.272834 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267000    2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 21:31:07.272834 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267016    2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 21:31:07.272834 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267020    2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 21:31:07.272834 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267024    2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 21:31:07.272834 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267034    2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 21:31:07.272834 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267037    2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 21:31:07.272834 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267039    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267042    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267044    2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267047    2575 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267049    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267052    2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267054    2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267057    2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267059    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267062    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267064    2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267067    2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267070    2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267073    2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267077    2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267080    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267083    2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267086    2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267088    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 21:31:07.273241 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267092    2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267095    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267097    2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267100    2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267103    2575 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267106    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267108    2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267111    2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267113    2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267116    2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267118    2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267121    2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267129    2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267132    2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267135    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267137    2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267139    2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267142    2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267144    2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 21:31:07.273789 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267147    2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267150    2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267153    2575 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267157    2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267159    2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267162    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267165    2575 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267168    2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267170    2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267173    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267176    2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267178    2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267181    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267183    2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267186    2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267188    2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267191    2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267193    2575 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267195    2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267198    2575 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 21:31:07.274552 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267200    2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267203    2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267205    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267208    2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267210    2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267213    2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267221    2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267223    2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267226    2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267229    2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267232    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267234    2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267237    2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267239    2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267241    2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267244    2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267247    2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267249    2575 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267252    2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 21:31:07.275256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267254    2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 21:31:07.275754 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267257    2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 21:31:07.275754 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267259    2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 21:31:07.275754 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267261    2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 21:31:07.275754 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267264    2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 21:31:07.275754 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267266    2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 21:31:07.275754 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267269    2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 21:31:07.275754 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267271    2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 21:31:07.275754 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:07.267274    2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 21:31:07.275754 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.267279    2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 21:31:07.275754 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.267375    2575 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 21:31:07.275754 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.269370    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 21:31:07.275754 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.270703    2575 server.go:1019] "Starting client certificate rotation"
Jul 02 21:31:07.275754 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.270801    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 21:31:07.275754 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.270834    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 21:31:07.276129 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.273208    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 21:31:07.280048 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.280030    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 21:31:07.289953 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.289928    2575 log.go:25] "Validated CRI v1 runtime API"
Jul 02 21:31:07.292128 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.292113    2575 log.go:25] "Validated CRI v1 image API"
Jul 02 21:31:07.294279 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.294264    2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 21:31:07.296745 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.296727    2575 fs.go:135] Filesystem UUIDs: map[33943258-8bad-491b-ad25-b7acb0dc55c9:/dev/nvme0n1p3 432af53b-7547-4fc4-ba0b-f33a414bd052:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 02 21:31:07.296803 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.296746    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 21:31:07.302864 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.302734    2575 manager.go:216] Machine: {Timestamp:2026-07-02 21:31:07.301289144 +0000 UTC m=+0.338768445 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099293 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2189f3cf30922b7e9468d520291010 SystemUUID:ec2189f3-cf30-922b-7e94-68d520291010 BootID:c440aba1-ce95-4a7d-80ca-ff8a8c9e9e5f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f9:df:a4:7f:ed Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f9:df:a4:7f:ed Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:f4:96:32:e1:80 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 21:31:07.302864 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.302855    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 21:31:07.303002 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.302935    2575 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 21:31:07.304684 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.304667    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 21:31:07.307320 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.307292    2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 21:31:07.307493 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.307322    2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-110.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 21:31:07.308134 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.308124    2575 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 21:31:07.308172 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.308137    2575 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 21:31:07.308172 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.308149    2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 21:31:07.308907 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.308897    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 21:31:07.310194 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.310184    2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 21:31:07.314517 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.314502    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 21:31:07.314638 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.314629    2575 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 21:31:07.314673 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.314659    2575 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 21:31:07.314702 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.314675    2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 21:31:07.314702 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.314690    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 21:31:07.314702 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.314701    2575 kubelet.go:398] "Adding apiserver pod source"
Jul 02 21:31:07.314795 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.314712    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 21:31:07.315218 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.315204    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 21:31:07.315270 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.315232    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 21:31:07.317746 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.317727    2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 21:31:07.319633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.319619    2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 21:31:07.319675 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.319652    2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 21:31:07.320695 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.320683    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 21:31:07.320736 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.320700    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 21:31:07.320736 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.320707    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 21:31:07.320736 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.320714    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 21:31:07.320736 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.320723    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 21:31:07.320736 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.320729    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 21:31:07.320736 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.320738    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 21:31:07.320936 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.320743    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 21:31:07.320936 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.320750    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 21:31:07.320936 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.320756    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 21:31:07.320936 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.320765    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 21:31:07.320936 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.320778    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 21:31:07.321441 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.321431    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 21:31:07.321474 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.321442    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 21:31:07.325051 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.325038    2575 server.go:1268] "Started kubelet"
Jul 02 21:31:07.325293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.325264    2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 21:31:07.325366 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.325243    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 21:31:07.325521 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.325505    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 21:31:07.325980 ip-10-0-139-110 systemd[1]: Started Kubernetes Kubelet.
Jul 02 21:31:07.331897 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.331867    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 21:31:07.332003 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.331941    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 21:31:07.332132 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.332064    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k4sct"
Jul 02 21:31:07.332321 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.332251    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-110.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 21:31:07.333208 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.333179    2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 21:31:07.334392 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.334375    2575 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 21:31:07.338161 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.338136    2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 21:31:07.338604 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.337426    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-110.ec2.internal.18be9666008795ff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-110.ec2.internal,UID:ip-10-0-139-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-110.ec2.internal,},FirstTimestamp:2026-07-02 21:31:07.325011455 +0000 UTC m=+0.362490756,LastTimestamp:2026-07-02 21:31:07.325011455 +0000 UTC m=+0.362490756,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-110.ec2.internal,}"
Jul 02 21:31:07.338731 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.338712    2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 21:31:07.338838 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.338820    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 21:31:07.338938 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.338858    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-110.ec2.internal\" not found"
Jul 02 21:31:07.339008 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.338942    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-k4sct"
Jul 02 21:31:07.339514 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.339491    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 21:31:07.339633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.339611    2575 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 21:31:07.339633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.339628    2575 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 21:31:07.339784 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.339763    2575 factory.go:55] Registering systemd factory
Jul 02 21:31:07.339842 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.339788    2575 factory.go:223] Registration of the systemd container factory successfully
Jul 02 21:31:07.339842 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.339773    2575 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 21:31:07.339944 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.339829    2575 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 21:31:07.340033 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.340018    2575 factory.go:153] Registering CRI-O factory
Jul 02 21:31:07.340111 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.340037    2575 factory.go:223] Registration of the crio container factory successfully
Jul 02 21:31:07.340169 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.340123    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 21:31:07.340169 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.340147    2575 factory.go:103] Registering Raw factory
Jul 02 21:31:07.340169 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.340165    2575 manager.go:1196] Started watching for new ooms in manager
Jul 02 21:31:07.340627 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.340615    2575 manager.go:349] Starting recovery of all containers
Jul 02 21:31:07.346058 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.345896    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 21:31:07.348999 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.348964    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 21:31:07.349332 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.349310    2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-139-110.ec2.internal\" not found" node="ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.352029 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.352012    2575 manager.go:354] Recovery completed
Jul 02 21:31:07.356652 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.356636    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:31:07.358581 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.358564    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:31:07.358643 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.358596    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:31:07.358643 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.358619    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:31:07.359182 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.359168    2575 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 21:31:07.359182 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.359180    2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 21:31:07.359284 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.359196    2575 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 21:31:07.359284 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.359250    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:31:07.359940 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.359926    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:31:07.359990 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.359952    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:31:07.359990 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.359962    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:31:07.361289 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.361276    2575 policy_none.go:49] "None policy: Start"
Jul 02 21:31:07.361334 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.361293    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 21:31:07.361334 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.361303    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 21:31:07.363401 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.363390    2575 policy_none.go:47] "Start"
Jul 02 21:31:07.409627 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.409613    2575 manager.go:337] "Starting Device Plugin manager"
Jul 02 21:31:07.409701 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.409642    2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 21:31:07.409701 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.409652    2575 server.go:87] "Starting device plugin registration server"
Jul 02 21:31:07.409893 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.409880    2575 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 21:31:07.409938 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.409906    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 21:31:07.410052 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.410000    2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 21:31:07.410142 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.410105    2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 21:31:07.410142 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.410116    2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 21:31:07.410668 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.410645    2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 21:31:07.410744 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.410705    2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-110.ec2.internal\" not found"
Jul 02 21:31:07.511672 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.511618    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:31:07.514373 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.514357    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:31:07.514451 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.514389    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:31:07.514451 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.514404    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:31:07.514451 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.514435    2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.518670 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.518650    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 21:31:07.518740 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.518695    2575 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 21:31:07.518740 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.518715    2575 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 21:31:07.518812 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.518767    2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 21:31:07.521101 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.521069    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 21:31:07.521761 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.521746    2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.521829 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.521773    2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-110.ec2.internal\": node \"ip-10-0-139-110.ec2.internal\" not found"
Jul 02 21:31:07.585819 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.585794    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-110.ec2.internal\" not found"
Jul 02 21:31:07.621583 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.621562    2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-110.ec2.internal"]
Jul 02 21:31:07.621645 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.621635    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:31:07.622502 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.622484    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:31:07.622582 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.622519    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:31:07.622582 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.622534    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:31:07.624770 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.624754    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:31:07.624899 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.624873    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.624955 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.624903    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:31:07.625500 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.625483    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:31:07.625601 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.625511    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:31:07.625601 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.625526    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:31:07.625601 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.625490    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:31:07.625601 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.625561    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:31:07.625601 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.625579    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:31:07.627702 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.627686    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.627766 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.627714    2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 21:31:07.628389 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.628373    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 21:31:07.628470 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.628402    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 21:31:07.628470 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.628417    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeHasSufficientPID"
Jul 02 21:31:07.641159 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.641140    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/848e4b5bbe9811d04fb38a58e384117f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal\" (UID: \"848e4b5bbe9811d04fb38a58e384117f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.641254 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.641173    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/848e4b5bbe9811d04fb38a58e384117f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal\" (UID: \"848e4b5bbe9811d04fb38a58e384117f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.641254 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.641203    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e8b1f7912e9b285e8ec484595c325fef-config\") pod \"kube-apiserver-proxy-ip-10-0-139-110.ec2.internal\" (UID: \"e8b1f7912e9b285e8ec484595c325fef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.648645 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.648624    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-110.ec2.internal\" not found" node="ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.653317 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.653302    2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-110.ec2.internal\" not found" node="ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.686758 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.686727    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-110.ec2.internal\" not found"
Jul 02 21:31:07.741553 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.741534    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e8b1f7912e9b285e8ec484595c325fef-config\") pod \"kube-apiserver-proxy-ip-10-0-139-110.ec2.internal\" (UID: \"e8b1f7912e9b285e8ec484595c325fef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.741658 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.741559    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/848e4b5bbe9811d04fb38a58e384117f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal\" (UID: \"848e4b5bbe9811d04fb38a58e384117f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.741658 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.741576    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/848e4b5bbe9811d04fb38a58e384117f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal\" (UID: \"848e4b5bbe9811d04fb38a58e384117f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.741658 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.741612    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/848e4b5bbe9811d04fb38a58e384117f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal\" (UID: \"848e4b5bbe9811d04fb38a58e384117f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.741784 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.741657    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/848e4b5bbe9811d04fb38a58e384117f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal\" (UID: \"848e4b5bbe9811d04fb38a58e384117f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.741784 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.741663    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e8b1f7912e9b285e8ec484595c325fef-config\") pod \"kube-apiserver-proxy-ip-10-0-139-110.ec2.internal\" (UID: \"e8b1f7912e9b285e8ec484595c325fef\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.787300 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.787246    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-110.ec2.internal\" not found"
Jul 02 21:31:07.890544 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.890522    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-110.ec2.internal\" not found"
Jul 02 21:31:07.951448 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.951401    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.956733 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:07.956715    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-110.ec2.internal"
Jul 02 21:31:07.991794 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:07.990985    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-110.ec2.internal\" not found"
Jul 02 21:31:08.095680 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:08.095604    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-110.ec2.internal\" not found"
Jul 02 21:31:08.199954 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:08.199928    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-110.ec2.internal\" not found"
Jul 02 21:31:08.228929 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:08.228911    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 21:31:08.270525 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:08.270489    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 21:31:08.271128 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:08.270656    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 21:31:08.271128 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:08.270692    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 21:31:08.271128 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:08.270696    2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 21:31:08.302190 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:08.302152    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-110.ec2.internal\" not found"
Jul 02 21:31:08.342739 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:08.342702    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 21:26:08 +0000 UTC" deadline="2028-03-16 05:58:32.071275772 +0000 UTC"
Jul 02 21:31:08.342739 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:08.342737    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14936h27m23.728543263s"
Jul 02 21:31:08.402553 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:08.402486    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-110.ec2.internal\" not found"
Jul 02 21:31:08.503552 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:08.503518    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-110.ec2.internal\" not found"
Jul 02 21:31:08.589256 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:08.589216    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod848e4b5bbe9811d04fb38a58e384117f.slice/crio-86409ed20daf061ab9bcb3d4055f096cfae90d0d0b7c1cb753de33315f23eab8 WatchSource:0}: Error finding container 86409ed20daf061ab9bcb3d4055f096cfae90d0d0b7c1cb753de33315f23eab8: Status 404 returned error can't find the container with id 86409ed20daf061ab9bcb3d4055f096cfae90d0d0b7c1cb753de33315f23eab8
Jul 02 21:31:08.589487 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:08.589466    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8b1f7912e9b285e8ec484595c325fef.slice/crio-41b055540cfaf9a5166389203193bc300cc3d4969bf43ca030b3a7099a546523 WatchSource:0}: Error finding container 41b055540cfaf9a5166389203193bc300cc3d4969bf43ca030b3a7099a546523: Status 404 returned error can't find the container with id 41b055540cfaf9a5166389203193bc300cc3d4969bf43ca030b3a7099a546523
Jul 02 21:31:08.594839 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:08.594822    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 21:31:08.604315 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:08.604297    2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-110.ec2.internal\" not found"
Jul 02 21:31:08.625384 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:08.625363    2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 21:31:08.639704 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:08.639682    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal"
Jul 02 21:31:08.653399 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:08.653351    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 21:31:08.654443 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:08.654428    2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-110.ec2.internal"
Jul 02 21:31:08.662402 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:08.662385    2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 21:31:09.316516 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.316483    2575 apiserver.go:52] "Watching apiserver"
Jul 02 21:31:09.324832 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.324805    2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 21:31:09.328741 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.328691    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-89jhk","kube-system/konnectivity-agent-2n62r","kube-system/kube-apiserver-proxy-ip-10-0-139-110.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f","openshift-cluster-node-tuning-operator/tuned-62ghs","openshift-image-registry/node-ca-26tvv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal","openshift-network-diagnostics/network-check-target-wdkqq","openshift-network-operator/iptables-alerter-s64b9","kube-system/global-pull-secret-syncer-rc2fm","openshift-dns/node-resolver-tc79l","openshift-multus/multus-additional-cni-plugins-9cb65","openshift-multus/multus-httz2","openshift-multus/network-metrics-daemon-d8wzk"]
Jul 02 21:31:09.331555 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.331529    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:09.331675 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:09.331622    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:09.334155 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.334128    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.336418 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.336302    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:09.336418 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:09.336372    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:09.338468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.338142    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 21:31:09.338468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.338351    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 21:31:09.338468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.338367    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pphch\""
Jul 02 21:31:09.339226 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.338866    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.339226 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.338904    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 21:31:09.339226 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.338941    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 21:31:09.340848 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.340158    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 21:31:09.341649 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.341271    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.341883 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.341852    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 21:31:09.342297 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.341997    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 21:31:09.342297 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.342097    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dbzhs\""
Jul 02 21:31:09.342297 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.342223    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 21:31:09.344137 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.344116    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5tv9r\""
Jul 02 21:31:09.344455 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.344434    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 21:31:09.344579 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.344558    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:31:09.344694 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.344674    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-26tvv"
Jul 02 21:31:09.347196 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.347171    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s64b9"
Jul 02 21:31:09.347356 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.347337    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 21:31:09.347438 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.347385    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jtq2t\""
Jul 02 21:31:09.348160 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.348139    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 21:31:09.349350 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.348468    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 21:31:09.349655 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.349636    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:09.349752 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:09.349726    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:09.350364 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.350341    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 21:31:09.350565 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.350534    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-var-lib-cni-bin\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.350655 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.350571    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-var-lib-kubelet\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.350655 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.350596    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-device-dir\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.350655 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.350622    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7jcm\" (UniqueName: \"kubernetes.io/projected/ef12de80-68c8-44ea-995a-dd348934a275-kube-api-access-w7jcm\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.350655 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.350649    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-systemd\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.350860 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.350671    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-tuned\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.350860 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.350695    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.350860 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.350723    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret\") pod \"global-pull-secret-syncer-rc2fm\" (UID: \"6f667a42-f21d-49d0-8e40-4828f12e36db\") " pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:09.350860 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.350749    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-cnibin\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.350860 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.350782    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-run-k8s-cni-cncf-io\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.350860 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.350817    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-run-netns\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.350860 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.350842    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rkpz\" (UniqueName: \"kubernetes.io/projected/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-kube-api-access-5rkpz\") pod \"network-metrics-daemon-d8wzk\" (UID: \"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740\") " pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:09.351280 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.350867    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-etc-selinux\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.351280 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.350888    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4tpdp\""
Jul 02 21:31:09.351280 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.350918    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f667a42-f21d-49d0-8e40-4828f12e36db-dbus\") pod \"global-pull-secret-syncer-rc2fm\" (UID: \"6f667a42-f21d-49d0-8e40-4828f12e36db\") " pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:09.351280 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.350959    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-system-cni-dir\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.351280 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351004    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-registration-dir\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.351280 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351048    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-sysconfig\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.351280 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351090    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-sysctl-d\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.351280 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351116    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-sysctl-conf\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.351280 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351142    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-var-lib-kubelet\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.351280 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351197    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75bcfe41-4433-452a-aba5-b6b713f4445e-tmp\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.351280 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351231    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:31:09.351915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351233    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-multus-socket-dir-parent\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.351915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351338    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1168801f-a056-4f31-93d4-e2d3750c0035-multus-daemon-config\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.351915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351367    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-sys-fs\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.351915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351393    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-modprobe-d\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.351915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351414    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-sys\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.351915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351439    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-host\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.351915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351480    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-multus-cni-dir\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.351915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351517    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-etc-kubernetes\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.351915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351558    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-run\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.351915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351620    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-lib-modules\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.351915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351672    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5n65\" (UniqueName: \"kubernetes.io/projected/75bcfe41-4433-452a-aba5-b6b713f4445e-kube-api-access-q5n65\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.351915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351697    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-socket-dir\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.351915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351776    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-os-release\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.351915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351854    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1168801f-a056-4f31-93d4-e2d3750c0035-cni-binary-copy\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.351915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs\") pod \"network-metrics-daemon-d8wzk\" (UID: \"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740\") " pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:09.351915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351893    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f667a42-f21d-49d0-8e40-4828f12e36db-kubelet-config\") pod \"global-pull-secret-syncer-rc2fm\" (UID: \"6f667a42-f21d-49d0-8e40-4828f12e36db\") " pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:09.351915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351916    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-var-lib-cni-multus\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.353044 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351967    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-hostroot\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.353044 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351982    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-run-multus-certs\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.353044 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.351997    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-multus-conf-dir\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.353044 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.352017    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72w5z\" (UniqueName: \"kubernetes.io/projected/1168801f-a056-4f31-93d4-e2d3750c0035-kube-api-access-72w5z\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.353044 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.352041    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-kubernetes\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.353044 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.352387    2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 21:31:09.353044 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.352961    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 21:31:09.354574 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.354553    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2n62r"
Jul 02 21:31:09.358296 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.357688    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.359136 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.358586    2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 21:31:09.359136 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.358619    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 21:31:09.359136 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.358793    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 21:31:09.359136 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.358838    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xbvgf\""
Jul 02 21:31:09.361624 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.360301    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 21:31:09.361624 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.360562    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jzdgc\""
Jul 02 21:31:09.361624 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.360864    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 21:31:09.361624 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.360944    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 21:31:09.362970 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.361888    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tc79l"
Jul 02 21:31:09.362970 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.361940    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 21:31:09.362970 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.362698    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 21:31:09.363514 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.363499    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 21:31:09.364759 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.364657    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.365522 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.365226    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 21:31:09.365522 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.365249    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 21:31:09.365522 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.365292    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fml4l\""
Jul 02 21:31:09.369062 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.367852    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 21:31:09.372770 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.372747    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dxrws\""
Jul 02 21:31:09.376757 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.373358    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 21:31:09.440668 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.440646    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 21:31:09.449587 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.449565    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2vcsh"
Jul 02 21:31:09.452949 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.452928    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-socket-dir\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.453051 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.452967    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-os-release\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.453051 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453001    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c022474e-db77-4cf8-940c-07c74e1568d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.453191 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453047    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-run-openvswitch\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.453191 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c21e6cc-4e98-4f64-a437-93e72a71d077-env-overrides\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.453191 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453101    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f667a42-f21d-49d0-8e40-4828f12e36db-kubelet-config\") pod \"global-pull-secret-syncer-rc2fm\" (UID: \"6f667a42-f21d-49d0-8e40-4828f12e36db\") " pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:09.453191 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453137    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-var-lib-cni-multus\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.453191 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453161    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-hostroot\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.453191 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453190    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/50903ab1-7af9-4033-a0c1-42c65587127d-konnectivity-ca\") pod \"konnectivity-agent-2n62r\" (UID: \"50903ab1-7af9-4033-a0c1-42c65587127d\") " pod="kube-system/konnectivity-agent-2n62r"
Jul 02 21:31:09.453500 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453215    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c022474e-db77-4cf8-940c-07c74e1568d2-os-release\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.453500 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453241    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-etc-openvswitch\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.453500 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453265    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c21e6cc-4e98-4f64-a437-93e72a71d077-ovn-node-metrics-cert\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.453500 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c022474e-db77-4cf8-940c-07c74e1568d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.453500 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453352    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6f667a42-f21d-49d0-8e40-4828f12e36db-kubelet-config\") pod \"global-pull-secret-syncer-rc2fm\" (UID: \"6f667a42-f21d-49d0-8e40-4828f12e36db\") " pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:09.453500 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453415    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-var-lib-cni-multus\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.453500 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453439    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-hostroot\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.453500 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453476    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-os-release\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.453983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453514    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c21e6cc-4e98-4f64-a437-93e72a71d077-ovnkube-config\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.453983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453545    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef-tmp-dir\") pod \"node-resolver-tc79l\" (UID: \"8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef\") " pod="openshift-dns/node-resolver-tc79l"
Jul 02 21:31:09.453983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453552    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-socket-dir\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.453983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453585    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-var-lib-cni-bin\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.453983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453615    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-systemd\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.453983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453655    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-var-lib-cni-bin\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.453983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453683    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-tuned\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.453983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453710    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgnp6\" (UniqueName: \"kubernetes.io/projected/9c21e6cc-4e98-4f64-a437-93e72a71d077-kube-api-access-sgnp6\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.453983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453747    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grjsd\" (UniqueName: \"kubernetes.io/projected/8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef-kube-api-access-grjsd\") pod \"node-resolver-tc79l\" (UID: \"8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef\") " pod="openshift-dns/node-resolver-tc79l"
Jul 02 21:31:09.453983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453756    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-systemd\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.453983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-cnibin\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.453983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453803    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-etc-selinux\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.453983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453829    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-sysconfig\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.453983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453852    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-sysctl-d\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.453983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-run-ovn\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.453983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453899    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-log-socket\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.453983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453924    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f667a42-f21d-49d0-8e40-4828f12e36db-dbus\") pod \"global-pull-secret-syncer-rc2fm\" (UID: \"6f667a42-f21d-49d0-8e40-4828f12e36db\") " pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453948    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-system-cni-dir\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.453973    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-registration-dir\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454000    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-var-lib-kubelet\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454041    2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454091    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-sysconfig\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454171    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-etc-selinux\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454208    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75bcfe41-4433-452a-aba5-b6b713f4445e-tmp\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454211    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-sysctl-d\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454241    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnw86\" (UniqueName: \"kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86\") pod \"network-check-target-wdkqq\" (UID: \"47bc453e-8ee1-479c-b138-4db88759552b\") " pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454324    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-var-lib-kubelet\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454333    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-system-cni-dir\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454354    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-var-lib-openvswitch\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454391    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-registration-dir\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454431    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-multus-socket-dir-parent\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454457    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6f667a42-f21d-49d0-8e40-4828f12e36db-dbus\") pod \"global-pull-secret-syncer-rc2fm\" (UID: \"6f667a42-f21d-49d0-8e40-4828f12e36db\") " pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454459    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1168801f-a056-4f31-93d4-e2d3750c0035-multus-daemon-config\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454505    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-sys-fs\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.454857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454533    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-modprobe-d\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.455762 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454564    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c022474e-db77-4cf8-940c-07c74e1568d2-system-cni-dir\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.455762 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454639    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfc8k\" (UniqueName: \"kubernetes.io/projected/d35e7da7-8891-4293-8b43-aa77447be718-kube-api-access-tfc8k\") pod \"iptables-alerter-s64b9\" (UID: \"d35e7da7-8891-4293-8b43-aa77447be718\") " pod="openshift-network-operator/iptables-alerter-s64b9"
Jul 02 21:31:09.455762 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454667    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-run-systemd\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.455762 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454691    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-run-ovn-kubernetes\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.455762 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454731    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-multus-cni-dir\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.455762 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-etc-kubernetes\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.455762 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454785    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztswc\" (UniqueName: \"kubernetes.io/projected/55c68fb2-3894-4e91-b536-b47a9ec3900c-kube-api-access-ztswc\") pod \"node-ca-26tvv\" (UID: \"55c68fb2-3894-4e91-b536-b47a9ec3900c\") " pod="openshift-image-registry/node-ca-26tvv"
Jul 02 21:31:09.455762 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454847    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d35e7da7-8891-4293-8b43-aa77447be718-host-slash\") pod \"iptables-alerter-s64b9\" (UID: \"d35e7da7-8891-4293-8b43-aa77447be718\") " pod="openshift-network-operator/iptables-alerter-s64b9"
Jul 02 21:31:09.455762 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454874    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1168801f-a056-4f31-93d4-e2d3750c0035-cni-binary-copy\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.455762 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454900    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs\") pod \"network-metrics-daemon-d8wzk\" (UID: \"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740\") " pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:09.455762 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454928    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-run-multus-certs\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.455762 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454955    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c022474e-db77-4cf8-940c-07c74e1568d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.455762 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.454989    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55c68fb2-3894-4e91-b536-b47a9ec3900c-serviceca\") pod \"node-ca-26tvv\" (UID: \"55c68fb2-3894-4e91-b536-b47a9ec3900c\") " pod="openshift-image-registry/node-ca-26tvv"
Jul 02 21:31:09.455762 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455025    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef-hosts-file\") pod \"node-resolver-tc79l\" (UID: \"8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef\") " pod="openshift-dns/node-resolver-tc79l"
Jul 02 21:31:09.455762 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455053    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-multus-conf-dir\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.455762 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455079    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72w5z\" (UniqueName: \"kubernetes.io/projected/1168801f-a056-4f31-93d4-e2d3750c0035-kube-api-access-72w5z\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.455762 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455124    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-kubernetes\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.456633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455026    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1168801f-a056-4f31-93d4-e2d3750c0035-multus-daemon-config\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.456633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455097    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-multus-socket-dir-parent\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.456633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455221    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxcr5\" (UniqueName: \"kubernetes.io/projected/c022474e-db77-4cf8-940c-07c74e1568d2-kube-api-access-cxcr5\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.456633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455225    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-etc-kubernetes\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.456633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455255    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55c68fb2-3894-4e91-b536-b47a9ec3900c-host\") pod \"node-ca-26tvv\" (UID: \"55c68fb2-3894-4e91-b536-b47a9ec3900c\") " pod="openshift-image-registry/node-ca-26tvv"
Jul 02 21:31:09.456633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-cni-netd\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.456633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c022474e-db77-4cf8-940c-07c74e1568d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.456633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-var-lib-kubelet\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.456633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455389    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-device-dir\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.456633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455417    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7jcm\" (UniqueName: \"kubernetes.io/projected/ef12de80-68c8-44ea-995a-dd348934a275-kube-api-access-w7jcm\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.456633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455443    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c022474e-db77-4cf8-940c-07c74e1568d2-cnibin\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.456633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455480    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d35e7da7-8891-4293-8b43-aa77447be718-iptables-alerter-script\") pod \"iptables-alerter-s64b9\" (UID: \"d35e7da7-8891-4293-8b43-aa77447be718\") " pod="openshift-network-operator/iptables-alerter-s64b9"
Jul 02 21:31:09.456633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455509    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-kubelet\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.456633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455536    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5n65\" (UniqueName: \"kubernetes.io/projected/75bcfe41-4433-452a-aba5-b6b713f4445e-kube-api-access-q5n65\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.456633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455563    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.456633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret\") pod \"global-pull-secret-syncer-rc2fm\" (UID: \"6f667a42-f21d-49d0-8e40-4828f12e36db\") " pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:09.457468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-run-k8s-cni-cncf-io\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.457468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455705    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1168801f-a056-4f31-93d4-e2d3750c0035-cni-binary-copy\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.457468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455723    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-run-netns\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.457468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455752    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rkpz\" (UniqueName: \"kubernetes.io/projected/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-kube-api-access-5rkpz\") pod \"network-metrics-daemon-d8wzk\" (UID: \"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740\") " pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:09.457468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455779    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-systemd-units\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.457468 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:09.455802    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:09.457468 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:09.455876    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs podName:ad9a4f7b-552f-469a-be1b-7ab6b4bd3740 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:09.955843353 +0000 UTC m=+2.993322646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs") pod "network-metrics-daemon-d8wzk" (UID: "ad9a4f7b-552f-469a-be1b-7ab6b4bd3740") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:09.457468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455912    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-sysctl-conf\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.457468 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:09.455979    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:09.457468 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:09.456025    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret podName:6f667a42-f21d-49d0-8e40-4828f12e36db nodeName:}" failed. No retries permitted until 2026-07-02 21:31:09.956008607 +0000 UTC m=+2.993487902 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret") pod "global-pull-secret-syncer-rc2fm" (UID: "6f667a42-f21d-49d0-8e40-4828f12e36db") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:09.457468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456068    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-sys-fs\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.457468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456144    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-kubernetes\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.457468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456153    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-modprobe-d\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.457468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456217    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-multus-cni-dir\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.457468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456218    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-run-multus-certs\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.457468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456268    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-var-lib-kubelet\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.457468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456310    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-device-dir\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.458331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456498    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-multus-conf-dir\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.458331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.455805    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-sysctl-conf\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.458331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456596    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-sys\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.458331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456608    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ef12de80-68c8-44ea-995a-dd348934a275-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.458331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456643    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-run-k8s-cni-cncf-io\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.458331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456627    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-host\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.458331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456673    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-host-run-netns\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.458331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456701    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/50903ab1-7af9-4033-a0c1-42c65587127d-agent-certs\") pod \"konnectivity-agent-2n62r\" (UID: \"50903ab1-7af9-4033-a0c1-42c65587127d\") " pod="kube-system/konnectivity-agent-2n62r"
Jul 02 21:31:09.458331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456730    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-slash\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.458331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456757    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-node-log\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.458331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456807    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-cni-bin\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.458331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456837    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.458331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456865    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c21e6cc-4e98-4f64-a437-93e72a71d077-ovnkube-script-lib\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.458331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456906    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-run\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.458331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456936    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-lib-modules\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.458331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.456905    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-host\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.458331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.457009    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-run-netns\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.459283 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.457172    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-lib-modules\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.459283 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.457221    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-sys\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.459283 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.457274    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/75bcfe41-4433-452a-aba5-b6b713f4445e-run\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.459283 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.457384    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1168801f-a056-4f31-93d4-e2d3750c0035-cnibin\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.461920 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.461862    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75bcfe41-4433-452a-aba5-b6b713f4445e-tmp\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.462548 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.462508    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/75bcfe41-4433-452a-aba5-b6b713f4445e-etc-tuned\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.465753 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.465330    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2vcsh"
Jul 02 21:31:09.472343 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.472255    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rkpz\" (UniqueName: \"kubernetes.io/projected/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-kube-api-access-5rkpz\") pod \"network-metrics-daemon-d8wzk\" (UID: \"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740\") " pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:09.473312 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.473266    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72w5z\" (UniqueName: \"kubernetes.io/projected/1168801f-a056-4f31-93d4-e2d3750c0035-kube-api-access-72w5z\") pod \"multus-httz2\" (UID: \"1168801f-a056-4f31-93d4-e2d3750c0035\") " pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.475726 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.475698    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5n65\" (UniqueName: \"kubernetes.io/projected/75bcfe41-4433-452a-aba5-b6b713f4445e-kube-api-access-q5n65\") pod \"tuned-62ghs\" (UID: \"75bcfe41-4433-452a-aba5-b6b713f4445e\") " pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.477143 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.477118    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7jcm\" (UniqueName: \"kubernetes.io/projected/ef12de80-68c8-44ea-995a-dd348934a275-kube-api-access-w7jcm\") pod \"aws-ebs-csi-driver-node-rxm8f\" (UID: \"ef12de80-68c8-44ea-995a-dd348934a275\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.524901 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.524852    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-110.ec2.internal" event={"ID":"e8b1f7912e9b285e8ec484595c325fef","Type":"ContainerStarted","Data":"41b055540cfaf9a5166389203193bc300cc3d4969bf43ca030b3a7099a546523"}
Jul 02 21:31:09.526678 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.526652    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal" event={"ID":"848e4b5bbe9811d04fb38a58e384117f","Type":"ContainerStarted","Data":"86409ed20daf061ab9bcb3d4055f096cfae90d0d0b7c1cb753de33315f23eab8"}
Jul 02 21:31:09.558238 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558213    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c022474e-db77-4cf8-940c-07c74e1568d2-cnibin\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.558318 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558254    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d35e7da7-8891-4293-8b43-aa77447be718-iptables-alerter-script\") pod \"iptables-alerter-s64b9\" (UID: \"d35e7da7-8891-4293-8b43-aa77447be718\") " pod="openshift-network-operator/iptables-alerter-s64b9"
Jul 02 21:31:09.558318 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558304    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-kubelet\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.558394 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558332    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c022474e-db77-4cf8-940c-07c74e1568d2-cnibin\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.558394 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558349    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-systemd-units\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.558463 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558395    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/50903ab1-7af9-4033-a0c1-42c65587127d-agent-certs\") pod \"konnectivity-agent-2n62r\" (UID: \"50903ab1-7af9-4033-a0c1-42c65587127d\") " pod="kube-system/konnectivity-agent-2n62r"
Jul 02 21:31:09.558463 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558407    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-systemd-units\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.558463 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558424    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-slash\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.558463 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558427    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-kubelet\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.558463 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-node-log\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.558605 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558488    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-node-log\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.558605 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558491    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-cni-bin\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.558605 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558527    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.558605 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558532    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-cni-bin\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.558605 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558556    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c21e6cc-4e98-4f64-a437-93e72a71d077-ovnkube-script-lib\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.558605 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558573    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-slash\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.558605 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558582    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-run-netns\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.558813 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558614    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.558813 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558623    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c022474e-db77-4cf8-940c-07c74e1568d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.558813 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558648    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-run-openvswitch\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.558813 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558675    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c21e6cc-4e98-4f64-a437-93e72a71d077-env-overrides\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.558813 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558707    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/50903ab1-7af9-4033-a0c1-42c65587127d-konnectivity-ca\") pod \"konnectivity-agent-2n62r\" (UID: \"50903ab1-7af9-4033-a0c1-42c65587127d\") " pod="kube-system/konnectivity-agent-2n62r"
Jul 02 21:31:09.558813 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558731    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c022474e-db77-4cf8-940c-07c74e1568d2-os-release\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.558813 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558757    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-etc-openvswitch\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.559030 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558955    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d35e7da7-8891-4293-8b43-aa77447be718-iptables-alerter-script\") pod \"iptables-alerter-s64b9\" (UID: \"d35e7da7-8891-4293-8b43-aa77447be718\") " pod="openshift-network-operator/iptables-alerter-s64b9"
Jul 02 21:31:09.559152 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559132    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-etc-openvswitch\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.559218 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559151    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c022474e-db77-4cf8-940c-07c74e1568d2-os-release\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.559314 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559264    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-run-openvswitch\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.559314 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.558785    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c21e6cc-4e98-4f64-a437-93e72a71d077-ovn-node-metrics-cert\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.559426 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559319    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-run-netns\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.559426 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559321    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c022474e-db77-4cf8-940c-07c74e1568d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.559426 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c21e6cc-4e98-4f64-a437-93e72a71d077-ovnkube-config\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.559426 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559388    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef-tmp-dir\") pod \"node-resolver-tc79l\" (UID: \"8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef\") " pod="openshift-dns/node-resolver-tc79l"
Jul 02 21:31:09.559426 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559419    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgnp6\" (UniqueName: \"kubernetes.io/projected/9c21e6cc-4e98-4f64-a437-93e72a71d077-kube-api-access-sgnp6\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.559671 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559446    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grjsd\" (UniqueName: \"kubernetes.io/projected/8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef-kube-api-access-grjsd\") pod \"node-resolver-tc79l\" (UID: \"8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef\") " pod="openshift-dns/node-resolver-tc79l"
Jul 02 21:31:09.559671 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559475    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-run-ovn\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.559671 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559479    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c022474e-db77-4cf8-940c-07c74e1568d2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.559671 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559497    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-log-socket\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.559671 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559501    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9c21e6cc-4e98-4f64-a437-93e72a71d077-env-overrides\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.559671 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559528    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnw86\" (UniqueName: \"kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86\") pod \"network-check-target-wdkqq\" (UID: \"47bc453e-8ee1-479c-b138-4db88759552b\") " pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:09.559671 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559552    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-var-lib-openvswitch\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.559671 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559580    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c022474e-db77-4cf8-940c-07c74e1568d2-system-cni-dir\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.559671 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559605    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfc8k\" (UniqueName: \"kubernetes.io/projected/d35e7da7-8891-4293-8b43-aa77447be718-kube-api-access-tfc8k\") pod \"iptables-alerter-s64b9\" (UID: \"d35e7da7-8891-4293-8b43-aa77447be718\") " pod="openshift-network-operator/iptables-alerter-s64b9"
Jul 02 21:31:09.559671 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559628    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-run-systemd\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.559671 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559651    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-run-ovn-kubernetes\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.559671 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559677    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztswc\" (UniqueName: \"kubernetes.io/projected/55c68fb2-3894-4e91-b536-b47a9ec3900c-kube-api-access-ztswc\") pod \"node-ca-26tvv\" (UID: \"55c68fb2-3894-4e91-b536-b47a9ec3900c\") " pod="openshift-image-registry/node-ca-26tvv"
Jul 02 21:31:09.560344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559700    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d35e7da7-8891-4293-8b43-aa77447be718-host-slash\") pod \"iptables-alerter-s64b9\" (UID: \"d35e7da7-8891-4293-8b43-aa77447be718\") " pod="openshift-network-operator/iptables-alerter-s64b9"
Jul 02 21:31:09.560344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559719    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/50903ab1-7af9-4033-a0c1-42c65587127d-konnectivity-ca\") pod \"konnectivity-agent-2n62r\" (UID: \"50903ab1-7af9-4033-a0c1-42c65587127d\") " pod="kube-system/konnectivity-agent-2n62r"
Jul 02 21:31:09.560344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559719    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c022474e-db77-4cf8-940c-07c74e1568d2-cni-binary-copy\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.560344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559739    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c022474e-db77-4cf8-940c-07c74e1568d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.560344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559786    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55c68fb2-3894-4e91-b536-b47a9ec3900c-serviceca\") pod \"node-ca-26tvv\" (UID: \"55c68fb2-3894-4e91-b536-b47a9ec3900c\") " pod="openshift-image-registry/node-ca-26tvv"
Jul 02 21:31:09.560344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559814    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef-hosts-file\") pod \"node-resolver-tc79l\" (UID: \"8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef\") " pod="openshift-dns/node-resolver-tc79l"
Jul 02 21:31:09.560344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559846    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxcr5\" (UniqueName: \"kubernetes.io/projected/c022474e-db77-4cf8-940c-07c74e1568d2-kube-api-access-cxcr5\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.560344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559872    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55c68fb2-3894-4e91-b536-b47a9ec3900c-host\") pod \"node-ca-26tvv\" (UID: \"55c68fb2-3894-4e91-b536-b47a9ec3900c\") " pod="openshift-image-registry/node-ca-26tvv"
Jul 02 21:31:09.560344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559898    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-cni-netd\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.560344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.559924    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c022474e-db77-4cf8-940c-07c74e1568d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.560344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.560016    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef-tmp-dir\") pod \"node-resolver-tc79l\" (UID: \"8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef\") " pod="openshift-dns/node-resolver-tc79l"
Jul 02 21:31:09.560344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.560078    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c022474e-db77-4cf8-940c-07c74e1568d2-system-cni-dir\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.560344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.560253    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9c21e6cc-4e98-4f64-a437-93e72a71d077-ovnkube-config\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.560344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.560273    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c022474e-db77-4cf8-940c-07c74e1568d2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.560344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.560325    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-run-ovn-kubernetes\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.561150 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.560356    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-run-ovn\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.561150 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.560465    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c022474e-db77-4cf8-940c-07c74e1568d2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.561150 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.560526    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55c68fb2-3894-4e91-b536-b47a9ec3900c-host\") pod \"node-ca-26tvv\" (UID: \"55c68fb2-3894-4e91-b536-b47a9ec3900c\") " pod="openshift-image-registry/node-ca-26tvv"
Jul 02 21:31:09.561150 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.560542    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-run-systemd\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.561150 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.560573    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-host-cni-netd\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.561150 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.560609    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef-hosts-file\") pod \"node-resolver-tc79l\" (UID: \"8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef\") " pod="openshift-dns/node-resolver-tc79l"
Jul 02 21:31:09.561150 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.560626    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d35e7da7-8891-4293-8b43-aa77447be718-host-slash\") pod \"iptables-alerter-s64b9\" (UID: \"d35e7da7-8891-4293-8b43-aa77447be718\") " pod="openshift-network-operator/iptables-alerter-s64b9"
Jul 02 21:31:09.561150 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.560671    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-var-lib-openvswitch\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.561150 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.560708    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9c21e6cc-4e98-4f64-a437-93e72a71d077-log-socket\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.561150 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.560983    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55c68fb2-3894-4e91-b536-b47a9ec3900c-serviceca\") pod \"node-ca-26tvv\" (UID: \"55c68fb2-3894-4e91-b536-b47a9ec3900c\") " pod="openshift-image-registry/node-ca-26tvv"
Jul 02 21:31:09.561629 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.561261    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9c21e6cc-4e98-4f64-a437-93e72a71d077-ovnkube-script-lib\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.562566 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.562539    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9c21e6cc-4e98-4f64-a437-93e72a71d077-ovn-node-metrics-cert\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.563224 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.563201    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/50903ab1-7af9-4033-a0c1-42c65587127d-agent-certs\") pod \"konnectivity-agent-2n62r\" (UID: \"50903ab1-7af9-4033-a0c1-42c65587127d\") " pod="kube-system/konnectivity-agent-2n62r"
Jul 02 21:31:09.577112 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.576917    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztswc\" (UniqueName: \"kubernetes.io/projected/55c68fb2-3894-4e91-b536-b47a9ec3900c-kube-api-access-ztswc\") pod \"node-ca-26tvv\" (UID: \"55c68fb2-3894-4e91-b536-b47a9ec3900c\") " pod="openshift-image-registry/node-ca-26tvv"
Jul 02 21:31:09.577112 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.577031    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxcr5\" (UniqueName: \"kubernetes.io/projected/c022474e-db77-4cf8-940c-07c74e1568d2-kube-api-access-cxcr5\") pod \"multus-additional-cni-plugins-9cb65\" (UID: \"c022474e-db77-4cf8-940c-07c74e1568d2\") " pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.584717 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:09.584694    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:31:09.584876 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:09.584726    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:31:09.584876 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:09.584740    2575 projected.go:196] Error preparing data for projected volume kube-api-access-bnw86 for pod openshift-network-diagnostics/network-check-target-wdkqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:09.584876 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:09.584814    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86 podName:47bc453e-8ee1-479c-b138-4db88759552b nodeName:}" failed. No retries permitted until 2026-07-02 21:31:10.084795012 +0000 UTC m=+3.122274303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bnw86" (UniqueName: "kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86") pod "network-check-target-wdkqq" (UID: "47bc453e-8ee1-479c-b138-4db88759552b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:09.587511 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.587486    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grjsd\" (UniqueName: \"kubernetes.io/projected/8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef-kube-api-access-grjsd\") pod \"node-resolver-tc79l\" (UID: \"8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef\") " pod="openshift-dns/node-resolver-tc79l"
Jul 02 21:31:09.588214 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.588146    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfc8k\" (UniqueName: \"kubernetes.io/projected/d35e7da7-8891-4293-8b43-aa77447be718-kube-api-access-tfc8k\") pod \"iptables-alerter-s64b9\" (UID: \"d35e7da7-8891-4293-8b43-aa77447be718\") " pod="openshift-network-operator/iptables-alerter-s64b9"
Jul 02 21:31:09.590885 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.590860    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgnp6\" (UniqueName: \"kubernetes.io/projected/9c21e6cc-4e98-4f64-a437-93e72a71d077-kube-api-access-sgnp6\") pod \"ovnkube-node-89jhk\" (UID: \"9c21e6cc-4e98-4f64-a437-93e72a71d077\") " pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.619541 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.619502    2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 21:31:09.647249 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.647214    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-httz2"
Jul 02 21:31:09.656548 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.656527    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f"
Jul 02 21:31:09.658216 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:09.658190    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1168801f_a056_4f31_93d4_e2d3750c0035.slice/crio-0bcac55185fc492f5c582701ce7374fd6b682230a7c8a20715b47b6068c84264 WatchSource:0}: Error finding container 0bcac55185fc492f5c582701ce7374fd6b682230a7c8a20715b47b6068c84264: Status 404 returned error can't find the container with id 0bcac55185fc492f5c582701ce7374fd6b682230a7c8a20715b47b6068c84264
Jul 02 21:31:09.666170 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.666144    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-62ghs"
Jul 02 21:31:09.667746 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:09.667723    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef12de80_68c8_44ea_995a_dd348934a275.slice/crio-befd1aef545720a8e2d3e0e2653f288f4a3bb19f21341460c7a1a0e65d5b4dcf WatchSource:0}: Error finding container befd1aef545720a8e2d3e0e2653f288f4a3bb19f21341460c7a1a0e65d5b4dcf: Status 404 returned error can't find the container with id befd1aef545720a8e2d3e0e2653f288f4a3bb19f21341460c7a1a0e65d5b4dcf
Jul 02 21:31:09.677270 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:09.677244    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75bcfe41_4433_452a_aba5_b6b713f4445e.slice/crio-02d5bca3fbbabc4a42a3da40b20af4460499d314d117ba934191fb281e87cd79 WatchSource:0}: Error finding container 02d5bca3fbbabc4a42a3da40b20af4460499d314d117ba934191fb281e87cd79: Status 404 returned error can't find the container with id 02d5bca3fbbabc4a42a3da40b20af4460499d314d117ba934191fb281e87cd79
Jul 02 21:31:09.678480 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.678462    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-26tvv"
Jul 02 21:31:09.688731 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:09.688662    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c68fb2_3894_4e91_b536_b47a9ec3900c.slice/crio-5f03061e8bce282ce1ce82353eb2b7cf1ca80d70d53ffdbd3785dcd022d31f6d WatchSource:0}: Error finding container 5f03061e8bce282ce1ce82353eb2b7cf1ca80d70d53ffdbd3785dcd022d31f6d: Status 404 returned error can't find the container with id 5f03061e8bce282ce1ce82353eb2b7cf1ca80d70d53ffdbd3785dcd022d31f6d
Jul 02 21:31:09.688731 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.688694    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s64b9"
Jul 02 21:31:09.698263 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.697864    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2n62r"
Jul 02 21:31:09.698596 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:09.698571    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd35e7da7_8891_4293_8b43_aa77447be718.slice/crio-b08219297394676fb77f5c2a106d4b780ad1a7410f88dd4ca00063d93cd86cfe WatchSource:0}: Error finding container b08219297394676fb77f5c2a106d4b780ad1a7410f88dd4ca00063d93cd86cfe: Status 404 returned error can't find the container with id b08219297394676fb77f5c2a106d4b780ad1a7410f88dd4ca00063d93cd86cfe
Jul 02 21:31:09.707495 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:09.707473    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50903ab1_7af9_4033_a0c1_42c65587127d.slice/crio-38bb0b6b66d1a05794f66e83dc445b2a46c9ff2330ca4dd77a2efa3e54a04433 WatchSource:0}: Error finding container 38bb0b6b66d1a05794f66e83dc445b2a46c9ff2330ca4dd77a2efa3e54a04433: Status 404 returned error can't find the container with id 38bb0b6b66d1a05794f66e83dc445b2a46c9ff2330ca4dd77a2efa3e54a04433
Jul 02 21:31:09.708491 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.708471    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:09.716357 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.716333    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tc79l"
Jul 02 21:31:09.718629 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:09.718607    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c21e6cc_4e98_4f64_a437_93e72a71d077.slice/crio-09b20f8a3a2c86ad85deef8a6e237a5ff3e76aa0503781dbcb8a7b7ce7caec6e WatchSource:0}: Error finding container 09b20f8a3a2c86ad85deef8a6e237a5ff3e76aa0503781dbcb8a7b7ce7caec6e: Status 404 returned error can't find the container with id 09b20f8a3a2c86ad85deef8a6e237a5ff3e76aa0503781dbcb8a7b7ce7caec6e
Jul 02 21:31:09.728362 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:09.728339    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a0c06cc_1a9c_4c17_86dd_b6cfad9dbeef.slice/crio-fee4c0e68e459af50dd24a25d774af3807f5c8323d957cfbe20514aa5d40bd00 WatchSource:0}: Error finding container fee4c0e68e459af50dd24a25d774af3807f5c8323d957cfbe20514aa5d40bd00: Status 404 returned error can't find the container with id fee4c0e68e459af50dd24a25d774af3807f5c8323d957cfbe20514aa5d40bd00
Jul 02 21:31:09.731580 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.731561    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9cb65"
Jul 02 21:31:09.744265 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:09.744237    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc022474e_db77_4cf8_940c_07c74e1568d2.slice/crio-666cd7d1a920689fdd06e64dd0818a57d24c69b72e8270e30b257c1e3974ea24 WatchSource:0}: Error finding container 666cd7d1a920689fdd06e64dd0818a57d24c69b72e8270e30b257c1e3974ea24: Status 404 returned error can't find the container with id 666cd7d1a920689fdd06e64dd0818a57d24c69b72e8270e30b257c1e3974ea24
Jul 02 21:31:09.906346 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.906261    2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 21:31:09.963344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.963311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret\") pod \"global-pull-secret-syncer-rc2fm\" (UID: \"6f667a42-f21d-49d0-8e40-4828f12e36db\") " pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:09.963520 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:09.963392    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs\") pod \"network-metrics-daemon-d8wzk\" (UID: \"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740\") " pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:09.963520 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:09.963490    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:09.963641 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:09.963543    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs podName:ad9a4f7b-552f-469a-be1b-7ab6b4bd3740 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:10.963529287 +0000 UTC m=+4.001008575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs") pod "network-metrics-daemon-d8wzk" (UID: "ad9a4f7b-552f-469a-be1b-7ab6b4bd3740") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:09.963641 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:09.963492    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:09.963641 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:09.963635    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret podName:6f667a42-f21d-49d0-8e40-4828f12e36db nodeName:}" failed. No retries permitted until 2026-07-02 21:31:10.963620245 +0000 UTC m=+4.001099548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret") pod "global-pull-secret-syncer-rc2fm" (UID: "6f667a42-f21d-49d0-8e40-4828f12e36db") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:10.165489 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:10.165407    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnw86\" (UniqueName: \"kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86\") pod \"network-check-target-wdkqq\" (UID: \"47bc453e-8ee1-479c-b138-4db88759552b\") " pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:10.165647 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:10.165588    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:31:10.165647 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:10.165611    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:31:10.165647 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:10.165626    2575 projected.go:196] Error preparing data for projected volume kube-api-access-bnw86 for pod openshift-network-diagnostics/network-check-target-wdkqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:10.165805 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:10.165690    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86 podName:47bc453e-8ee1-479c-b138-4db88759552b nodeName:}" failed. No retries permitted until 2026-07-02 21:31:11.165669417 +0000 UTC m=+4.203148707 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bnw86" (UniqueName: "kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86") pod "network-check-target-wdkqq" (UID: "47bc453e-8ee1-479c-b138-4db88759552b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:10.470599 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:10.470515    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 21:26:10 +0000 UTC" deadline="2028-03-26 10:43:17.706769504 +0000 UTC"
Jul 02 21:31:10.470599 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:10.470557    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15181h12m7.236217725s"
Jul 02 21:31:10.530094 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:10.530058    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cb65" event={"ID":"c022474e-db77-4cf8-940c-07c74e1568d2","Type":"ContainerStarted","Data":"666cd7d1a920689fdd06e64dd0818a57d24c69b72e8270e30b257c1e3974ea24"}
Jul 02 21:31:10.532105 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:10.532065    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tc79l" event={"ID":"8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef","Type":"ContainerStarted","Data":"fee4c0e68e459af50dd24a25d774af3807f5c8323d957cfbe20514aa5d40bd00"}
Jul 02 21:31:10.534136 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:10.534056    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-26tvv" event={"ID":"55c68fb2-3894-4e91-b536-b47a9ec3900c","Type":"ContainerStarted","Data":"5f03061e8bce282ce1ce82353eb2b7cf1ca80d70d53ffdbd3785dcd022d31f6d"}
Jul 02 21:31:10.535799 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:10.535736    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f" event={"ID":"ef12de80-68c8-44ea-995a-dd348934a275","Type":"ContainerStarted","Data":"befd1aef545720a8e2d3e0e2653f288f4a3bb19f21341460c7a1a0e65d5b4dcf"}
Jul 02 21:31:10.538798 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:10.538762    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk" event={"ID":"9c21e6cc-4e98-4f64-a437-93e72a71d077","Type":"ContainerStarted","Data":"09b20f8a3a2c86ad85deef8a6e237a5ff3e76aa0503781dbcb8a7b7ce7caec6e"}
Jul 02 21:31:10.540646 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:10.540616    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2n62r" event={"ID":"50903ab1-7af9-4033-a0c1-42c65587127d","Type":"ContainerStarted","Data":"38bb0b6b66d1a05794f66e83dc445b2a46c9ff2330ca4dd77a2efa3e54a04433"}
Jul 02 21:31:10.542141 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:10.542113    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s64b9" event={"ID":"d35e7da7-8891-4293-8b43-aa77447be718","Type":"ContainerStarted","Data":"b08219297394676fb77f5c2a106d4b780ad1a7410f88dd4ca00063d93cd86cfe"}
Jul 02 21:31:10.543880 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:10.543854    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-62ghs" event={"ID":"75bcfe41-4433-452a-aba5-b6b713f4445e","Type":"ContainerStarted","Data":"02d5bca3fbbabc4a42a3da40b20af4460499d314d117ba934191fb281e87cd79"}
Jul 02 21:31:10.545722 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:10.545694    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-httz2" event={"ID":"1168801f-a056-4f31-93d4-e2d3750c0035","Type":"ContainerStarted","Data":"0bcac55185fc492f5c582701ce7374fd6b682230a7c8a20715b47b6068c84264"}
Jul 02 21:31:10.975023 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:10.974742    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs\") pod \"network-metrics-daemon-d8wzk\" (UID: \"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740\") " pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:10.975300 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:10.975093    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret\") pod \"global-pull-secret-syncer-rc2fm\" (UID: \"6f667a42-f21d-49d0-8e40-4828f12e36db\") " pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:10.975300 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:10.975179    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:10.975300 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:10.975193    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:10.975300 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:10.975258    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret podName:6f667a42-f21d-49d0-8e40-4828f12e36db nodeName:}" failed. No retries permitted until 2026-07-02 21:31:12.97523609 +0000 UTC m=+6.012715378 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret") pod "global-pull-secret-syncer-rc2fm" (UID: "6f667a42-f21d-49d0-8e40-4828f12e36db") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:10.975300 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:10.975278    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs podName:ad9a4f7b-552f-469a-be1b-7ab6b4bd3740 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:12.97526791 +0000 UTC m=+6.012747200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs") pod "network-metrics-daemon-d8wzk" (UID: "ad9a4f7b-552f-469a-be1b-7ab6b4bd3740") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:11.176491 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:11.176451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnw86\" (UniqueName: \"kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86\") pod \"network-check-target-wdkqq\" (UID: \"47bc453e-8ee1-479c-b138-4db88759552b\") " pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:11.176676 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:11.176650    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:31:11.176676 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:11.176674    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:31:11.176806 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:11.176687    2575 projected.go:196] Error preparing data for projected volume kube-api-access-bnw86 for pod openshift-network-diagnostics/network-check-target-wdkqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:11.176806 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:11.176759    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86 podName:47bc453e-8ee1-479c-b138-4db88759552b nodeName:}" failed. No retries permitted until 2026-07-02 21:31:13.176731211 +0000 UTC m=+6.214210499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bnw86" (UniqueName: "kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86") pod "network-check-target-wdkqq" (UID: "47bc453e-8ee1-479c-b138-4db88759552b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:11.471331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:11.471290    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 21:26:10 +0000 UTC" deadline="2027-12-10 20:34:34.107231281 +0000 UTC"
Jul 02 21:31:11.471331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:11.471332    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12623h3m22.635904619s"
Jul 02 21:31:11.521504 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:11.521477    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:11.521667 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:11.521618    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:11.522073 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:11.522051    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:11.522204 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:11.522182    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:11.522273 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:11.522253    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:11.522341 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:11.522323    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:12.997512 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:12.996632    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs\") pod \"network-metrics-daemon-d8wzk\" (UID: \"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740\") " pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:12.997512 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:12.996703    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret\") pod \"global-pull-secret-syncer-rc2fm\" (UID: \"6f667a42-f21d-49d0-8e40-4828f12e36db\") " pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:12.997512 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:12.996884    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:12.997512 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:12.996949    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret podName:6f667a42-f21d-49d0-8e40-4828f12e36db nodeName:}" failed. No retries permitted until 2026-07-02 21:31:16.996929239 +0000 UTC m=+10.034408542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret") pod "global-pull-secret-syncer-rc2fm" (UID: "6f667a42-f21d-49d0-8e40-4828f12e36db") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:12.997512 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:12.997408    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:12.997512 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:12.997461    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs podName:ad9a4f7b-552f-469a-be1b-7ab6b4bd3740 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:16.997444572 +0000 UTC m=+10.034923875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs") pod "network-metrics-daemon-d8wzk" (UID: "ad9a4f7b-552f-469a-be1b-7ab6b4bd3740") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:13.198689 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:13.198085    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnw86\" (UniqueName: \"kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86\") pod \"network-check-target-wdkqq\" (UID: \"47bc453e-8ee1-479c-b138-4db88759552b\") " pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:13.198689 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:13.198244    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:31:13.198689 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:13.198268    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:31:13.198689 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:13.198282    2575 projected.go:196] Error preparing data for projected volume kube-api-access-bnw86 for pod openshift-network-diagnostics/network-check-target-wdkqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:13.198689 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:13.198341    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86 podName:47bc453e-8ee1-479c-b138-4db88759552b nodeName:}" failed. No retries permitted until 2026-07-02 21:31:17.198322097 +0000 UTC m=+10.235801404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bnw86" (UniqueName: "kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86") pod "network-check-target-wdkqq" (UID: "47bc453e-8ee1-479c-b138-4db88759552b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:13.519947 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:13.519912    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:13.520150 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:13.519963    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:13.520150 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:13.519913    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:13.520150 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:13.520063    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:13.520328 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:13.520157    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:13.520328 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:13.520241    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:15.519521 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:15.519486    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:15.520023 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:15.519490    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:15.520023 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:15.519663    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:15.520023 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:15.519702    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:15.520023 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:15.519836    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:15.520023 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:15.519923    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:17.030909 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:17.030870    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs\") pod \"network-metrics-daemon-d8wzk\" (UID: \"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740\") " pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:17.031439 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:17.030939    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret\") pod \"global-pull-secret-syncer-rc2fm\" (UID: \"6f667a42-f21d-49d0-8e40-4828f12e36db\") " pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:17.031439 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:17.031139    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:17.031439 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:17.031204    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret podName:6f667a42-f21d-49d0-8e40-4828f12e36db nodeName:}" failed. No retries permitted until 2026-07-02 21:31:25.031183334 +0000 UTC m=+18.068662637 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret") pod "global-pull-secret-syncer-rc2fm" (UID: "6f667a42-f21d-49d0-8e40-4828f12e36db") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:17.031732 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:17.031633    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:17.031732 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:17.031700    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs podName:ad9a4f7b-552f-469a-be1b-7ab6b4bd3740 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:25.031682355 +0000 UTC m=+18.069161646 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs") pod "network-metrics-daemon-d8wzk" (UID: "ad9a4f7b-552f-469a-be1b-7ab6b4bd3740") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:17.232957 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:17.232912    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnw86\" (UniqueName: \"kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86\") pod \"network-check-target-wdkqq\" (UID: \"47bc453e-8ee1-479c-b138-4db88759552b\") " pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:17.233172 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:17.233143    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:31:17.233172 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:17.233168    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:31:17.233314 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:17.233180    2575 projected.go:196] Error preparing data for projected volume kube-api-access-bnw86 for pod openshift-network-diagnostics/network-check-target-wdkqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:17.233314 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:17.233243    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86 podName:47bc453e-8ee1-479c-b138-4db88759552b nodeName:}" failed. No retries permitted until 2026-07-02 21:31:25.233227506 +0000 UTC m=+18.270706795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bnw86" (UniqueName: "kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86") pod "network-check-target-wdkqq" (UID: "47bc453e-8ee1-479c-b138-4db88759552b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:17.521364 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:17.520816    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:17.521364 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:17.520933    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:17.521364 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:17.521104    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:17.521364 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:17.521214    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:17.521704 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:17.521385    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:17.521704 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:17.521504    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:19.519347 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:19.519317    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:19.519828 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:19.519321    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:19.519828 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:19.519456    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:19.519828 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:19.519446    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:19.519828 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:19.519553    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:19.519828 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:19.519633    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:21.519551 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:21.519520    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:21.519948 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:21.519566    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:21.519948 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:21.519520    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:21.519948 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:21.519665    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:21.519948 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:21.519747    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:21.519948 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:21.519867    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:23.518885 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:23.518856    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:23.519300 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:23.518862    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:23.519300 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:23.518982    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:23.519300 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:23.519100    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:23.519300 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:23.519135    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:23.519300 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:23.519209    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:25.095826 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:25.095784    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret\") pod \"global-pull-secret-syncer-rc2fm\" (UID: \"6f667a42-f21d-49d0-8e40-4828f12e36db\") " pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:25.096347 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:25.095939    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:25.096347 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:25.095972    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs\") pod \"network-metrics-daemon-d8wzk\" (UID: \"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740\") " pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:25.096347 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:25.096000    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret podName:6f667a42-f21d-49d0-8e40-4828f12e36db nodeName:}" failed. No retries permitted until 2026-07-02 21:31:41.095981068 +0000 UTC m=+34.133460413 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret") pod "global-pull-secret-syncer-rc2fm" (UID: "6f667a42-f21d-49d0-8e40-4828f12e36db") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:25.096347 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:25.096073    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:25.096347 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:25.096123    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs podName:ad9a4f7b-552f-469a-be1b-7ab6b4bd3740 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:41.096107255 +0000 UTC m=+34.133586541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs") pod "network-metrics-daemon-d8wzk" (UID: "ad9a4f7b-552f-469a-be1b-7ab6b4bd3740") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:25.297290 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:25.297257    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnw86\" (UniqueName: \"kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86\") pod \"network-check-target-wdkqq\" (UID: \"47bc453e-8ee1-479c-b138-4db88759552b\") " pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:25.297454 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:25.297415    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:31:25.297454 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:25.297432    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:31:25.297454 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:25.297441    2575 projected.go:196] Error preparing data for projected volume kube-api-access-bnw86 for pod openshift-network-diagnostics/network-check-target-wdkqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:25.297623 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:25.297493    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86 podName:47bc453e-8ee1-479c-b138-4db88759552b nodeName:}" failed. No retries permitted until 2026-07-02 21:31:41.297477996 +0000 UTC m=+34.334957302 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bnw86" (UniqueName: "kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86") pod "network-check-target-wdkqq" (UID: "47bc453e-8ee1-479c-b138-4db88759552b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:25.519285 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:25.519210    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:25.519442 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:25.519332    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:25.519442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:25.519379    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:25.519442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:25.519413    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:25.519588 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:25.519473    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:25.519588 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:25.519561    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:27.522733 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:27.522701    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:27.523222 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:27.522741    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:27.523222 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:27.522828    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:27.523222 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:27.522835    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:27.523222 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:27.522917    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:27.523222 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:27.523054    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:29.521624 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:29.521596    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:29.521624 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:29.521625    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:29.521962 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:29.521644    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:29.521962 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:29.521756    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:29.521962 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:29.521856    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:29.521962 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:29.521922    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:30.590375 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:30.590157    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-110.ec2.internal" event={"ID":"e8b1f7912e9b285e8ec484595c325fef","Type":"ContainerStarted","Data":"6f918c4a699ac9dd5de26e7616e3fcf2a23e3eea5f8664d85ac11ea4ef47ef9a"}
Jul 02 21:31:30.596109 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:30.595929    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk" event={"ID":"9c21e6cc-4e98-4f64-a437-93e72a71d077","Type":"ContainerStarted","Data":"09d47e6c249c380c89271fcca1beedc29632abc096c1d82ae32420a440e4cf33"}
Jul 02 21:31:30.596109 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:30.596038    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk" event={"ID":"9c21e6cc-4e98-4f64-a437-93e72a71d077","Type":"ContainerStarted","Data":"d8e07363c7145d44b5a15b6cfad0b747c01ea86cb72261a645f8fce298476129"}
Jul 02 21:31:30.596109 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:30.596091    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk" event={"ID":"9c21e6cc-4e98-4f64-a437-93e72a71d077","Type":"ContainerStarted","Data":"d2de565e763d3ff37fe6231209b5b2b1262901e987e9d46d6d0d2643c11a2f9f"}
Jul 02 21:31:30.596336 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:30.596141    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk" event={"ID":"9c21e6cc-4e98-4f64-a437-93e72a71d077","Type":"ContainerStarted","Data":"0721eef895ad869f332cb16c8558854f298793d19efd1195b31df14d16456103"}
Jul 02 21:31:30.596336 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:30.596192    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk" event={"ID":"9c21e6cc-4e98-4f64-a437-93e72a71d077","Type":"ContainerStarted","Data":"09970ac8d6937d989f59d15f219c57e0513188e8719025ae05c48949960157d0"}
Jul 02 21:31:30.596336 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:30.596238    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk" event={"ID":"9c21e6cc-4e98-4f64-a437-93e72a71d077","Type":"ContainerStarted","Data":"dc935d4d1ac9b5cc426b882fcaecc4e418c703d78544fa824700496ab8930713"}
Jul 02 21:31:30.598447 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:30.598415    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-62ghs" event={"ID":"75bcfe41-4433-452a-aba5-b6b713f4445e","Type":"ContainerStarted","Data":"ff1c0c9b1e15eefefaebbe2eaaf3ecda660c6832d342904f7c0d4ebb60463054"}
Jul 02 21:31:30.599923 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:30.599892    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-httz2" event={"ID":"1168801f-a056-4f31-93d4-e2d3750c0035","Type":"ContainerStarted","Data":"a05248b452968fe4e43c402be576eacdc2df07127379025ab569ddeb53323c2c"}
Jul 02 21:31:30.612721 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:30.612659    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-110.ec2.internal" podStartSLOduration=21.61264648 podStartE2EDuration="21.61264648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:30.612116144 +0000 UTC m=+23.649595453" watchObservedRunningTime="2026-07-02 21:31:30.61264648 +0000 UTC m=+23.650125788"
Jul 02 21:31:30.650641 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:30.650590    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-62ghs" podStartSLOduration=2.705999693 podStartE2EDuration="22.650570864s" totalImagesPullingTime="19.944571171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:30.649913834 +0000 UTC m=+23.687393144" watchObservedRunningTime="2026-07-02 21:31:30.650570864 +0000 UTC m=+23.688050172"
Jul 02 21:31:30.651160 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:30.651105    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-httz2" podStartSLOduration=2.6560577260000002 podStartE2EDuration="22.65109579s" totalImagesPullingTime="19.995038064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:30.632416144 +0000 UTC m=+23.669895456" watchObservedRunningTime="2026-07-02 21:31:30.65109579 +0000 UTC m=+23.688575099"
Jul 02 21:31:31.519404 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:31.519216    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:31.519567 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:31.519222    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:31.519567 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:31.519492    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:31.519697 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:31.519237    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:31.519697 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:31.519579    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:31.519697 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:31.519651    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:31.603968 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:31.603933    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2n62r" event={"ID":"50903ab1-7af9-4033-a0c1-42c65587127d","Type":"ContainerStarted","Data":"6b1e9737bcb9273acb46af46b0b7f93f682a59052eb47227c13070f3fdc31636"}
Jul 02 21:31:31.605568 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:31.605536    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s64b9" event={"ID":"d35e7da7-8891-4293-8b43-aa77447be718","Type":"ContainerStarted","Data":"c02b468d02c30ab61b32136ca73089f7b21ffb76d46bada5cc437958822710a9"}
Jul 02 21:31:31.607120 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:31.607093    2575 generic.go:356] "Generic (PLEG): container finished" podID="848e4b5bbe9811d04fb38a58e384117f" containerID="dfe5b3b49acd6e14e9063fc405b1585c8d5eb19368cd1a3b7bdd3daf9ed6064b" exitCode=0
Jul 02 21:31:31.607249 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:31.607177    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal" event={"ID":"848e4b5bbe9811d04fb38a58e384117f","Type":"ContainerDied","Data":"dfe5b3b49acd6e14e9063fc405b1585c8d5eb19368cd1a3b7bdd3daf9ed6064b"}
Jul 02 21:31:31.608988 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:31.608963    2575 generic.go:356] "Generic (PLEG): container finished" podID="c022474e-db77-4cf8-940c-07c74e1568d2" containerID="9ac1bab087b77af07773c2f0fec30f9812421d95b63b347aa644aa3e66f061d0" exitCode=0
Jul 02 21:31:31.609120 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:31.609049    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cb65" event={"ID":"c022474e-db77-4cf8-940c-07c74e1568d2","Type":"ContainerDied","Data":"9ac1bab087b77af07773c2f0fec30f9812421d95b63b347aa644aa3e66f061d0"}
Jul 02 21:31:31.610647 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:31.610615    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tc79l" event={"ID":"8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef","Type":"ContainerStarted","Data":"a23f36204ee9b6314bbdaaa9811753c9d01e31d6faa90c7efe8e58f2a4e366bd"}
Jul 02 21:31:31.612206 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:31.612167    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-26tvv" event={"ID":"55c68fb2-3894-4e91-b536-b47a9ec3900c","Type":"ContainerStarted","Data":"c2a796817635e53969a0e985477b520c3cbc890366ac24924b1d349379fe2f6c"}
Jul 02 21:31:31.613789 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:31.613769    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f" event={"ID":"ef12de80-68c8-44ea-995a-dd348934a275","Type":"ContainerStarted","Data":"5f2d9e3005e17cad702100a032a4d987ca43f6cf9c628369bc4d97c1a084d3e9"}
Jul 02 21:31:31.620418 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:31.620385    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2n62r" podStartSLOduration=7.708934713 podStartE2EDuration="23.620373236s" totalImagesPullingTime="15.911438523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:31.620164885 +0000 UTC m=+24.657644192" watchObservedRunningTime="2026-07-02 21:31:31.620373236 +0000 UTC m=+24.657852543"
Jul 02 21:31:31.659052 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:31.658999    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-26tvv" podStartSLOduration=3.775720767 podStartE2EDuration="23.658982678s" totalImagesPullingTime="19.883261911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:31.642780712 +0000 UTC m=+24.680260022" watchObservedRunningTime="2026-07-02 21:31:31.658982678 +0000 UTC m=+24.696461987"
Jul 02 21:31:31.675865 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:31.675827    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s64b9" podStartSLOduration=3.752736862 podStartE2EDuration="23.675811513s" totalImagesPullingTime="19.923074651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:31.659294945 +0000 UTC m=+24.696774254" watchObservedRunningTime="2026-07-02 21:31:31.675811513 +0000 UTC m=+24.713290822"
Jul 02 21:31:31.714947 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:31.714909    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tc79l" podStartSLOduration=3.819960015 podStartE2EDuration="23.714892872s" totalImagesPullingTime="19.894932857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:31.69103607 +0000 UTC m=+24.728515368" watchObservedRunningTime="2026-07-02 21:31:31.714892872 +0000 UTC m=+24.752372181"
Jul 02 21:31:31.945838 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:31.945819    2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 21:31:32.425185 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:32.425063    2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T21:31:31.945837355Z","UUID":"69439c5d-7ad9-4490-82d1-3995979fea6c","Handler":null,"Name":"","Endpoint":""}
Jul 02 21:31:32.427018 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:32.426972    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 21:31:32.427154 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:32.427038    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 21:31:32.619061 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:32.618935    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f" event={"ID":"ef12de80-68c8-44ea-995a-dd348934a275","Type":"ContainerStarted","Data":"980d414e55d67ecb1f10e8a854fc33a564c662cc6786175dffeacf72ac7686d9"}
Jul 02 21:31:32.623067 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:32.623039    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk" event={"ID":"9c21e6cc-4e98-4f64-a437-93e72a71d077","Type":"ContainerStarted","Data":"d7fdf03f8bbddb6eba0f5950ced9e7497d3d6c70d32ed859ad1bfdbcaa5e80c4"}
Jul 02 21:31:32.625246 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:32.625211    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal" event={"ID":"848e4b5bbe9811d04fb38a58e384117f","Type":"ContainerStarted","Data":"d36d659847052544a4fffd551c64737ca5c4425c9582b750bc345c821fa0646b"}
Jul 02 21:31:32.642811 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:32.642759    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-110.ec2.internal" podStartSLOduration=23.64274185 podStartE2EDuration="23.64274185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:32.642054391 +0000 UTC m=+25.679533699" watchObservedRunningTime="2026-07-02 21:31:32.64274185 +0000 UTC m=+25.680221160"
Jul 02 21:31:33.522805 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:33.522775    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:33.522980 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:33.522816    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:33.522980 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:33.522776    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:33.522980 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:33.522893    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:33.522980 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:33.522972    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:33.523193 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:33.523108    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:33.630081 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:33.630044    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f" event={"ID":"ef12de80-68c8-44ea-995a-dd348934a275","Type":"ContainerStarted","Data":"d5d85957acf0bf75d94e17e47ba6788da1c0fa6719a4a340c9b5e00697564585"}
Jul 02 21:31:33.971258 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:33.971181    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2n62r"
Jul 02 21:31:33.971847 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:33.971824    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2n62r"
Jul 02 21:31:33.988214 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:33.988176    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rxm8f" podStartSLOduration=3.925273835 podStartE2EDuration="25.988161925s" totalImagesPullingTime="22.06288809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:33.647109509 +0000 UTC m=+26.684588846" watchObservedRunningTime="2026-07-02 21:31:33.988161925 +0000 UTC m=+27.025641229"
Jul 02 21:31:34.633132 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:34.632855    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2n62r"
Jul 02 21:31:34.633616 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:34.633599    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2n62r"
Jul 02 21:31:35.524132 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:35.524066    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:35.524132 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:35.524090    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:35.524132 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:35.524098    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:35.524443 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:35.524167    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:35.524443 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:35.524317    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:35.524443 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:35.524412    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:36.642119 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:36.641911    2575 generic.go:356] "Generic (PLEG): container finished" podID="c022474e-db77-4cf8-940c-07c74e1568d2" containerID="e09a9869e609c493acc4ddf064cecadc0588ad05e5fbae7a61f567df616cdeae" exitCode=0
Jul 02 21:31:36.642843 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:36.641994    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cb65" event={"ID":"c022474e-db77-4cf8-940c-07c74e1568d2","Type":"ContainerDied","Data":"e09a9869e609c493acc4ddf064cecadc0588ad05e5fbae7a61f567df616cdeae"}
Jul 02 21:31:36.646035 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:36.645996    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk" event={"ID":"9c21e6cc-4e98-4f64-a437-93e72a71d077","Type":"ContainerStarted","Data":"26a9581507d735c66c99190ee0a3fc5f4c2eecb3158d0848cccce3bb0452829d"}
Jul 02 21:31:36.646318 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:36.646292    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:36.646488 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:36.646350    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:36.661142 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:36.661123    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:36.689735 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:36.689693    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk" podStartSLOduration=8.629776409 podStartE2EDuration="28.689682098s" totalImagesPullingTime="20.059905689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:36.688296531 +0000 UTC m=+29.725775852" watchObservedRunningTime="2026-07-02 21:31:36.689682098 +0000 UTC m=+29.727161406"
Jul 02 21:31:37.520508 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:37.520478    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:37.520745 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:37.520582    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:37.520745 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:37.520596    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:37.520745 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:37.520684    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:37.520745 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:37.520740    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:37.520886 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:37.520811    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:37.648599 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:37.648576    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:37.662542 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:37.662522    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:31:37.841536 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:37.841475    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rc2fm"]
Jul 02 21:31:37.841638 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:37.841556    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:37.841638 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:37.841627    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:37.848383 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:37.848355    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wdkqq"]
Jul 02 21:31:37.848588 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:37.848441    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:37.848588 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:37.848528    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:37.848940 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:37.848918    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d8wzk"]
Jul 02 21:31:37.849034 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:37.848991    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:37.849122 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:37.849100    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:38.652685 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:38.652650    2575 generic.go:356] "Generic (PLEG): container finished" podID="c022474e-db77-4cf8-940c-07c74e1568d2" containerID="9dd796902971cef9019bc039077f3168ba9e2cef137545b686a001e81af10d39" exitCode=0
Jul 02 21:31:38.653207 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:38.652731    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cb65" event={"ID":"c022474e-db77-4cf8-940c-07c74e1568d2","Type":"ContainerDied","Data":"9dd796902971cef9019bc039077f3168ba9e2cef137545b686a001e81af10d39"}
Jul 02 21:31:39.519539 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:39.519410    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:39.519672 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:39.519409    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:39.519672 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:39.519567    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:39.519672 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:39.519538    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:39.519672 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:39.519650    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:39.519885 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:39.519747    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:39.656827 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:39.656674    2575 generic.go:356] "Generic (PLEG): container finished" podID="c022474e-db77-4cf8-940c-07c74e1568d2" containerID="21f0feae3ee2afe087720ab08efe00280b570a744ff39da8e140900e40f54c8a" exitCode=0
Jul 02 21:31:39.657139 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:39.656752    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cb65" event={"ID":"c022474e-db77-4cf8-940c-07c74e1568d2","Type":"ContainerDied","Data":"21f0feae3ee2afe087720ab08efe00280b570a744ff39da8e140900e40f54c8a"}
Jul 02 21:31:41.124211 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:41.124172    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret\") pod \"global-pull-secret-syncer-rc2fm\" (UID: \"6f667a42-f21d-49d0-8e40-4828f12e36db\") " pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:41.124610 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:41.124267    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs\") pod \"network-metrics-daemon-d8wzk\" (UID: \"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740\") " pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:41.124610 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:41.124334    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:41.124610 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:41.124362    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:41.124610 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:41.124410    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret podName:6f667a42-f21d-49d0-8e40-4828f12e36db nodeName:}" failed. No retries permitted until 2026-07-02 21:32:13.124389982 +0000 UTC m=+66.161869272 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret") pod "global-pull-secret-syncer-rc2fm" (UID: "6f667a42-f21d-49d0-8e40-4828f12e36db") : object "kube-system"/"original-pull-secret" not registered
Jul 02 21:31:41.124610 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:41.124431    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs podName:ad9a4f7b-552f-469a-be1b-7ab6b4bd3740 nodeName:}" failed. No retries permitted until 2026-07-02 21:32:13.12442216 +0000 UTC m=+66.161901451 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs") pod "network-metrics-daemon-d8wzk" (UID: "ad9a4f7b-552f-469a-be1b-7ab6b4bd3740") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 21:31:41.325670 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:41.325581    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnw86\" (UniqueName: \"kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86\") pod \"network-check-target-wdkqq\" (UID: \"47bc453e-8ee1-479c-b138-4db88759552b\") " pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:41.325813 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:41.325760    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 21:31:41.325813 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:41.325780    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 21:31:41.325813 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:41.325791    2575 projected.go:196] Error preparing data for projected volume kube-api-access-bnw86 for pod openshift-network-diagnostics/network-check-target-wdkqq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:41.325970 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:41.325843    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86 podName:47bc453e-8ee1-479c-b138-4db88759552b nodeName:}" failed. No retries permitted until 2026-07-02 21:32:13.325828619 +0000 UTC m=+66.363307906 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bnw86" (UniqueName: "kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86") pod "network-check-target-wdkqq" (UID: "47bc453e-8ee1-479c-b138-4db88759552b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 21:31:41.519755 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:41.519712    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:41.519755 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:41.519747    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:41.519998 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:41.519712    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:41.519998 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:41.519862    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:31:41.519998 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:41.519988    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wdkqq" podUID="47bc453e-8ee1-479c-b138-4db88759552b"
Jul 02 21:31:41.520155 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:41.520099    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rc2fm" podUID="6f667a42-f21d-49d0-8e40-4828f12e36db"
Jul 02 21:31:42.274205 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.274177    2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-110.ec2.internal" event="NodeReady"
Jul 02 21:31:42.274693 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.274317    2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 21:31:42.314922 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.313667    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bf65d99fd-87ctd"]
Jul 02 21:31:42.318444 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.318420    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.321755 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.321733    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 21:31:42.321863 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.321776    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 21:31:42.321863 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.321784    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 21:31:42.322168 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.322149    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b4gbg\""
Jul 02 21:31:42.327247 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.327229    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hmsc8"]
Jul 02 21:31:42.328375 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.328355    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 21:31:42.330112 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.330095    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:31:42.330556 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.330536    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bf65d99fd-87ctd"]
Jul 02 21:31:42.331831 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.331804    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-trusted-ca\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.331925 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.331838    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4rj5\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-kube-api-access-h4rj5\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.331925 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.331872    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxdpv\" (UniqueName: \"kubernetes.io/projected/4e8eaa68-900f-4a98-8499-111bd1451076-kube-api-access-gxdpv\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:31:42.331925 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.331900    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-certificates\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.332107 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.331976    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-ca-trust-extracted\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.332107 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.332047    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e8eaa68-900f-4a98-8499-111bd1451076-tmp-dir\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:31:42.332243 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.332110    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-installation-pull-secrets\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.332243 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.332212    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e8eaa68-900f-4a98-8499-111bd1451076-config-volume\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:31:42.332363 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.332265    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:31:42.332363 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.332299    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-image-registry-private-configuration\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.332363 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.332323    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.332363 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.332344    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-bound-sa-token\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.333035 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.332913    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-knz6t\""
Jul 02 21:31:42.333035 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.332959    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 21:31:42.333035 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.333031    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hlcjm"]
Jul 02 21:31:42.333210 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.333052    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 21:31:42.335897 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.335879    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hlcjm"
Jul 02 21:31:42.337866 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.337847    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmsc8"]
Jul 02 21:31:42.339366 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.339243    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 21:31:42.339366 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.339254    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 21:31:42.339527 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.339460    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gnsm2\""
Jul 02 21:31:42.339616 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.339588    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 21:31:42.347125 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.347105    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hlcjm"]
Jul 02 21:31:42.433476 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.433411    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.433476 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.433442    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-bound-sa-token\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.433476 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.433463    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-trusted-ca\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.433752 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.433481    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4rj5\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-kube-api-access-h4rj5\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.433752 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.433512    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b58149aa-a11a-4b62-b8d2-54492d81dda2-cert\") pod \"ingress-canary-hlcjm\" (UID: \"b58149aa-a11a-4b62-b8d2-54492d81dda2\") " pod="openshift-ingress-canary/ingress-canary-hlcjm"
Jul 02 21:31:42.433752 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:42.433590    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 21:31:42.433752 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:42.433608    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf65d99fd-87ctd: secret "image-registry-tls" not found
Jul 02 21:31:42.433752 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.433636    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxdpv\" (UniqueName: \"kubernetes.io/projected/4e8eaa68-900f-4a98-8499-111bd1451076-kube-api-access-gxdpv\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:31:42.433752 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:42.433677    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls podName:6f567d5e-c6f3-4a65-aef0-ac6bd0250922 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:42.933656258 +0000 UTC m=+35.971135555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls") pod "image-registry-5bf65d99fd-87ctd" (UID: "6f567d5e-c6f3-4a65-aef0-ac6bd0250922") : secret "image-registry-tls" not found
Jul 02 21:31:42.433752 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.433711    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-certificates\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.434122 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.433760    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-ca-trust-extracted\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.434122 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.433807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e8eaa68-900f-4a98-8499-111bd1451076-tmp-dir\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:31:42.434122 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.433834    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-installation-pull-secrets\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.434122 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.433864    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e8eaa68-900f-4a98-8499-111bd1451076-config-volume\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:31:42.434122 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.433909    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:31:42.434122 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.433934    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-image-registry-private-configuration\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.434122 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:42.434000    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:31:42.434122 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:42.434056    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls podName:4e8eaa68-900f-4a98-8499-111bd1451076 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:42.934044926 +0000 UTC m=+35.971524224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls") pod "dns-default-hmsc8" (UID: "4e8eaa68-900f-4a98-8499-111bd1451076") : secret "dns-default-metrics-tls" not found
Jul 02 21:31:42.434567 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.434150    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-ca-trust-extracted\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.434567 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.434156    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e8eaa68-900f-4a98-8499-111bd1451076-tmp-dir\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:31:42.434567 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.434196    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gffbr\" (UniqueName: \"kubernetes.io/projected/b58149aa-a11a-4b62-b8d2-54492d81dda2-kube-api-access-gffbr\") pod \"ingress-canary-hlcjm\" (UID: \"b58149aa-a11a-4b62-b8d2-54492d81dda2\") " pod="openshift-ingress-canary/ingress-canary-hlcjm"
Jul 02 21:31:42.434567 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.434324    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-certificates\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.434567 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.434474    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-trusted-ca\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.434567 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.434496    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e8eaa68-900f-4a98-8499-111bd1451076-config-volume\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:31:42.438427 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.438407    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-installation-pull-secrets\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.438544 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.438423    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-image-registry-private-configuration\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.442739 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.442677    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4rj5\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-kube-api-access-h4rj5\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.445857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.445834    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-bound-sa-token\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.446307 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.446288    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxdpv\" (UniqueName: \"kubernetes.io/projected/4e8eaa68-900f-4a98-8499-111bd1451076-kube-api-access-gxdpv\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:31:42.534720 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.534686    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b58149aa-a11a-4b62-b8d2-54492d81dda2-cert\") pod \"ingress-canary-hlcjm\" (UID: \"b58149aa-a11a-4b62-b8d2-54492d81dda2\") " pod="openshift-ingress-canary/ingress-canary-hlcjm"
Jul 02 21:31:42.534870 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.534798    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gffbr\" (UniqueName: \"kubernetes.io/projected/b58149aa-a11a-4b62-b8d2-54492d81dda2-kube-api-access-gffbr\") pod \"ingress-canary-hlcjm\" (UID: \"b58149aa-a11a-4b62-b8d2-54492d81dda2\") " pod="openshift-ingress-canary/ingress-canary-hlcjm"
Jul 02 21:31:42.537302 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.537278    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b58149aa-a11a-4b62-b8d2-54492d81dda2-cert\") pod \"ingress-canary-hlcjm\" (UID: \"b58149aa-a11a-4b62-b8d2-54492d81dda2\") " pod="openshift-ingress-canary/ingress-canary-hlcjm"
Jul 02 21:31:42.543550 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.543527    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gffbr\" (UniqueName: \"kubernetes.io/projected/b58149aa-a11a-4b62-b8d2-54492d81dda2-kube-api-access-gffbr\") pod \"ingress-canary-hlcjm\" (UID: \"b58149aa-a11a-4b62-b8d2-54492d81dda2\") " pod="openshift-ingress-canary/ingress-canary-hlcjm"
Jul 02 21:31:42.647975 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.647945    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hlcjm"
Jul 02 21:31:42.748342 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.748273    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:31:42.838340 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.838310    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:31:42.938346 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.938238    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:31:42.938346 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.938289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:42.938346 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:42.938350    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:31:42.938612 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:42.938392    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 21:31:42.938612 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:42.938407    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls podName:4e8eaa68-900f-4a98-8499-111bd1451076 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:43.938391865 +0000 UTC m=+36.975871157 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls") pod "dns-default-hmsc8" (UID: "4e8eaa68-900f-4a98-8499-111bd1451076") : secret "dns-default-metrics-tls" not found
Jul 02 21:31:42.938612 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:42.938411    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf65d99fd-87ctd: secret "image-registry-tls" not found
Jul 02 21:31:42.938612 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:42.938475    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls podName:6f567d5e-c6f3-4a65-aef0-ac6bd0250922 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:43.938462847 +0000 UTC m=+36.975942137 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls") pod "image-registry-5bf65d99fd-87ctd" (UID: "6f567d5e-c6f3-4a65-aef0-ac6bd0250922") : secret "image-registry-tls" not found
Jul 02 21:31:42.939289 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:42.939262    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:31:43.519639 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:43.519407    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:31:43.519639 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:43.519616    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:31:43.520873 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:43.520263    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:31:43.522470 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:43.522446    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 21:31:43.522549 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:43.522451    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 21:31:43.524235 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:43.524062    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 21:31:43.524365 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:43.524310    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7x7kj\""
Jul 02 21:31:43.524533 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:43.524482    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sm2np\""
Jul 02 21:31:43.525183 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:43.524677    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 21:31:43.575706 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:43.575553    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hlcjm"]
Jul 02 21:31:43.578954 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:31:43.578930    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58149aa_a11a_4b62_b8d2_54492d81dda2.slice/crio-f4e3a4007386d86ec08075533bf9fcfdaf647e59be15419492f5d0e35847756c WatchSource:0}: Error finding container f4e3a4007386d86ec08075533bf9fcfdaf647e59be15419492f5d0e35847756c: Status 404 returned error can't find the container with id f4e3a4007386d86ec08075533bf9fcfdaf647e59be15419492f5d0e35847756c
Jul 02 21:31:43.668890 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:43.668856    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cb65" event={"ID":"c022474e-db77-4cf8-940c-07c74e1568d2","Type":"ContainerStarted","Data":"d01fe94ad669443dca8d81bb5ad4f0ec38e501ad832c957ef77a2dc28a920da0"}
Jul 02 21:31:43.670058 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:43.670035    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hlcjm" event={"ID":"b58149aa-a11a-4b62-b8d2-54492d81dda2","Type":"ContainerStarted","Data":"f4e3a4007386d86ec08075533bf9fcfdaf647e59be15419492f5d0e35847756c"}
Jul 02 21:31:43.945098 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:43.945059    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:43.945236 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:43.945154    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:31:43.945236 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:43.945195    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 21:31:43.945236 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:43.945210    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf65d99fd-87ctd: secret "image-registry-tls" not found
Jul 02 21:31:43.945331 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:43.945240    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:31:43.945331 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:43.945261    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls podName:6f567d5e-c6f3-4a65-aef0-ac6bd0250922 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:45.945246509 +0000 UTC m=+38.982725795 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls") pod "image-registry-5bf65d99fd-87ctd" (UID: "6f567d5e-c6f3-4a65-aef0-ac6bd0250922") : secret "image-registry-tls" not found
Jul 02 21:31:43.945331 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:43.945278    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls podName:4e8eaa68-900f-4a98-8499-111bd1451076 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:45.945267756 +0000 UTC m=+38.982747041 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls") pod "dns-default-hmsc8" (UID: "4e8eaa68-900f-4a98-8499-111bd1451076") : secret "dns-default-metrics-tls" not found
Jul 02 21:31:44.582763 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:44.582727    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:31:44.643909 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:44.643879    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:31:44.676100 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:44.676070    2575 generic.go:356] "Generic (PLEG): container finished" podID="c022474e-db77-4cf8-940c-07c74e1568d2" containerID="d01fe94ad669443dca8d81bb5ad4f0ec38e501ad832c957ef77a2dc28a920da0" exitCode=0
Jul 02 21:31:44.676232 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:44.676131    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cb65" event={"ID":"c022474e-db77-4cf8-940c-07c74e1568d2","Type":"ContainerDied","Data":"d01fe94ad669443dca8d81bb5ad4f0ec38e501ad832c957ef77a2dc28a920da0"}
Jul 02 21:31:45.377975 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:45.377937    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:31:45.682047 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:45.681951    2575 generic.go:356] "Generic (PLEG): container finished" podID="c022474e-db77-4cf8-940c-07c74e1568d2" containerID="cf3811dc4767185ede2da803a9505279ecda3e7feddda5aa875c763a53bf5dbb" exitCode=0
Jul 02 21:31:45.682047 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:45.682027    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cb65" event={"ID":"c022474e-db77-4cf8-940c-07c74e1568d2","Type":"ContainerDied","Data":"cf3811dc4767185ede2da803a9505279ecda3e7feddda5aa875c763a53bf5dbb"}
Jul 02 21:31:45.961630 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:45.961538    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:31:45.961630 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:45.961590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:45.961852 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:45.961703    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:31:45.961852 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:45.961725    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 21:31:45.961852 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:45.961746    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf65d99fd-87ctd: secret "image-registry-tls" not found
Jul 02 21:31:45.961852 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:45.961779    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls podName:4e8eaa68-900f-4a98-8499-111bd1451076 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:49.961759717 +0000 UTC m=+42.999239013 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls") pod "dns-default-hmsc8" (UID: "4e8eaa68-900f-4a98-8499-111bd1451076") : secret "dns-default-metrics-tls" not found
Jul 02 21:31:45.961852 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:45.961799    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls podName:6f567d5e-c6f3-4a65-aef0-ac6bd0250922 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:49.961789111 +0000 UTC m=+42.999268397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls") pod "image-registry-5bf65d99fd-87ctd" (UID: "6f567d5e-c6f3-4a65-aef0-ac6bd0250922") : secret "image-registry-tls" not found
Jul 02 21:31:46.687282 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:46.687209    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9cb65" event={"ID":"c022474e-db77-4cf8-940c-07c74e1568d2","Type":"ContainerStarted","Data":"d3f7cdb06003b53a246b639984caf3b6fcb68468a6ad0ca1f037beeb5be9231d"}
Jul 02 21:31:46.688678 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:46.688655    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hlcjm" event={"ID":"b58149aa-a11a-4b62-b8d2-54492d81dda2","Type":"ContainerStarted","Data":"fb06a52bec9797b90eb50c7696b2e0dd09b6e3e7b7ae7b7f2e661073181a0a3c"}
Jul 02 21:31:46.712910 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:46.712870    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9cb65" podStartSLOduration=9.060417991 podStartE2EDuration="38.71285784s" totalImagesPullingTime="29.652439849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:46.712270977 +0000 UTC m=+39.749750284" watchObservedRunningTime="2026-07-02 21:31:46.71285784 +0000 UTC m=+39.750337145"
Jul 02 21:31:46.729964 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:46.729926    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hlcjm" podStartSLOduration=2.10559337 podStartE2EDuration="4.729911677s" totalImagesPullingTime="2.624318307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:31:46.728990199 +0000 UTC m=+39.766469506" watchObservedRunningTime="2026-07-02 21:31:46.729911677 +0000 UTC m=+39.767390985"
Jul 02 21:31:46.837869 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:46.837724    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:31:46.935292 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:46.935262    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:31:47.349526 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:47.349497    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:31:47.449734 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:47.449707    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:31:48.274207 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:48.274176    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:31:48.375859 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:48.375833    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:31:49.992325 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:49.992291    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:31:49.992325 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:49.992328    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:49.992762 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:49.992445    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 21:31:49.992762 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:49.992455    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf65d99fd-87ctd: secret "image-registry-tls" not found
Jul 02 21:31:49.992762 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:49.992454    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:31:49.992762 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:49.992499    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls podName:6f567d5e-c6f3-4a65-aef0-ac6bd0250922 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:57.992487545 +0000 UTC m=+51.029966831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls") pod "image-registry-5bf65d99fd-87ctd" (UID: "6f567d5e-c6f3-4a65-aef0-ac6bd0250922") : secret "image-registry-tls" not found
Jul 02 21:31:49.992762 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:49.992512    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls podName:4e8eaa68-900f-4a98-8499-111bd1451076 nodeName:}" failed. No retries permitted until 2026-07-02 21:31:57.992506235 +0000 UTC m=+51.029985522 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls") pod "dns-default-hmsc8" (UID: "4e8eaa68-900f-4a98-8499-111bd1451076") : secret "dns-default-metrics-tls" not found
Jul 02 21:31:58.048304 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:58.048269    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:31:58.048671 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:31:58.048308    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:31:58.048671 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:58.048423    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:31:58.048671 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:58.048482    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls podName:4e8eaa68-900f-4a98-8499-111bd1451076 nodeName:}" failed. No retries permitted until 2026-07-02 21:32:14.048468133 +0000 UTC m=+67.085947429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls") pod "dns-default-hmsc8" (UID: "4e8eaa68-900f-4a98-8499-111bd1451076") : secret "dns-default-metrics-tls" not found
Jul 02 21:31:58.048671 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:58.048426    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 21:31:58.048671 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:58.048525    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf65d99fd-87ctd: secret "image-registry-tls" not found
Jul 02 21:31:58.048671 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:31:58.048588    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls podName:6f567d5e-c6f3-4a65-aef0-ac6bd0250922 nodeName:}" failed. No retries permitted until 2026-07-02 21:32:14.048574888 +0000 UTC m=+67.086054188 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls") pod "image-registry-5bf65d99fd-87ctd" (UID: "6f567d5e-c6f3-4a65-aef0-ac6bd0250922") : secret "image-registry-tls" not found
Jul 02 21:32:06.568794 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:06.568761    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:32:06.636529 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:06.636490    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:32:09.667158 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:09.667132    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-89jhk"
Jul 02 21:32:09.821144 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:09.821115    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:32:09.881092 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:09.881049    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:32:10.665756 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:10.665714    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:32:10.763873 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:10.763847    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:32:13.148146 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:13.148111    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs\") pod \"network-metrics-daemon-d8wzk\" (UID: \"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740\") " pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:32:13.148500 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:13.148152    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret\") pod \"global-pull-secret-syncer-rc2fm\" (UID: \"6f667a42-f21d-49d0-8e40-4828f12e36db\") " pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:32:13.151299 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:13.151281    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 21:32:13.151299 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:13.151296    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 21:32:13.158653 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:32:13.158637    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 21:32:13.158707 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:32:13.158696    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs podName:ad9a4f7b-552f-469a-be1b-7ab6b4bd3740 nodeName:}" failed. No retries permitted until 2026-07-02 21:33:17.158682197 +0000 UTC m=+130.196161483 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs") pod "network-metrics-daemon-d8wzk" (UID: "ad9a4f7b-552f-469a-be1b-7ab6b4bd3740") : secret "metrics-daemon-secret" not found
Jul 02 21:32:13.162227 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:13.162211    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6f667a42-f21d-49d0-8e40-4828f12e36db-original-pull-secret\") pod \"global-pull-secret-syncer-rc2fm\" (UID: \"6f667a42-f21d-49d0-8e40-4828f12e36db\") " pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:32:13.257983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:13.257952    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rc2fm"
Jul 02 21:32:13.349518 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:13.349493    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnw86\" (UniqueName: \"kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86\") pod \"network-check-target-wdkqq\" (UID: \"47bc453e-8ee1-479c-b138-4db88759552b\") " pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:32:13.352634 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:13.352616    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 21:32:13.362783 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:13.362765    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 21:32:13.373135 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:13.373116    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnw86\" (UniqueName: \"kubernetes.io/projected/47bc453e-8ee1-479c-b138-4db88759552b-kube-api-access-bnw86\") pod \"network-check-target-wdkqq\" (UID: \"47bc453e-8ee1-479c-b138-4db88759552b\") " pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:32:13.377917 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:13.377893    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rc2fm"]
Jul 02 21:32:13.380425 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:32:13.380406    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f667a42_f21d_49d0_8e40_4828f12e36db.slice/crio-9b77dea219f8b07d0b9470d58273e4028ef8bc8002b5215d03f990035e3b3e69 WatchSource:0}: Error finding container 9b77dea219f8b07d0b9470d58273e4028ef8bc8002b5215d03f990035e3b3e69: Status 404 returned error can't find the container with id 9b77dea219f8b07d0b9470d58273e4028ef8bc8002b5215d03f990035e3b3e69
Jul 02 21:32:13.554099 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:13.554033    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sm2np\""
Jul 02 21:32:13.562273 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:13.562256    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:32:13.674969 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:13.674939    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wdkqq"]
Jul 02 21:32:13.679623 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:32:13.679596    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47bc453e_8ee1_479c_b138_4db88759552b.slice/crio-6c66037653b3ab5186ea4cb8ac8af52c32d4b20102074305759118d61b4b3faf WatchSource:0}: Error finding container 6c66037653b3ab5186ea4cb8ac8af52c32d4b20102074305759118d61b4b3faf: Status 404 returned error can't find the container with id 6c66037653b3ab5186ea4cb8ac8af52c32d4b20102074305759118d61b4b3faf
Jul 02 21:32:13.747046 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:13.747019    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wdkqq" event={"ID":"47bc453e-8ee1-479c-b138-4db88759552b","Type":"ContainerStarted","Data":"6c66037653b3ab5186ea4cb8ac8af52c32d4b20102074305759118d61b4b3faf"}
Jul 02 21:32:13.748068 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:13.748035    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rc2fm" event={"ID":"6f667a42-f21d-49d0-8e40-4828f12e36db","Type":"ContainerStarted","Data":"9b77dea219f8b07d0b9470d58273e4028ef8bc8002b5215d03f990035e3b3e69"}
Jul 02 21:32:14.056388 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:14.056351    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:32:14.056647 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:14.056405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:32:14.056647 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:32:14.056487    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:32:14.056647 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:32:14.056552    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 21:32:14.056647 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:32:14.056569    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf65d99fd-87ctd: secret "image-registry-tls" not found
Jul 02 21:32:14.056647 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:32:14.056572    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls podName:4e8eaa68-900f-4a98-8499-111bd1451076 nodeName:}" failed. No retries permitted until 2026-07-02 21:32:46.056551622 +0000 UTC m=+99.094030922 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls") pod "dns-default-hmsc8" (UID: "4e8eaa68-900f-4a98-8499-111bd1451076") : secret "dns-default-metrics-tls" not found
Jul 02 21:32:14.056647 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:32:14.056623    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls podName:6f567d5e-c6f3-4a65-aef0-ac6bd0250922 nodeName:}" failed. No retries permitted until 2026-07-02 21:32:46.05660797 +0000 UTC m=+99.094087265 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls") pod "image-registry-5bf65d99fd-87ctd" (UID: "6f567d5e-c6f3-4a65-aef0-ac6bd0250922") : secret "image-registry-tls" not found
Jul 02 21:32:18.762334 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:18.762296    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wdkqq" event={"ID":"47bc453e-8ee1-479c-b138-4db88759552b","Type":"ContainerStarted","Data":"86bf2f76e1cd389ad80484b4a96d0f81d8dbd925b7a85550e6d696629a6ae91a"}
Jul 02 21:32:18.762721 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:18.762390    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:32:18.763662 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:18.763639    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rc2fm" event={"ID":"6f667a42-f21d-49d0-8e40-4828f12e36db","Type":"ContainerStarted","Data":"6a1c8dea62683cc42ff95969f257402cb0f36f6717ba3df4f0fe732724c7275c"}
Jul 02 21:32:18.779198 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:18.779143    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wdkqq" podStartSLOduration=66.247991915 podStartE2EDuration="1m10.779130207s" totalImagesPullingTime="4.531138292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:32:18.778394293 +0000 UTC m=+71.815873601" watchObservedRunningTime="2026-07-02 21:32:18.779130207 +0000 UTC m=+71.816609515"
Jul 02 21:32:18.797783 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:18.797745    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rc2fm" podStartSLOduration=65.963464395 podStartE2EDuration="1m10.797733405s" totalImagesPullingTime="4.83426901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:32:18.797641405 +0000 UTC m=+71.835120716" watchObservedRunningTime="2026-07-02 21:32:18.797733405 +0000 UTC m=+71.835212712"
Jul 02 21:32:21.644896 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:21.644860    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:32:31.305706 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:31.305593    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv"]
Jul 02 21:32:31.307893 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:31.307877    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv"
Jul 02 21:32:31.311786 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:31.311760    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 21:32:31.311786 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:31.311759    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 21:32:31.311960 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:31.311800    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7l88s\""
Jul 02 21:32:31.311960 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:31.311839    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 21:32:31.311960 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:31.311762    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 02 21:32:31.319367 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:31.319346    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv"]
Jul 02 21:32:31.374539 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:31.374512    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9jn8\" (UniqueName: \"kubernetes.io/projected/a62f3ef4-cca2-4123-ad0c-606b623112cd-kube-api-access-v9jn8\") pod \"managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv\" (UID: \"a62f3ef4-cca2-4123-ad0c-606b623112cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv"
Jul 02 21:32:31.374657 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:31.374588    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a62f3ef4-cca2-4123-ad0c-606b623112cd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv\" (UID: \"a62f3ef4-cca2-4123-ad0c-606b623112cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv"
Jul 02 21:32:31.474976 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:31.474949    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9jn8\" (UniqueName: \"kubernetes.io/projected/a62f3ef4-cca2-4123-ad0c-606b623112cd-kube-api-access-v9jn8\") pod \"managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv\" (UID: \"a62f3ef4-cca2-4123-ad0c-606b623112cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv"
Jul 02 21:32:31.475102 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:31.475025    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a62f3ef4-cca2-4123-ad0c-606b623112cd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv\" (UID: \"a62f3ef4-cca2-4123-ad0c-606b623112cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv"
Jul 02 21:32:31.477329 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:31.477309    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a62f3ef4-cca2-4123-ad0c-606b623112cd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv\" (UID: \"a62f3ef4-cca2-4123-ad0c-606b623112cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv"
Jul 02 21:32:31.484321 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:31.484296    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9jn8\" (UniqueName: \"kubernetes.io/projected/a62f3ef4-cca2-4123-ad0c-606b623112cd-kube-api-access-v9jn8\") pod \"managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv\" (UID: \"a62f3ef4-cca2-4123-ad0c-606b623112cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv"
Jul 02 21:32:31.627573 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:31.627554    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv"
Jul 02 21:32:31.740157 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:31.740120    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv"]
Jul 02 21:32:31.742930 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:32:31.742902    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda62f3ef4_cca2_4123_ad0c_606b623112cd.slice/crio-4a3a71dd8f2ff8c68c3982a6f92af400cb26fc882111132117b2bf0585ef4497 WatchSource:0}: Error finding container 4a3a71dd8f2ff8c68c3982a6f92af400cb26fc882111132117b2bf0585ef4497: Status 404 returned error can't find the container with id 4a3a71dd8f2ff8c68c3982a6f92af400cb26fc882111132117b2bf0585ef4497
Jul 02 21:32:31.799237 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:31.799208    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv" event={"ID":"a62f3ef4-cca2-4123-ad0c-606b623112cd","Type":"ContainerStarted","Data":"4a3a71dd8f2ff8c68c3982a6f92af400cb26fc882111132117b2bf0585ef4497"}
Jul 02 21:32:43.528548 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:43.528512    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:32:43.582984 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:43.582964    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:32:46.070790 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:46.070755    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:32:46.070790 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:46.070796    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:32:46.071219 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:32:46.070907    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:32:46.071219 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:32:46.070965    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls podName:4e8eaa68-900f-4a98-8499-111bd1451076 nodeName:}" failed. No retries permitted until 2026-07-02 21:33:50.070950082 +0000 UTC m=+163.108429381 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls") pod "dns-default-hmsc8" (UID: "4e8eaa68-900f-4a98-8499-111bd1451076") : secret "dns-default-metrics-tls" not found
Jul 02 21:32:46.071219 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:32:46.070910    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 21:32:46.071219 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:32:46.071019    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf65d99fd-87ctd: secret "image-registry-tls" not found
Jul 02 21:32:46.071219 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:32:46.071086    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls podName:6f567d5e-c6f3-4a65-aef0-ac6bd0250922 nodeName:}" failed. No retries permitted until 2026-07-02 21:33:50.071073257 +0000 UTC m=+163.108552546 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls") pod "image-registry-5bf65d99fd-87ctd" (UID: "6f567d5e-c6f3-4a65-aef0-ac6bd0250922") : secret "image-registry-tls" not found
Jul 02 21:32:49.769849 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:49.769816    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wdkqq"
Jul 02 21:32:52.853173 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:52.853131    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv" event={"ID":"a62f3ef4-cca2-4123-ad0c-606b623112cd","Type":"ContainerStarted","Data":"30cda3eb85526fee1b394f8100e0f714c6a977805177e7c45d01858fb9162e3b"}
Jul 02 21:32:52.869349 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:32:52.869305    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv" podStartSLOduration=1.613936566 podStartE2EDuration="21.869292141s" totalImagesPullingTime="20.255355575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:32:52.868921957 +0000 UTC m=+105.906401266" watchObservedRunningTime="2026-07-02 21:32:52.869292141 +0000 UTC m=+105.906771448"
Jul 02 21:33:17.178038 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:33:17.177989    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs\") pod \"network-metrics-daemon-d8wzk\" (UID: \"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740\") " pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:33:17.178497 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:33:17.178138    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 21:33:17.178497 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:33:17.178216    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs podName:ad9a4f7b-552f-469a-be1b-7ab6b4bd3740 nodeName:}" failed. No retries permitted until 2026-07-02 21:35:19.178199442 +0000 UTC m=+252.215678728 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs") pod "network-metrics-daemon-d8wzk" (UID: "ad9a4f7b-552f-469a-be1b-7ab6b4bd3740") : secret "metrics-daemon-secret" not found
Jul 02 21:33:45.330098 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:33:45.330058    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd" podUID="6f567d5e-c6f3-4a65-aef0-ac6bd0250922"
Jul 02 21:33:45.342154 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:33:45.342126    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hmsc8" podUID="4e8eaa68-900f-4a98-8499-111bd1451076"
Jul 02 21:33:45.980945 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:33:45.980919    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:33:45.981126 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:33:45.980919    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:33:46.544706 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:33:46.544662    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:33:50.082788 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:33:50.082747    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:33:50.083180 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:33:50.082809    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls\") pod \"image-registry-5bf65d99fd-87ctd\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") " pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:33:50.083180 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:33:50.082890    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 21:33:50.083180 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:33:50.082910    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 21:33:50.083180 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:33:50.082920    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bf65d99fd-87ctd: secret "image-registry-tls" not found
Jul 02 21:33:50.083180 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:33:50.082960    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls podName:4e8eaa68-900f-4a98-8499-111bd1451076 nodeName:}" failed. No retries permitted until 2026-07-02 21:35:52.082944338 +0000 UTC m=+285.120423624 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls") pod "dns-default-hmsc8" (UID: "4e8eaa68-900f-4a98-8499-111bd1451076") : secret "dns-default-metrics-tls" not found
Jul 02 21:33:50.083180 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:33:50.082974    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls podName:6f567d5e-c6f3-4a65-aef0-ac6bd0250922 nodeName:}" failed. No retries permitted until 2026-07-02 21:35:52.08296805 +0000 UTC m=+285.120447337 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls") pod "image-registry-5bf65d99fd-87ctd" (UID: "6f567d5e-c6f3-4a65-aef0-ac6bd0250922") : secret "image-registry-tls" not found
Jul 02 21:33:59.519260 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:33:59.519168    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:34:53.137840 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:34:53.137808    2575 generic.go:356] "Generic (PLEG): container finished" podID="a62f3ef4-cca2-4123-ad0c-606b623112cd" containerID="30cda3eb85526fee1b394f8100e0f714c6a977805177e7c45d01858fb9162e3b" exitCode=255
Jul 02 21:34:53.138281 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:34:53.137845    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv" event={"ID":"a62f3ef4-cca2-4123-ad0c-606b623112cd","Type":"ContainerDied","Data":"30cda3eb85526fee1b394f8100e0f714c6a977805177e7c45d01858fb9162e3b"}
Jul 02 21:34:53.143095 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:34:53.143075    2575 scope.go:117] "RemoveContainer" containerID="30cda3eb85526fee1b394f8100e0f714c6a977805177e7c45d01858fb9162e3b"
Jul 02 21:34:54.141571 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:34:54.141536    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddb5bb87b-l4rpv" event={"ID":"a62f3ef4-cca2-4123-ad0c-606b623112cd","Type":"ContainerStarted","Data":"2575ed926489f1511218643d9bd2e68318764688b6ff97aaba0ab5ffac731b88"}
Jul 02 21:35:19.178961 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.178917    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs\") pod \"network-metrics-daemon-d8wzk\" (UID: \"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740\") " pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:35:19.179448 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:19.179082    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 02 21:35:19.179448 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:19.179147    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs podName:ad9a4f7b-552f-469a-be1b-7ab6b4bd3740 nodeName:}" failed. No retries permitted until 2026-07-02 21:37:21.179131202 +0000 UTC m=+374.216610491 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs") pod "network-metrics-daemon-d8wzk" (UID: "ad9a4f7b-552f-469a-be1b-7ab6b4bd3740") : secret "metrics-daemon-secret" not found
Jul 02 21:35:19.432855 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.432778    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jmfq6"]
Jul 02 21:35:19.435570 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.435549    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.439758 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.439731    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 21:35:19.439868 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.439769    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 02 21:35:19.440800 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.440765    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 02 21:35:19.440800 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.440779    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 21:35:19.440952 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.440799    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-q264j\""
Jul 02 21:35:19.449618 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.449599    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 02 21:35:19.457416 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.457396    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jmfq6"]
Jul 02 21:35:19.524847 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.524823    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx"]
Jul 02 21:35:19.527579 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.527558    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn"]
Jul 02 21:35:19.527729 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.527711    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx"
Jul 02 21:35:19.530200 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.530180    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-bvtxv"]
Jul 02 21:35:19.530329 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.530312    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn"
Jul 02 21:35:19.530405 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.530370    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rgcwf\""
Jul 02 21:35:19.530405 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.530388    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:35:19.531274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.531240    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 02 21:35:19.531406 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.531386    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 02 21:35:19.532460 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.532440    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 02 21:35:19.533052 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.533031    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 02 21:35:19.533209 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.533190    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:35:19.535731 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.535668    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 02 21:35:19.535731 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.535708    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 02 21:35:19.535900 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.535819    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mmbwx\""
Jul 02 21:35:19.536183 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.536166    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bvtxv"
Jul 02 21:35:19.540203 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.540181    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-44z9z\""
Jul 02 21:35:19.541274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.541251    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx"]
Jul 02 21:35:19.542369 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.542350    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn"]
Jul 02 21:35:19.543442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.543424    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-bvtxv"]
Jul 02 21:35:19.582298 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.582277    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2105cd7b-38da-4788-8094-fd92efcff9bc-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.582401 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.582300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2105cd7b-38da-4788-8094-fd92efcff9bc-serving-cert\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.582401 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.582329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2105cd7b-38da-4788-8094-fd92efcff9bc-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.582515 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.582418    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2105cd7b-38da-4788-8094-fd92efcff9bc-snapshots\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.582515 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.582449    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8s84\" (UniqueName: \"kubernetes.io/projected/2105cd7b-38da-4788-8094-fd92efcff9bc-kube-api-access-t8s84\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.582515 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.582495    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2105cd7b-38da-4788-8094-fd92efcff9bc-tmp\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.680887 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.680865    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:19.683652 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.683613    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjcsm\" (UniqueName: \"kubernetes.io/projected/008eabf7-ce57-4467-8eb0-dd94a34f2147-kube-api-access-bjcsm\") pod \"kube-storage-version-migrator-operator-846bf668f7-x7dqn\" (UID: \"008eabf7-ce57-4467-8eb0-dd94a34f2147\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn"
Jul 02 21:35:19.683652 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.683644    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2105cd7b-38da-4788-8094-fd92efcff9bc-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.683767 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.683675    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2105cd7b-38da-4788-8094-fd92efcff9bc-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.683832 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.683811    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/008eabf7-ce57-4467-8eb0-dd94a34f2147-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-x7dqn\" (UID: \"008eabf7-ce57-4467-8eb0-dd94a34f2147\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn"
Jul 02 21:35:19.683893 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.683855    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2105cd7b-38da-4788-8094-fd92efcff9bc-snapshots\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.683950 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.683885    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/008eabf7-ce57-4467-8eb0-dd94a34f2147-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-x7dqn\" (UID: \"008eabf7-ce57-4467-8eb0-dd94a34f2147\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn"
Jul 02 21:35:19.683950 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.683930    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgfxs\" (UniqueName: \"kubernetes.io/projected/6130c258-549e-418a-a046-6f559442c4de-kube-api-access-wgfxs\") pod \"network-check-source-989f8b8dc-bvtxv\" (UID: \"6130c258-549e-418a-a046-6f559442c4de\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bvtxv"
Jul 02 21:35:19.684047 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.683956    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff158097-815f-4969-aa21-8352654fd18f-config\") pod \"service-ca-operator-5d46d9ffd4-jmfnx\" (UID: \"ff158097-815f-4969-aa21-8352654fd18f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx"
Jul 02 21:35:19.684083 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.684047    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcwst\" (UniqueName: \"kubernetes.io/projected/ff158097-815f-4969-aa21-8352654fd18f-kube-api-access-wcwst\") pod \"service-ca-operator-5d46d9ffd4-jmfnx\" (UID: \"ff158097-815f-4969-aa21-8352654fd18f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx"
Jul 02 21:35:19.684083 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.684073    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff158097-815f-4969-aa21-8352654fd18f-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-jmfnx\" (UID: \"ff158097-815f-4969-aa21-8352654fd18f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx"
Jul 02 21:35:19.684159 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.684106    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2105cd7b-38da-4788-8094-fd92efcff9bc-serving-cert\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.684159 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.684140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8s84\" (UniqueName: \"kubernetes.io/projected/2105cd7b-38da-4788-8094-fd92efcff9bc-kube-api-access-t8s84\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.684233 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.684165    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2105cd7b-38da-4788-8094-fd92efcff9bc-tmp\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.684326 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.684305    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2105cd7b-38da-4788-8094-fd92efcff9bc-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.684432 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.684412    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2105cd7b-38da-4788-8094-fd92efcff9bc-snapshots\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.684471 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.684457    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2105cd7b-38da-4788-8094-fd92efcff9bc-tmp\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.684567 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.684547    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2105cd7b-38da-4788-8094-fd92efcff9bc-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.686422 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.686405    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2105cd7b-38da-4788-8094-fd92efcff9bc-serving-cert\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.692402 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.692381    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8s84\" (UniqueName: \"kubernetes.io/projected/2105cd7b-38da-4788-8094-fd92efcff9bc-kube-api-access-t8s84\") pod \"insights-operator-5c847dcfc4-jmfq6\" (UID: \"2105cd7b-38da-4788-8094-fd92efcff9bc\") " pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.744369 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.744351    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6"
Jul 02 21:35:19.768339 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.768307    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:19.784548 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.784524    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/008eabf7-ce57-4467-8eb0-dd94a34f2147-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-x7dqn\" (UID: \"008eabf7-ce57-4467-8eb0-dd94a34f2147\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn"
Jul 02 21:35:19.784650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.784560    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/008eabf7-ce57-4467-8eb0-dd94a34f2147-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-x7dqn\" (UID: \"008eabf7-ce57-4467-8eb0-dd94a34f2147\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn"
Jul 02 21:35:19.784650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.784590    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgfxs\" (UniqueName: \"kubernetes.io/projected/6130c258-549e-418a-a046-6f559442c4de-kube-api-access-wgfxs\") pod \"network-check-source-989f8b8dc-bvtxv\" (UID: \"6130c258-549e-418a-a046-6f559442c4de\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bvtxv"
Jul 02 21:35:19.784650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.784605    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff158097-815f-4969-aa21-8352654fd18f-config\") pod \"service-ca-operator-5d46d9ffd4-jmfnx\" (UID: \"ff158097-815f-4969-aa21-8352654fd18f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx"
Jul 02 21:35:19.784650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.784622    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcwst\" (UniqueName: \"kubernetes.io/projected/ff158097-815f-4969-aa21-8352654fd18f-kube-api-access-wcwst\") pod \"service-ca-operator-5d46d9ffd4-jmfnx\" (UID: \"ff158097-815f-4969-aa21-8352654fd18f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx"
Jul 02 21:35:19.784650 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.784643    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff158097-815f-4969-aa21-8352654fd18f-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-jmfnx\" (UID: \"ff158097-815f-4969-aa21-8352654fd18f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx"
Jul 02 21:35:19.784903 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.784702    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjcsm\" (UniqueName: \"kubernetes.io/projected/008eabf7-ce57-4467-8eb0-dd94a34f2147-kube-api-access-bjcsm\") pod \"kube-storage-version-migrator-operator-846bf668f7-x7dqn\" (UID: \"008eabf7-ce57-4467-8eb0-dd94a34f2147\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn"
Jul 02 21:35:19.785207 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.785182    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/008eabf7-ce57-4467-8eb0-dd94a34f2147-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-x7dqn\" (UID: \"008eabf7-ce57-4467-8eb0-dd94a34f2147\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn"
Jul 02 21:35:19.785355 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.785336    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff158097-815f-4969-aa21-8352654fd18f-config\") pod \"service-ca-operator-5d46d9ffd4-jmfnx\" (UID: \"ff158097-815f-4969-aa21-8352654fd18f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx"
Jul 02 21:35:19.786806 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.786786    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/008eabf7-ce57-4467-8eb0-dd94a34f2147-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-x7dqn\" (UID: \"008eabf7-ce57-4467-8eb0-dd94a34f2147\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn"
Jul 02 21:35:19.786860 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.786786    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff158097-815f-4969-aa21-8352654fd18f-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-jmfnx\" (UID: \"ff158097-815f-4969-aa21-8352654fd18f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx"
Jul 02 21:35:19.793719 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.793693    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcwst\" (UniqueName: \"kubernetes.io/projected/ff158097-815f-4969-aa21-8352654fd18f-kube-api-access-wcwst\") pod \"service-ca-operator-5d46d9ffd4-jmfnx\" (UID: \"ff158097-815f-4969-aa21-8352654fd18f\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx"
Jul 02 21:35:19.794227 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.794203    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjcsm\" (UniqueName: \"kubernetes.io/projected/008eabf7-ce57-4467-8eb0-dd94a34f2147-kube-api-access-bjcsm\") pod \"kube-storage-version-migrator-operator-846bf668f7-x7dqn\" (UID: \"008eabf7-ce57-4467-8eb0-dd94a34f2147\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn"
Jul 02 21:35:19.796020 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.795979    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgfxs\" (UniqueName: \"kubernetes.io/projected/6130c258-549e-418a-a046-6f559442c4de-kube-api-access-wgfxs\") pod \"network-check-source-989f8b8dc-bvtxv\" (UID: \"6130c258-549e-418a-a046-6f559442c4de\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bvtxv"
Jul 02 21:35:19.840940 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.840910    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx"
Jul 02 21:35:19.848249 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.848229    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn"
Jul 02 21:35:19.853060 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.853040    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bvtxv"
Jul 02 21:35:19.866424 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.866331    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-jmfq6"]
Jul 02 21:35:19.869145 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:35:19.869115    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2105cd7b_38da_4788_8094_fd92efcff9bc.slice/crio-340bea11f01d848d7bc1f3972653da1a28f72278a71086e558cdcf0ba8435e99 WatchSource:0}: Error finding container 340bea11f01d848d7bc1f3972653da1a28f72278a71086e558cdcf0ba8435e99: Status 404 returned error can't find the container with id 340bea11f01d848d7bc1f3972653da1a28f72278a71086e558cdcf0ba8435e99
Jul 02 21:35:19.984925 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:19.984897    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx"]
Jul 02 21:35:19.987580 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:35:19.987552    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff158097_815f_4969_aa21_8352654fd18f.slice/crio-0a57c7de63a24d708539f142eb74ddcd4b28bcca278be986cd16d0c65db73bdb WatchSource:0}: Error finding container 0a57c7de63a24d708539f142eb74ddcd4b28bcca278be986cd16d0c65db73bdb: Status 404 returned error can't find the container with id 0a57c7de63a24d708539f142eb74ddcd4b28bcca278be986cd16d0c65db73bdb
Jul 02 21:35:20.203575 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:20.203504    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx" event={"ID":"ff158097-815f-4969-aa21-8352654fd18f","Type":"ContainerStarted","Data":"0a57c7de63a24d708539f142eb74ddcd4b28bcca278be986cd16d0c65db73bdb"}
Jul 02 21:35:20.204524 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:20.204501    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6" event={"ID":"2105cd7b-38da-4788-8094-fd92efcff9bc","Type":"ContainerStarted","Data":"340bea11f01d848d7bc1f3972653da1a28f72278a71086e558cdcf0ba8435e99"}
Jul 02 21:35:20.207485 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:20.207463    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn"]
Jul 02 21:35:20.208181 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:20.208163    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-bvtxv"]
Jul 02 21:35:20.212489 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:35:20.212468    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6130c258_549e_418a_a046_6f559442c4de.slice/crio-a1e6c9bd4fb8e390e807ca7e67822de9bef80420b1aa43e4a3ec41b971382d04 WatchSource:0}: Error finding container a1e6c9bd4fb8e390e807ca7e67822de9bef80420b1aa43e4a3ec41b971382d04: Status 404 returned error can't find the container with id a1e6c9bd4fb8e390e807ca7e67822de9bef80420b1aa43e4a3ec41b971382d04
Jul 02 21:35:20.212869 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:35:20.212851    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod008eabf7_ce57_4467_8eb0_dd94a34f2147.slice/crio-fcde1962e27023f471a36b66dc9a2b9b97cf6a78173a5736535daa94423e6657 WatchSource:0}: Error finding container fcde1962e27023f471a36b66dc9a2b9b97cf6a78173a5736535daa94423e6657: Status 404 returned error can't find the container with id fcde1962e27023f471a36b66dc9a2b9b97cf6a78173a5736535daa94423e6657
Jul 02 21:35:21.211716 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:21.211678    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bvtxv" event={"ID":"6130c258-549e-418a-a046-6f559442c4de","Type":"ContainerStarted","Data":"b6a8c0fd8f907a671a8b669e582cdc73dcb5acb8d6875d3f2635823a4c4250ee"}
Jul 02 21:35:21.212189 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:21.211733    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bvtxv" event={"ID":"6130c258-549e-418a-a046-6f559442c4de","Type":"ContainerStarted","Data":"a1e6c9bd4fb8e390e807ca7e67822de9bef80420b1aa43e4a3ec41b971382d04"}
Jul 02 21:35:21.213116 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:21.213088    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn" event={"ID":"008eabf7-ce57-4467-8eb0-dd94a34f2147","Type":"ContainerStarted","Data":"fcde1962e27023f471a36b66dc9a2b9b97cf6a78173a5736535daa94423e6657"}
Jul 02 21:35:21.229381 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:21.229303    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bvtxv" podStartSLOduration=2.22928562 podStartE2EDuration="2.22928562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:35:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:35:21.228610912 +0000 UTC m=+254.266090245" watchObservedRunningTime="2026-07-02 21:35:21.22928562 +0000 UTC m=+254.266764931"
Jul 02 21:35:22.040586 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:22.040554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:22.142080 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:22.142046    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:23.221950 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:23.221910    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx" event={"ID":"ff158097-815f-4969-aa21-8352654fd18f","Type":"ContainerStarted","Data":"31ce372fee6e2e710c01bf2a01f8bee034b7aeb56bbad95891c92bf8ef251c97"}
Jul 02 21:35:23.223567 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:23.223541    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6" event={"ID":"2105cd7b-38da-4788-8094-fd92efcff9bc","Type":"ContainerStarted","Data":"40a6a87c3738565d88acac3884513e378a31fa201f08a3cf348828b80a4bfcef"}
Jul 02 21:35:23.225072 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:23.225046    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn" event={"ID":"008eabf7-ce57-4467-8eb0-dd94a34f2147","Type":"ContainerStarted","Data":"da753be2b85712ab898a64c80e542c916c979b8d4b08162ca931a6ba2782f2ff"}
Jul 02 21:35:23.240456 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:23.240372    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx" podStartSLOduration=1.21065633 podStartE2EDuration="4.240355309s" totalImagesPullingTime="3.029698979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:35:23.239197648 +0000 UTC m=+256.276676958" watchObservedRunningTime="2026-07-02 21:35:23.240355309 +0000 UTC m=+256.277834618"
Jul 02 21:35:23.256715 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:23.256665    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6" podStartSLOduration=1.115848828 podStartE2EDuration="4.256649809s" totalImagesPullingTime="3.140800981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:35:23.256404183 +0000 UTC m=+256.293883495" watchObservedRunningTime="2026-07-02 21:35:23.256649809 +0000 UTC m=+256.294129118"
Jul 02 21:35:23.270990 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:23.270847    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn" podStartSLOduration=1.471231753 podStartE2EDuration="4.270832665s" totalImagesPullingTime="2.799600912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:35:23.26986999 +0000 UTC m=+256.307349299" watchObservedRunningTime="2026-07-02 21:35:23.270832665 +0000 UTC m=+256.308311973"
Jul 02 21:35:24.286694 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.286654    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:24.392036 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.391957    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:24.416540 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.416509    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zxb2n"]
Jul 02 21:35:24.420392 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.420371    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:24.422625 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.422605    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 21:35:24.422625 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.422611    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 21:35:24.422865 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.422852    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-97hq6\""
Jul 02 21:35:24.429490 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.429463    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zxb2n"]
Jul 02 21:35:24.457491 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.457471    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:24.519103 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.519082    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e2efd29-a663-4ef7-88ef-f153628344dd-data-volume\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:24.519195 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.519109    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e2efd29-a663-4ef7-88ef-f153628344dd-crio-socket\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:24.519195 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.519155    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftn2z\" (UniqueName: \"kubernetes.io/projected/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-api-access-ftn2z\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:24.519264 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.519195    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:24.519264 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.519233    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:24.557949 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.557883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:24.581143 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.581119    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-q7z9m"]
Jul 02 21:35:24.584194 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.584178    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-q7z9m"
Jul 02 21:35:24.587254 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.587237    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 02 21:35:24.587359 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.587325    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-r6vs4\""
Jul 02 21:35:24.587414 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.587390    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 02 21:35:24.594547 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.594528    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-q7z9m"]
Jul 02 21:35:24.620044 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.620002    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftn2z\" (UniqueName: \"kubernetes.io/projected/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-api-access-ftn2z\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:24.620141 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.620055    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:24.620185 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:24.620146    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:24.620185 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.620174    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:24.620248 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:24.620193    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls podName:0e2efd29-a663-4ef7-88ef-f153628344dd nodeName:}" failed. No retries permitted until 2026-07-02 21:35:25.120178076 +0000 UTC m=+258.157657375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zxb2n" (UID: "0e2efd29-a663-4ef7-88ef-f153628344dd") : secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:24.620248 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:24.620230    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 21:35:24.620248 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.620243    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e2efd29-a663-4ef7-88ef-f153628344dd-data-volume\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:24.620359 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.620272    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e2efd29-a663-4ef7-88ef-f153628344dd-crio-socket\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:24.620359 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:24.620291    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm podName:0e2efd29-a663-4ef7-88ef-f153628344dd nodeName:}" failed. No retries permitted until 2026-07-02 21:35:25.120273341 +0000 UTC m=+258.157752647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zxb2n" (UID: "0e2efd29-a663-4ef7-88ef-f153628344dd") : configmap "kube-rbac-proxy" not found
Jul 02 21:35:24.620359 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.620322    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e2efd29-a663-4ef7-88ef-f153628344dd-crio-socket\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:24.620525 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.620509    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e2efd29-a663-4ef7-88ef-f153628344dd-data-volume\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:24.629564 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.629545    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftn2z\" (UniqueName: \"kubernetes.io/projected/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-api-access-ftn2z\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:24.657091 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.657067    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:24.720636 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.720615    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-599hc\" (UniqueName: \"kubernetes.io/projected/3c8b1429-a4ab-48db-8be6-42f82333abfc-kube-api-access-599hc\") pod \"migrator-d57d58cc9-q7z9m\" (UID: \"3c8b1429-a4ab-48db-8be6-42f82333abfc\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-q7z9m"
Jul 02 21:35:24.757700 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.757676    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:24.821102 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.821050    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-599hc\" (UniqueName: \"kubernetes.io/projected/3c8b1429-a4ab-48db-8be6-42f82333abfc-kube-api-access-599hc\") pod \"migrator-d57d58cc9-q7z9m\" (UID: \"3c8b1429-a4ab-48db-8be6-42f82333abfc\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-q7z9m"
Jul 02 21:35:24.829138 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.829108    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-599hc\" (UniqueName: \"kubernetes.io/projected/3c8b1429-a4ab-48db-8be6-42f82333abfc-kube-api-access-599hc\") pod \"migrator-d57d58cc9-q7z9m\" (UID: \"3c8b1429-a4ab-48db-8be6-42f82333abfc\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-q7z9m"
Jul 02 21:35:24.893011 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.892994    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-q7z9m"
Jul 02 21:35:24.994252 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:24.994225    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:25.012808 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:25.012786    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-q7z9m"]
Jul 02 21:35:25.015164 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:35:25.015137    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c8b1429_a4ab_48db_8be6_42f82333abfc.slice/crio-a53f944dcab3b4d36131003e571b638b2fb7828dcb4c2fdc3365fe2303fd0ff0 WatchSource:0}: Error finding container a53f944dcab3b4d36131003e571b638b2fb7828dcb4c2fdc3365fe2303fd0ff0: Status 404 returned error can't find the container with id a53f944dcab3b4d36131003e571b638b2fb7828dcb4c2fdc3365fe2303fd0ff0
Jul 02 21:35:25.094298 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:25.094240    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:25.123229 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:25.123192    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:25.123308 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:25.123243    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:25.123350 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:25.123331    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:25.123383 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:25.123370    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 21:35:25.123414 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:25.123385    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls podName:0e2efd29-a663-4ef7-88ef-f153628344dd nodeName:}" failed. No retries permitted until 2026-07-02 21:35:26.123370004 +0000 UTC m=+259.160849290 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zxb2n" (UID: "0e2efd29-a663-4ef7-88ef-f153628344dd") : secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:25.123414 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:25.123408    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm podName:0e2efd29-a663-4ef7-88ef-f153628344dd nodeName:}" failed. No retries permitted until 2026-07-02 21:35:26.123397508 +0000 UTC m=+259.160876793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zxb2n" (UID: "0e2efd29-a663-4ef7-88ef-f153628344dd") : configmap "kube-rbac-proxy" not found
Jul 02 21:35:25.236540 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:25.236516    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-q7z9m" event={"ID":"3c8b1429-a4ab-48db-8be6-42f82333abfc","Type":"ContainerStarted","Data":"a53f944dcab3b4d36131003e571b638b2fb7828dcb4c2fdc3365fe2303fd0ff0"}
Jul 02 21:35:26.130832 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.130792    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:26.131280 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.130854    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:26.131280 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:26.130975    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:26.131280 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:26.131022    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 21:35:26.131280 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:26.131065    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls podName:0e2efd29-a663-4ef7-88ef-f153628344dd nodeName:}" failed. No retries permitted until 2026-07-02 21:35:28.131047697 +0000 UTC m=+261.168526983 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zxb2n" (UID: "0e2efd29-a663-4ef7-88ef-f153628344dd") : secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:26.131280 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:26.131080    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm podName:0e2efd29-a663-4ef7-88ef-f153628344dd nodeName:}" failed. No retries permitted until 2026-07-02 21:35:28.131074565 +0000 UTC m=+261.168553851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zxb2n" (UID: "0e2efd29-a663-4ef7-88ef-f153628344dd") : configmap "kube-rbac-proxy" not found
Jul 02 21:35:26.590587 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.590556    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-q6858"]
Jul 02 21:35:26.593600 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.593584    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-q6858"
Jul 02 21:35:26.596358 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.596336    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 02 21:35:26.597359 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.597338    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 02 21:35:26.597473 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.597461    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 02 21:35:26.597528 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.597496    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nd2md\""
Jul 02 21:35:26.597528 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.597512    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 02 21:35:26.601039 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.600994    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-q6858"]
Jul 02 21:35:26.601135 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.601086    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tc79l_8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef/dns-node-resolver/0.log"
Jul 02 21:35:26.658268 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.658204    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:26.735685 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.735623    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3033888c-f87f-42bf-9e71-7b9c7edff439-signing-key\") pod \"service-ca-758f599c5-q6858\" (UID: \"3033888c-f87f-42bf-9e71-7b9c7edff439\") " pod="openshift-service-ca/service-ca-758f599c5-q6858"
Jul 02 21:35:26.735685 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.735672    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:26.735834 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.735758    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3033888c-f87f-42bf-9e71-7b9c7edff439-signing-cabundle\") pod \"service-ca-758f599c5-q6858\" (UID: \"3033888c-f87f-42bf-9e71-7b9c7edff439\") " pod="openshift-service-ca/service-ca-758f599c5-q6858"
Jul 02 21:35:26.735834 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.735806    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqx44\" (UniqueName: \"kubernetes.io/projected/3033888c-f87f-42bf-9e71-7b9c7edff439-kube-api-access-tqx44\") pod \"service-ca-758f599c5-q6858\" (UID: \"3033888c-f87f-42bf-9e71-7b9c7edff439\") " pod="openshift-service-ca/service-ca-758f599c5-q6858"
Jul 02 21:35:26.836217 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.836197    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3033888c-f87f-42bf-9e71-7b9c7edff439-signing-key\") pod \"service-ca-758f599c5-q6858\" (UID: \"3033888c-f87f-42bf-9e71-7b9c7edff439\") " pod="openshift-service-ca/service-ca-758f599c5-q6858"
Jul 02 21:35:26.836336 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.836242    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3033888c-f87f-42bf-9e71-7b9c7edff439-signing-cabundle\") pod \"service-ca-758f599c5-q6858\" (UID: \"3033888c-f87f-42bf-9e71-7b9c7edff439\") " pod="openshift-service-ca/service-ca-758f599c5-q6858"
Jul 02 21:35:26.836336 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.836284    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqx44\" (UniqueName: \"kubernetes.io/projected/3033888c-f87f-42bf-9e71-7b9c7edff439-kube-api-access-tqx44\") pod \"service-ca-758f599c5-q6858\" (UID: \"3033888c-f87f-42bf-9e71-7b9c7edff439\") " pod="openshift-service-ca/service-ca-758f599c5-q6858"
Jul 02 21:35:26.836939 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.836923    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3033888c-f87f-42bf-9e71-7b9c7edff439-signing-cabundle\") pod \"service-ca-758f599c5-q6858\" (UID: \"3033888c-f87f-42bf-9e71-7b9c7edff439\") " pod="openshift-service-ca/service-ca-758f599c5-q6858"
Jul 02 21:35:26.838466 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.838442    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3033888c-f87f-42bf-9e71-7b9c7edff439-signing-key\") pod \"service-ca-758f599c5-q6858\" (UID: \"3033888c-f87f-42bf-9e71-7b9c7edff439\") " pod="openshift-service-ca/service-ca-758f599c5-q6858"
Jul 02 21:35:26.844727 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.844706    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqx44\" (UniqueName: \"kubernetes.io/projected/3033888c-f87f-42bf-9e71-7b9c7edff439-kube-api-access-tqx44\") pod \"service-ca-758f599c5-q6858\" (UID: \"3033888c-f87f-42bf-9e71-7b9c7edff439\") " pod="openshift-service-ca/service-ca-758f599c5-q6858"
Jul 02 21:35:26.902695 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:26.902666    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-q6858"
Jul 02 21:35:27.022341 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:27.022314    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-q6858"]
Jul 02 21:35:27.025080 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:35:27.025051    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3033888c_f87f_42bf_9e71_7b9c7edff439.slice/crio-4b8ae7fc21e39d26bbc6de2bf7cad64c5f122fb9f8c51398ecc405ca86ff5fdd WatchSource:0}: Error finding container 4b8ae7fc21e39d26bbc6de2bf7cad64c5f122fb9f8c51398ecc405ca86ff5fdd: Status 404 returned error can't find the container with id 4b8ae7fc21e39d26bbc6de2bf7cad64c5f122fb9f8c51398ecc405ca86ff5fdd
Jul 02 21:35:27.195973 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:27.195911    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-26tvv_55c68fb2-3894-4e91-b536-b47a9ec3900c/node-ca/0.log"
Jul 02 21:35:27.245661 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:27.245628    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-q7z9m" event={"ID":"3c8b1429-a4ab-48db-8be6-42f82333abfc","Type":"ContainerStarted","Data":"1343f32ae20731317b419508138557c356f6f5643ff3f42930f49c307299b8c7"}
Jul 02 21:35:27.245801 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:27.245689    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-q7z9m" event={"ID":"3c8b1429-a4ab-48db-8be6-42f82333abfc","Type":"ContainerStarted","Data":"3d4d90dc139f2d4a1dca8699473bdae686ed5e6ca791de7e8f9cffdd1ba8da58"}
Jul 02 21:35:27.246870 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:27.246845    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-q6858" event={"ID":"3033888c-f87f-42bf-9e71-7b9c7edff439","Type":"ContainerStarted","Data":"b9add9a0f9609b5205e3183d62a4c2880a56ce5faa3b773003ac30515706926b"}
Jul 02 21:35:27.246962 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:27.246887    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-q6858" event={"ID":"3033888c-f87f-42bf-9e71-7b9c7edff439","Type":"ContainerStarted","Data":"4b8ae7fc21e39d26bbc6de2bf7cad64c5f122fb9f8c51398ecc405ca86ff5fdd"}
Jul 02 21:35:27.270791 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:27.270742    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-q7z9m" podStartSLOduration=1.9775250290000002 podStartE2EDuration="3.270726158s" totalImagesPullingTime="1.293201129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:35:27.269954618 +0000 UTC m=+260.307433926" watchObservedRunningTime="2026-07-02 21:35:27.270726158 +0000 UTC m=+260.308205466"
Jul 02 21:35:27.289945 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:27.289900    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-q6858" podStartSLOduration=1.289884685 podStartE2EDuration="1.289884685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:35:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:35:27.289656377 +0000 UTC m=+260.327135696" watchObservedRunningTime="2026-07-02 21:35:27.289884685 +0000 UTC m=+260.327363994"
Jul 02 21:35:27.592571 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:27.592510    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:28.078317 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:28.078261    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:28.145400 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:28.145363    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:28.145584 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:28.145412    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:28.145584 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:28.145500    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 21:35:28.145584 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:28.145532    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:28.145584 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:28.145565    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm podName:0e2efd29-a663-4ef7-88ef-f153628344dd nodeName:}" failed. No retries permitted until 2026-07-02 21:35:32.14554623 +0000 UTC m=+265.183025521 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zxb2n" (UID: "0e2efd29-a663-4ef7-88ef-f153628344dd") : configmap "kube-rbac-proxy" not found
Jul 02 21:35:28.145777 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:28.145606    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls podName:0e2efd29-a663-4ef7-88ef-f153628344dd nodeName:}" failed. No retries permitted until 2026-07-02 21:35:32.14558868 +0000 UTC m=+265.183067970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zxb2n" (UID: "0e2efd29-a663-4ef7-88ef-f153628344dd") : secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:28.195891 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:28.195863    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hlcjm_b58149aa-a11a-4b62-b8d2-54492d81dda2/serve-healthcheck-canary/0.log"
Jul 02 21:35:28.214649 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:28.214592    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:28.514826 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:28.514768    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:28.655639 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:28.655586    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:28.753531 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:28.753494    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:28.813966 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:28.813892    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:29.376854 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:29.376825    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:29.779476 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:29.779410    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:30.053019 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:30.052924    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:30.580583 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:30.580556    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:30.798986 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:30.798948    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:30.997994 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:30.997964    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:31.176686 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:31.176650    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:31.403536 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:31.403506    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:31.779982 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:31.779894    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:31.972358 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:31.972332    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:32.177040 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:32.176986    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:32.177236 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:32.177053    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:32.177236 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:32.177133    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:32.177236 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:32.177180    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 21:35:32.177236 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:32.177201    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls podName:0e2efd29-a663-4ef7-88ef-f153628344dd nodeName:}" failed. No retries permitted until 2026-07-02 21:35:40.177186228 +0000 UTC m=+273.214665517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zxb2n" (UID: "0e2efd29-a663-4ef7-88ef-f153628344dd") : secret "insights-runtime-extractor-tls" not found
Jul 02 21:35:32.177236 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:32.177236    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm podName:0e2efd29-a663-4ef7-88ef-f153628344dd nodeName:}" failed. No retries permitted until 2026-07-02 21:35:40.177219282 +0000 UTC m=+273.214698587 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zxb2n" (UID: "0e2efd29-a663-4ef7-88ef-f153628344dd") : configmap "kube-rbac-proxy" not found
Jul 02 21:35:32.208565 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:32.208539    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:32.575808 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:32.575732    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:32.774987 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:32.774946    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:32.840143 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:32.840075    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:33.177622 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:33.177591    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:33.375832 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:33.375803    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:33.569968 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:33.569904    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:34.577274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:34.577247    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:34.676317 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:34.676286    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:34.971401 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:34.971375    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:35.170905 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:35.170868    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:35.379994 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:35.379964    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:35.773447 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:35.773366    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:36.380484 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:36.380456    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:36.776332 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:36.776257    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:37.172354 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:37.172325    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:37.377861 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:37.377800    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:37.604597 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:37.604570    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:37.805196 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:37.805168    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:37.905800 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:37.905727    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:38.005931 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:38.005906    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:38.060220 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:38.060198    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:38.176451 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:38.176392    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:38.375784 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:38.375750    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:38.975566 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:38.975534    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:39.178761 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:39.178734    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:39.480106 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:39.480074    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:40.237541 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:40.237498    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:40.237541 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:40.237543    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:40.238036 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:40.237960    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e2efd29-a663-4ef7-88ef-f153628344dd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:40.239879 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:40.239857    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e2efd29-a663-4ef7-88ef-f153628344dd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxb2n\" (UID: \"0e2efd29-a663-4ef7-88ef-f153628344dd\") " pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:40.329239 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:40.329217    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zxb2n"
Jul 02 21:35:40.456582 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:40.456551    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zxb2n"]
Jul 02 21:35:40.459231 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:35:40.459207    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e2efd29_a663_4ef7_88ef_f153628344dd.slice/crio-497de58244f11fa1d7e85d8e9b3951ae2a93cb50b74c20bdc720247bde9b2323 WatchSource:0}: Error finding container 497de58244f11fa1d7e85d8e9b3951ae2a93cb50b74c20bdc720247bde9b2323: Status 404 returned error can't find the container with id 497de58244f11fa1d7e85d8e9b3951ae2a93cb50b74c20bdc720247bde9b2323
Jul 02 21:35:41.295652 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:41.295572    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zxb2n" event={"ID":"0e2efd29-a663-4ef7-88ef-f153628344dd","Type":"ContainerStarted","Data":"497de58244f11fa1d7e85d8e9b3951ae2a93cb50b74c20bdc720247bde9b2323"}
Jul 02 21:35:42.726392 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:42.726359    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:42.777401 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:42.777369    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:44.306993 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:44.306959    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zxb2n" event={"ID":"0e2efd29-a663-4ef7-88ef-f153628344dd","Type":"ContainerStarted","Data":"fc29500d613e1e2f75cd4414187338d70e2904c593fe485c63ab070f9529fb9b"}
Jul 02 21:35:45.311969 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:45.311936    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zxb2n" event={"ID":"0e2efd29-a663-4ef7-88ef-f153628344dd","Type":"ContainerStarted","Data":"c86808aef1e53e822d0a109c00b5ba8c6a4d28e905b7d63ab65e408e7c492ded"}
Jul 02 21:35:48.323871 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:48.323831    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zxb2n" event={"ID":"0e2efd29-a663-4ef7-88ef-f153628344dd","Type":"ContainerStarted","Data":"6d9ee58261ba9e7e16662612b54682ed8d8ab4b955d80631c6aed4bdb86dff5c"}
Jul 02 21:35:48.341674 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:48.341635    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zxb2n" podStartSLOduration=17.49076605 podStartE2EDuration="24.341618217s" totalImagesPullingTime="6.850852167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:35:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:35:48.341538761 +0000 UTC m=+281.379018092" watchObservedRunningTime="2026-07-02 21:35:48.341618217 +0000 UTC m=+281.379097526"
Jul 02 21:35:48.982276 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:48.982240    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd" podUID="6f567d5e-c6f3-4a65-aef0-ac6bd0250922"
Jul 02 21:35:48.982276 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:48.982240    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hmsc8" podUID="4e8eaa68-900f-4a98-8499-111bd1451076"
Jul 02 21:35:49.327024 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:49.326935    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:35:49.327024 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:49.326940    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:35:49.798064 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:49.798039    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bf65d99fd-87ctd"]
Jul 02 21:35:49.798248 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:49.798228    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd" podUID="6f567d5e-c6f3-4a65-aef0-ac6bd0250922"
Jul 02 21:35:49.816822 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:49.816793    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-79c7886d7b-qks2t"]
Jul 02 21:35:49.820091 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:49.820072    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:49.832803 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:49.832779    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79c7886d7b-qks2t"]
Jul 02 21:35:49.872984 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:49.872960    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:49.910284 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:49.910260    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7323c660-49e7-4690-9457-8ff1780fd89e-trusted-ca\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:49.910382 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:49.910292    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7323c660-49e7-4690-9457-8ff1780fd89e-installation-pull-secrets\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:49.910382 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:49.910329    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7323c660-49e7-4690-9457-8ff1780fd89e-image-registry-private-configuration\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:49.910460 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:49.910401    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7323c660-49e7-4690-9457-8ff1780fd89e-registry-tls\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:49.910460 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:49.910422    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7323c660-49e7-4690-9457-8ff1780fd89e-ca-trust-extracted\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:49.910460 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:49.910454    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95pbz\" (UniqueName: \"kubernetes.io/projected/7323c660-49e7-4690-9457-8ff1780fd89e-kube-api-access-95pbz\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:49.910585 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:49.910473    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7323c660-49e7-4690-9457-8ff1780fd89e-registry-certificates\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:49.910585 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:49.910570    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7323c660-49e7-4690-9457-8ff1780fd89e-bound-sa-token\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.011673 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.011643    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7323c660-49e7-4690-9457-8ff1780fd89e-trusted-ca\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.011792 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.011697    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7323c660-49e7-4690-9457-8ff1780fd89e-installation-pull-secrets\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.011792 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.011744    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7323c660-49e7-4690-9457-8ff1780fd89e-image-registry-private-configuration\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.011896 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.011791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7323c660-49e7-4690-9457-8ff1780fd89e-registry-tls\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.011896 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.011833    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7323c660-49e7-4690-9457-8ff1780fd89e-ca-trust-extracted\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.011896 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.011882    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95pbz\" (UniqueName: \"kubernetes.io/projected/7323c660-49e7-4690-9457-8ff1780fd89e-kube-api-access-95pbz\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.012073 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.011904    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7323c660-49e7-4690-9457-8ff1780fd89e-registry-certificates\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.012073 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.011950    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7323c660-49e7-4690-9457-8ff1780fd89e-bound-sa-token\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.012351 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.012320    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7323c660-49e7-4690-9457-8ff1780fd89e-ca-trust-extracted\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.012664 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.012641    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7323c660-49e7-4690-9457-8ff1780fd89e-trusted-ca\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.012733 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.012692    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7323c660-49e7-4690-9457-8ff1780fd89e-registry-certificates\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.014251 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.014232    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7323c660-49e7-4690-9457-8ff1780fd89e-registry-tls\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.014606 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.014584    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7323c660-49e7-4690-9457-8ff1780fd89e-image-registry-private-configuration\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.014654 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.014613    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7323c660-49e7-4690-9457-8ff1780fd89e-installation-pull-secrets\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.023458 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.023436    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95pbz\" (UniqueName: \"kubernetes.io/projected/7323c660-49e7-4690-9457-8ff1780fd89e-kube-api-access-95pbz\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.023569 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.023553    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7323c660-49e7-4690-9457-8ff1780fd89e-bound-sa-token\") pod \"image-registry-79c7886d7b-qks2t\" (UID: \"7323c660-49e7-4690-9457-8ff1780fd89e\") " pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.132123 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.132106    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b4gbg\""
Jul 02 21:35:50.140074 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.140058    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.267117 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.267092    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-79c7886d7b-qks2t"]
Jul 02 21:35:50.270491 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:35:50.270465    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7323c660_49e7_4690_9457_8ff1780fd89e.slice/crio-3b3a03e1b07add05a5c75d18ec66ef26a8a03cf9f3fe1f7bee8720adc97a1f6d WatchSource:0}: Error finding container 3b3a03e1b07add05a5c75d18ec66ef26a8a03cf9f3fe1f7bee8720adc97a1f6d: Status 404 returned error can't find the container with id 3b3a03e1b07add05a5c75d18ec66ef26a8a03cf9f3fe1f7bee8720adc97a1f6d
Jul 02 21:35:50.331354 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.331320    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c7886d7b-qks2t" event={"ID":"7323c660-49e7-4690-9457-8ff1780fd89e","Type":"ContainerStarted","Data":"d064ee6660e67b302d80c022dd04b4b16296d6b15ae181100688dedc8ec9aa45"}
Jul 02 21:35:50.331704 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.331377    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-79c7886d7b-qks2t" event={"ID":"7323c660-49e7-4690-9457-8ff1780fd89e","Type":"ContainerStarted","Data":"3b3a03e1b07add05a5c75d18ec66ef26a8a03cf9f3fe1f7bee8720adc97a1f6d"}
Jul 02 21:35:50.331704 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.331398    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:35:50.331704 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.331404    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:35:50.337577 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.337560    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:35:50.353732 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.353692    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-79c7886d7b-qks2t" podStartSLOduration=1.353678505 podStartE2EDuration="1.353678505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:35:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:35:50.352386783 +0000 UTC m=+283.389866118" watchObservedRunningTime="2026-07-02 21:35:50.353678505 +0000 UTC m=+283.391157814"
Jul 02 21:35:50.414889 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.414821    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-bound-sa-token\") pod \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") "
Jul 02 21:35:50.414889 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.414858    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-certificates\") pod \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") "
Jul 02 21:35:50.415112 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.414906    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-installation-pull-secrets\") pod \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") "
Jul 02 21:35:50.415112 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.414944    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4rj5\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-kube-api-access-h4rj5\") pod \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") "
Jul 02 21:35:50.415112 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.415064    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-trusted-ca\") pod \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") "
Jul 02 21:35:50.415282 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.415123    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-image-registry-private-configuration\") pod \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") "
Jul 02 21:35:50.415282 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.415164    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-ca-trust-extracted\") pod \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\" (UID: \"6f567d5e-c6f3-4a65-aef0-ac6bd0250922\") "
Jul 02 21:35:50.415389 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.415283    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6f567d5e-c6f3-4a65-aef0-ac6bd0250922" (UID: "6f567d5e-c6f3-4a65-aef0-ac6bd0250922"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:35:50.416382 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.415443    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6f567d5e-c6f3-4a65-aef0-ac6bd0250922" (UID: "6f567d5e-c6f3-4a65-aef0-ac6bd0250922"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:35:50.416382 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.415542    2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-ca-trust-extracted\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:35:50.416382 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.415561    2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-certificates\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:35:50.416382 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.416346    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6f567d5e-c6f3-4a65-aef0-ac6bd0250922" (UID: "6f567d5e-c6f3-4a65-aef0-ac6bd0250922"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:35:50.417283 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.417261    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6f567d5e-c6f3-4a65-aef0-ac6bd0250922" (UID: "6f567d5e-c6f3-4a65-aef0-ac6bd0250922"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:35:50.417463 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.417443    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-kube-api-access-h4rj5" (OuterVolumeSpecName: "kube-api-access-h4rj5") pod "6f567d5e-c6f3-4a65-aef0-ac6bd0250922" (UID: "6f567d5e-c6f3-4a65-aef0-ac6bd0250922"). InnerVolumeSpecName "kube-api-access-h4rj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:35:50.417527 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.417457    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6f567d5e-c6f3-4a65-aef0-ac6bd0250922" (UID: "6f567d5e-c6f3-4a65-aef0-ac6bd0250922"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:35:50.417527 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.417503    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6f567d5e-c6f3-4a65-aef0-ac6bd0250922" (UID: "6f567d5e-c6f3-4a65-aef0-ac6bd0250922"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:35:50.515915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.515889    2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-bound-sa-token\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:35:50.515915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.515915    2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-installation-pull-secrets\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:35:50.516105 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.515928    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4rj5\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-kube-api-access-h4rj5\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:35:50.516105 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.515941    2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-trusted-ca\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:35:50.516105 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:50.515953    2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-image-registry-private-configuration\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:35:51.100818 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:51.100773    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:51.334825 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:51.334750    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bf65d99fd-87ctd"
Jul 02 21:35:51.364461 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:51.364432    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bf65d99fd-87ctd"]
Jul 02 21:35:51.369654 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:51.369633    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bf65d99fd-87ctd"]
Jul 02 21:35:51.424238 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:51.424200    2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f567d5e-c6f3-4a65-aef0-ac6bd0250922-registry-tls\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:35:51.523937 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:51.523912    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f567d5e-c6f3-4a65-aef0-ac6bd0250922" path="/var/lib/kubelet/pods/6f567d5e-c6f3-4a65-aef0-ac6bd0250922/volumes"
Jul 02 21:35:52.128918 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:52.128889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:35:52.131121 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:52.131103    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e8eaa68-900f-4a98-8499-111bd1451076-metrics-tls\") pod \"dns-default-hmsc8\" (UID: \"4e8eaa68-900f-4a98-8499-111bd1451076\") " pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:35:52.330060 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:52.330035    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-knz6t\""
Jul 02 21:35:52.337924 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:52.337905    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:35:52.458885 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:52.458856    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hmsc8"]
Jul 02 21:35:52.461788 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:35:52.461762    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8eaa68_900f_4a98_8499_111bd1451076.slice/crio-dd9d3eb29ec51f5d08e81fcdfcfbb056904659edf6916de85bfd9860793648c7 WatchSource:0}: Error finding container dd9d3eb29ec51f5d08e81fcdfcfbb056904659edf6916de85bfd9860793648c7: Status 404 returned error can't find the container with id dd9d3eb29ec51f5d08e81fcdfcfbb056904659edf6916de85bfd9860793648c7
Jul 02 21:35:52.975601 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:52.975547    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:53.052070 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:53.052033    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:53.332714 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:53.332628    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:53.341729 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:53.341702    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmsc8" event={"ID":"4e8eaa68-900f-4a98-8499-111bd1451076","Type":"ContainerStarted","Data":"dd9d3eb29ec51f5d08e81fcdfcfbb056904659edf6916de85bfd9860793648c7"}
Jul 02 21:35:54.227799 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:54.227767    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:54.282753 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:54.282724    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:54.346478 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:54.346452    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmsc8" event={"ID":"4e8eaa68-900f-4a98-8499-111bd1451076","Type":"ContainerStarted","Data":"b4042bc1a73fb43f1970ebdf1b9a9fbb32b1b09ff9f9f4b96f3798ec2fa30a72"}
Jul 02 21:35:55.351529 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:55.351496    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hmsc8" event={"ID":"4e8eaa68-900f-4a98-8499-111bd1451076","Type":"ContainerStarted","Data":"7f0165227c3d59ca0a09d4e1053a297da263ce2c97622032a2bcff52f123860c"}
Jul 02 21:35:55.351889 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:55.351604    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:35:55.369393 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:55.369353    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hmsc8" podStartSLOduration=251.6310349 podStartE2EDuration="4m13.369341732s" totalImagesPullingTime="1.738306832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:35:55.367303939 +0000 UTC m=+288.404783247" watchObservedRunningTime="2026-07-02 21:35:55.369341732 +0000 UTC m=+288.406821040"
Jul 02 21:35:55.613981 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:55.613915    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:58.102117 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.102085    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:58.302432 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.302373    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:58.363631 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.363561    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2jlrp"]
Jul 02 21:35:58.366776 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.366757    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.373840 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.373808    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 21:35:58.373840 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.373837    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vcgfq\""
Jul 02 21:35:58.374045 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.373872    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 21:35:58.374045 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.373882    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 21:35:58.374185 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.374063    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 21:35:58.374185 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.374178    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 21:35:58.374401 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.374383    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 21:35:58.407857 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.407832    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:58.474976 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.474954    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77c26077-8bce-47b7-9093-4f02dd2140c6-node-exporter-wtmp\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.475097 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.474985    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77c26077-8bce-47b7-9093-4f02dd2140c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.475097 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.475031    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfn2f\" (UniqueName: \"kubernetes.io/projected/77c26077-8bce-47b7-9093-4f02dd2140c6-kube-api-access-cfn2f\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.475207 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.475079    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77c26077-8bce-47b7-9093-4f02dd2140c6-sys\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.475207 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.475148    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77c26077-8bce-47b7-9093-4f02dd2140c6-node-exporter-tls\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.475207 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.475198    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77c26077-8bce-47b7-9093-4f02dd2140c6-metrics-client-ca\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.475360 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.475231    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77c26077-8bce-47b7-9093-4f02dd2140c6-node-exporter-textfile\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.475360 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.475272    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77c26077-8bce-47b7-9093-4f02dd2140c6-root\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.475360 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.475295    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77c26077-8bce-47b7-9093-4f02dd2140c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.486861 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.486837    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:58.576053 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.576030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77c26077-8bce-47b7-9093-4f02dd2140c6-root\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.576187 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.576059    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77c26077-8bce-47b7-9093-4f02dd2140c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.576187 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.576081    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77c26077-8bce-47b7-9093-4f02dd2140c6-node-exporter-wtmp\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.576187 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.576114    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77c26077-8bce-47b7-9093-4f02dd2140c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.576187 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.576135    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/77c26077-8bce-47b7-9093-4f02dd2140c6-root\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.576187 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.576148    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfn2f\" (UniqueName: \"kubernetes.io/projected/77c26077-8bce-47b7-9093-4f02dd2140c6-kube-api-access-cfn2f\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.576187 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.576185    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77c26077-8bce-47b7-9093-4f02dd2140c6-sys\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.576489 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.576218    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77c26077-8bce-47b7-9093-4f02dd2140c6-node-exporter-tls\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.576489 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.576262    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77c26077-8bce-47b7-9093-4f02dd2140c6-metrics-client-ca\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.576489 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.576287    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77c26077-8bce-47b7-9093-4f02dd2140c6-node-exporter-textfile\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.576639 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.576533    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/77c26077-8bce-47b7-9093-4f02dd2140c6-node-exporter-wtmp\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.576639 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.576571    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/77c26077-8bce-47b7-9093-4f02dd2140c6-node-exporter-textfile\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.576639 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.576616    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77c26077-8bce-47b7-9093-4f02dd2140c6-sys\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.576815 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.576780    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/77c26077-8bce-47b7-9093-4f02dd2140c6-node-exporter-accelerators-collector-config\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.577374 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.577349    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77c26077-8bce-47b7-9093-4f02dd2140c6-metrics-client-ca\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.578973 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.578933    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/77c26077-8bce-47b7-9093-4f02dd2140c6-node-exporter-tls\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.579160 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.579140    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77c26077-8bce-47b7-9093-4f02dd2140c6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.583687 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.583653    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:58.584633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.584610    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfn2f\" (UniqueName: \"kubernetes.io/projected/77c26077-8bce-47b7-9093-4f02dd2140c6-kube-api-access-cfn2f\") pod \"node-exporter-2jlrp\" (UID: \"77c26077-8bce-47b7-9093-4f02dd2140c6\") " pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.683214 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.683155    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2jlrp"
Jul 02 21:35:58.684679 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.684649    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:58.691880 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:35:58.691859    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c26077_8bce_47b7_9093_4f02dd2140c6.slice/crio-f60c36e18f8bad70dc9f3d345670fd1cc67f26332982e7464393c5c1cea663f3 WatchSource:0}: Error finding container f60c36e18f8bad70dc9f3d345670fd1cc67f26332982e7464393c5c1cea663f3: Status 404 returned error can't find the container with id f60c36e18f8bad70dc9f3d345670fd1cc67f26332982e7464393c5c1cea663f3
Jul 02 21:35:58.800671 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.800645    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:58.979696 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:58.979619    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:59.234611 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.234536    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:59.334433 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.334400    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:59.367139 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.367111    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2jlrp" event={"ID":"77c26077-8bce-47b7-9093-4f02dd2140c6","Type":"ContainerStarted","Data":"f60c36e18f8bad70dc9f3d345670fd1cc67f26332982e7464393c5c1cea663f3"}
Jul 02 21:35:59.445362 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.445311    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:59.452761 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.452733    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:35:59.456147 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.456086    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.460074 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.460039    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 02 21:35:59.460174 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.460091    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 02 21:35:59.460174 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.460115    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 02 21:35:59.460174 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.460126    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jw6zl\""
Jul 02 21:35:59.460278 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.460044    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 02 21:35:59.460328 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.460312    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 02 21:35:59.460398 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.460376    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 02 21:35:59.460455 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.460379    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 02 21:35:59.460455 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.460318    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 02 21:35:59.460556 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.460513    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 02 21:35:59.474069 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.474046    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:35:59.483908 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.483885    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6br9k\" (UniqueName: \"kubernetes.io/projected/0eb16785-edb3-4ceb-b570-b72875241bf9-kube-api-access-6br9k\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.484034 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.483929    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-web-config\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.484034 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.483956    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.484034 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.483982    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.484186 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.484036    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eb16785-edb3-4ceb-b570-b72875241bf9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.484186 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.484062    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.484186 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.484108    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0eb16785-edb3-4ceb-b570-b72875241bf9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.484186 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.484133    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-config-volume\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.484377 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.484173    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0eb16785-edb3-4ceb-b570-b72875241bf9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.484377 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.484240    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0eb16785-edb3-4ceb-b570-b72875241bf9-config-out\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.484377 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.484271    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0eb16785-edb3-4ceb-b570-b72875241bf9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.484377 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.484342    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.484530 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.484402    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.540616 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.540528    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:35:59.585233 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.585216    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0eb16785-edb3-4ceb-b570-b72875241bf9-config-out\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.585336 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.585245    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0eb16785-edb3-4ceb-b570-b72875241bf9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.585336 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.585264    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.585336 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.585288    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.585336 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.585320    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6br9k\" (UniqueName: \"kubernetes.io/projected/0eb16785-edb3-4ceb-b570-b72875241bf9-kube-api-access-6br9k\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.585566 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.585342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-web-config\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.585566 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.585358    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.585566 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.585381    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.585732 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.585626    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eb16785-edb3-4ceb-b570-b72875241bf9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.585732 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.585667    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.585732 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.585712    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0eb16785-edb3-4ceb-b570-b72875241bf9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.585867 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.585731    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-config-volume\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.585867 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.585750    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0eb16785-edb3-4ceb-b570-b72875241bf9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.586264 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.586125    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0eb16785-edb3-4ceb-b570-b72875241bf9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.586554 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:35:59.586353    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0eb16785-edb3-4ceb-b570-b72875241bf9-alertmanager-trusted-ca-bundle podName:0eb16785-edb3-4ceb-b570-b72875241bf9 nodeName:}" failed. No retries permitted until 2026-07-02 21:36:00.086331945 +0000 UTC m=+293.123811251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/0eb16785-edb3-4ceb-b570-b72875241bf9-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "0eb16785-edb3-4ceb-b570-b72875241bf9") : configmap references non-existent config key: ca-bundle.crt
Jul 02 21:35:59.586774 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.586751    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0eb16785-edb3-4ceb-b570-b72875241bf9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.588511 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.588481    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.588912 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.588895    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0eb16785-edb3-4ceb-b570-b72875241bf9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.589021 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.588911    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0eb16785-edb3-4ceb-b570-b72875241bf9-config-out\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.589021 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.588954    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.589236 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.589211    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.589310 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.589295    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-config-volume\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.589453 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.589431    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-web-config\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.590463 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.590444    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.591391 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.591371    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:35:59.597573 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:35:59.597555    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6br9k\" (UniqueName: \"kubernetes.io/projected/0eb16785-edb3-4ceb-b570-b72875241bf9-kube-api-access-6br9k\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:36:00.089658 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:00.089627    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eb16785-edb3-4ceb-b570-b72875241bf9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:36:00.090362 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:00.090345    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eb16785-edb3-4ceb-b570-b72875241bf9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:36:00.367460 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:00.367431    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:36:00.371456 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:00.371430    2575 generic.go:356] "Generic (PLEG): container finished" podID="77c26077-8bce-47b7-9093-4f02dd2140c6" containerID="c0944bca0c2ebc8d871662f1369b416bf407ce3f4232de32c33a931d2e8d48c6" exitCode=0
Jul 02 21:36:00.371576 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:00.371502    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2jlrp" event={"ID":"77c26077-8bce-47b7-9093-4f02dd2140c6","Type":"ContainerDied","Data":"c0944bca0c2ebc8d871662f1369b416bf407ce3f4232de32c33a931d2e8d48c6"}
Jul 02 21:36:00.513584 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:00.513511    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:36:00.516380 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:36:00.516356    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb16785_edb3_4ceb_b570_b72875241bf9.slice/crio-12086091e588bf75073e05770bdece7ec92f4c4ea4a1417b5d19ec1fc404a9bc WatchSource:0}: Error finding container 12086091e588bf75073e05770bdece7ec92f4c4ea4a1417b5d19ec1fc404a9bc: Status 404 returned error can't find the container with id 12086091e588bf75073e05770bdece7ec92f4c4ea4a1417b5d19ec1fc404a9bc
Jul 02 21:36:01.280363 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:01.280327    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:01.334369 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:01.334339    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:01.379351 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:01.379030    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2jlrp" event={"ID":"77c26077-8bce-47b7-9093-4f02dd2140c6","Type":"ContainerStarted","Data":"1f79236b29f25733a7679bbd239ef06d974b4852f8ddd8ed71d82de43001763e"}
Jul 02 21:36:01.379351 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:01.379117    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2jlrp" event={"ID":"77c26077-8bce-47b7-9093-4f02dd2140c6","Type":"ContainerStarted","Data":"a0915a3bc8e229d9d8c96f9bfccc52195db4651341e5a8429411e843199158b2"}
Jul 02 21:36:01.380598 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:01.380565    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0eb16785-edb3-4ceb-b570-b72875241bf9","Type":"ContainerStarted","Data":"12086091e588bf75073e05770bdece7ec92f4c4ea4a1417b5d19ec1fc404a9bc"}
Jul 02 21:36:01.406684 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:01.406632    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2jlrp" podStartSLOduration=2.49398291 podStartE2EDuration="3.40661328s" totalImagesPullingTime="849.774738ms" totalInitContainerRuntime="62.855632ms" isStatefulPod=true podCreationTimestamp="2026-07-02 21:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:01.401188121 +0000 UTC m=+294.438667431" watchObservedRunningTime="2026-07-02 21:36:01.40661328 +0000 UTC m=+294.444092589"
Jul 02 21:36:01.729495 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:01.729441    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:01.830079 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:01.830053    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:02.385695 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.385664    2575 generic.go:356] "Generic (PLEG): container finished" podID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerID="ef24e8abdd9c80489c541f9682a8098f54d6a72cd45b25d693b179b90befa37c" exitCode=0
Jul 02 21:36:02.386113 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.385750    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0eb16785-edb3-4ceb-b570-b72875241bf9","Type":"ContainerDied","Data":"ef24e8abdd9c80489c541f9682a8098f54d6a72cd45b25d693b179b90befa37c"}
Jul 02 21:36:02.520436 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:36:02.520405    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-d8wzk" podUID="ad9a4f7b-552f-469a-be1b-7ab6b4bd3740"
Jul 02 21:36:02.644735 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.644672    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5867c5989b-kd45z"]
Jul 02 21:36:02.646607 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.646593    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.649169 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.649149    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 02 21:36:02.649276 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.649170    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 21:36:02.650200 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.650183    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 02 21:36:02.650313 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.650269    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1n3878th5tfrk\""
Jul 02 21:36:02.650313 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.650294    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 02 21:36:02.650443 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.650271    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ggmws\""
Jul 02 21:36:02.657676 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.657659    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5867c5989b-kd45z"]
Jul 02 21:36:02.710404 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.710380    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0d04206a-a21a-4340-a523-b57ffafedcb2-metrics-server-audit-profiles\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.710489 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.710410    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d04206a-a21a-4340-a523-b57ffafedcb2-client-ca-bundle\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.710489 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.710442    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0d04206a-a21a-4340-a523-b57ffafedcb2-secret-metrics-server-client-certs\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.710489 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.710478    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0d04206a-a21a-4340-a523-b57ffafedcb2-audit-log\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.710615 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.710503    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0d04206a-a21a-4340-a523-b57ffafedcb2-secret-metrics-server-tls\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.710615 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.710557    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wfkl\" (UniqueName: \"kubernetes.io/projected/0d04206a-a21a-4340-a523-b57ffafedcb2-kube-api-access-6wfkl\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.710615 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.710597    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d04206a-a21a-4340-a523-b57ffafedcb2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.811314 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.811289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0d04206a-a21a-4340-a523-b57ffafedcb2-secret-metrics-server-client-certs\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.811392 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.811317    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0d04206a-a21a-4340-a523-b57ffafedcb2-audit-log\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.811392 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.811338    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0d04206a-a21a-4340-a523-b57ffafedcb2-secret-metrics-server-tls\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.811551 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.811532    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wfkl\" (UniqueName: \"kubernetes.io/projected/0d04206a-a21a-4340-a523-b57ffafedcb2-kube-api-access-6wfkl\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.811609 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.811577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d04206a-a21a-4340-a523-b57ffafedcb2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.811660 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.811606    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0d04206a-a21a-4340-a523-b57ffafedcb2-metrics-server-audit-profiles\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.811660 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.811641    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d04206a-a21a-4340-a523-b57ffafedcb2-client-ca-bundle\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.811660 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.811645    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0d04206a-a21a-4340-a523-b57ffafedcb2-audit-log\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.812307 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.812284    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d04206a-a21a-4340-a523-b57ffafedcb2-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.812766 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.812741    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0d04206a-a21a-4340-a523-b57ffafedcb2-metrics-server-audit-profiles\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.813819 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.813793    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0d04206a-a21a-4340-a523-b57ffafedcb2-secret-metrics-server-tls\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.813887 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.813868    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0d04206a-a21a-4340-a523-b57ffafedcb2-secret-metrics-server-client-certs\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.814077 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.814058    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0d04206a-a21a-4340-a523-b57ffafedcb2-client-ca-bundle\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.819263 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.819247    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wfkl\" (UniqueName: \"kubernetes.io/projected/0d04206a-a21a-4340-a523-b57ffafedcb2-kube-api-access-6wfkl\") pod \"metrics-server-5867c5989b-kd45z\" (UID: \"0d04206a-a21a-4340-a523-b57ffafedcb2\") " pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:02.955847 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:02.955792    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:03.091609 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:03.091582    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5867c5989b-kd45z"]
Jul 02 21:36:03.095449 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:36:03.095418    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d04206a_a21a_4340_a523_b57ffafedcb2.slice/crio-c0d24b6144b52b327cf3aeb686830c970a0efe52eb44517dc356fee25dc28bc1 WatchSource:0}: Error finding container c0d24b6144b52b327cf3aeb686830c970a0efe52eb44517dc356fee25dc28bc1: Status 404 returned error can't find the container with id c0d24b6144b52b327cf3aeb686830c970a0efe52eb44517dc356fee25dc28bc1
Jul 02 21:36:03.109746 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:03.109720    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:03.391396 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:03.391363    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5867c5989b-kd45z" event={"ID":"0d04206a-a21a-4340-a523-b57ffafedcb2","Type":"ContainerStarted","Data":"c0d24b6144b52b327cf3aeb686830c970a0efe52eb44517dc356fee25dc28bc1"}
Jul 02 21:36:03.526533 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:03.526489    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:04.398315 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.398282    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0eb16785-edb3-4ceb-b570-b72875241bf9","Type":"ContainerStarted","Data":"7653659f38801df53bb4faabfb088226f9b250003b4187611bc50a7dc1adc994"}
Jul 02 21:36:04.398710 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.398390    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0eb16785-edb3-4ceb-b570-b72875241bf9","Type":"ContainerStarted","Data":"03fc1d679fe876f027602b7e0577023a17939533a6398d33396a7f93e164eb65"}
Jul 02 21:36:04.398710 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.398440    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0eb16785-edb3-4ceb-b570-b72875241bf9","Type":"ContainerStarted","Data":"7c91f08cc192bcbcfd83e201b4ea7b4d4ce7fdd26b75ab2191b1669003d0a622"}
Jul 02 21:36:04.398710 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.398479    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0eb16785-edb3-4ceb-b570-b72875241bf9","Type":"ContainerStarted","Data":"5a36c80684ab0ded2a60b914ae81072c8eb7be8852789aa0d191da2d4443326a"}
Jul 02 21:36:04.580426 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.580392    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:04.582567 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.582540    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 21:36:04.585978 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.585962    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.588495 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.588476    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 21:36:04.588575 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.588546    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2mdonv2r5reua\""
Jul 02 21:36:04.589234 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.589210    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 21:36:04.589234 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.589224    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8lnqx\""
Jul 02 21:36:04.589370 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.589218    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 21:36:04.589614 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.589218    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 21:36:04.589800 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.589779    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 21:36:04.590301 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.590045    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 21:36:04.590301 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.590095    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 21:36:04.590301 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.590160    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 21:36:04.590301 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.590234    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 21:36:04.590552 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.590316    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 21:36:04.590552 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.590337    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 21:36:04.590552 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.590414    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 21:36:04.590979 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.590964    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 21:36:04.592379 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.592331    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 21:36:04.607063 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.607040    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 21:36:04.627513 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.627495    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.627607 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.627529    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97xq7\" (UniqueName: \"kubernetes.io/projected/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-kube-api-access-97xq7\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.627607 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.627577    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.627607 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.627593    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.627722 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.627612    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.627722 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.627628    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.627722 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.627654    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.627722 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.627702    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.627892 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.627779    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.627892 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.627843    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.627892 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.627864    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.627892 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.627880    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.628114 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.627910    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.628114 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.627944    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.628114 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.628001    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-config\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.628114 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.628054    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.628114 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.628083    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.628114 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.628108    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.628317 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.628141    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.628317 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.628176    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.729602 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.729531    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.729602 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.729568    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97xq7\" (UniqueName: \"kubernetes.io/projected/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-kube-api-access-97xq7\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.729602 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.729593    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.729840 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.729785    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.729840 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.729829    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.729948 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.729861    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.729948 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.729901    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.729948 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.729930    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.730136 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.729959    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.730136 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.729992    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.730136 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.730052    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.730136 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.730077    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.730136 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.730100    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.730136 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.730106    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.730136 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.730131    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.730479 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.730178    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-config\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.730479 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.730207    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.730479 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.730237    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.730479 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.730304    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.730479 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.730434    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.730969 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.730945    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.731195 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.731163    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.731324 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.731303    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.731412 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.731357    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.731412 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.731392    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.731564 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.731426    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.732184 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.732157    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.733578 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.733551    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-config\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.734151 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.734124    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.735303 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.734839    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.735303 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.734924    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.735303 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.734931    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.735540 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.735373    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.735540 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.735388    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.735795 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.735775    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-web-config\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.736041 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.735997    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-config-out\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.736183 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.736165    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.736442 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.736425    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.736515 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.736426    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.737675 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.737656    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97xq7\" (UniqueName: \"kubernetes.io/projected/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-kube-api-access-97xq7\") pod \"prometheus-k8s-0\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:04.913480 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:04.913447    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:05.051307 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:05.051204    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 21:36:05.056089 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:36:05.056057    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8748fbf6_b3f2_42bb_b0e9_fdd519e802d2.slice/crio-c0c9619899ee9fbf5e6085136d6e7e887528fe20d57829e4de63ce0c2684a71e WatchSource:0}: Error finding container c0c9619899ee9fbf5e6085136d6e7e887528fe20d57829e4de63ce0c2684a71e: Status 404 returned error can't find the container with id c0c9619899ee9fbf5e6085136d6e7e887528fe20d57829e4de63ce0c2684a71e
Jul 02 21:36:05.356633 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:05.356607    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hmsc8"
Jul 02 21:36:05.405179 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:05.405140    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5867c5989b-kd45z" event={"ID":"0d04206a-a21a-4340-a523-b57ffafedcb2","Type":"ContainerStarted","Data":"3ac7908be587d10eccd591b2900b465889fb63eb589f1a682eb820b771f4f6c2"}
Jul 02 21:36:05.407052 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:05.407028    2575 generic.go:356] "Generic (PLEG): container finished" podID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerID="47f03c10520d10355d1be8b3f009c0ed1bd517feed9bd1490823d8f7d3dc1a7a" exitCode=0
Jul 02 21:36:05.407172 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:05.407140    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2","Type":"ContainerDied","Data":"47f03c10520d10355d1be8b3f009c0ed1bd517feed9bd1490823d8f7d3dc1a7a"}
Jul 02 21:36:05.407233 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:05.407208    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2","Type":"ContainerStarted","Data":"c0c9619899ee9fbf5e6085136d6e7e887528fe20d57829e4de63ce0c2684a71e"}
Jul 02 21:36:05.411265 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:05.411213    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0eb16785-edb3-4ceb-b570-b72875241bf9","Type":"ContainerStarted","Data":"c51aac9c90dc2d4e580d6b7dbb26e7b46cebc103cf632c1492c97037ea67aff3"}
Jul 02 21:36:05.422889 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:05.422833    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5867c5989b-kd45z" podStartSLOduration=1.957252244 podStartE2EDuration="3.422819441s" totalImagesPullingTime="1.465567197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:05.421432062 +0000 UTC m=+298.458911392" watchObservedRunningTime="2026-07-02 21:36:05.422819441 +0000 UTC m=+298.460298749"
Jul 02 21:36:05.685270 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:05.685198    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:05.739480 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:05.739453    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:05.842516 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:05.842486    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:05.939549 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:05.939487    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:05.996395 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:05.996365    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:06.357001 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:06.356974    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:06.411020 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:06.410949    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:06.419986 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:06.419959    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0eb16785-edb3-4ceb-b570-b72875241bf9","Type":"ContainerStarted","Data":"8388695eeb9a3d0ad7a16d1e51e68aba7d9806435ba6fdab9b918837011faa09"}
Jul 02 21:36:06.448698 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:06.448656    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.7121585870000002 podStartE2EDuration="7.448638037s" totalImagesPullingTime="3.719851795s" totalInitContainerRuntime="16.627655ms" isStatefulPod=false podCreationTimestamp="2026-07-02 21:35:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:06.447607997 +0000 UTC m=+299.485087306" watchObservedRunningTime="2026-07-02 21:36:06.448638037 +0000 UTC m=+299.486117345"
Jul 02 21:36:06.754916 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:06.754843    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:06.809188 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:06.809157    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:07.112609 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:07.112574    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:07.213831 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:07.213801    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:07.384432 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:07.384371    2575 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 21:36:07.565050 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:07.564834    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:07.765636 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:07.765535    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:07.917096 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:07.917044    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:08.877454 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:08.877435    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 21:36:09.182878 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:09.182850    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:09.239067 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:09.239041    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:09.438478 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:09.438397    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2","Type":"ContainerStarted","Data":"032d5c58856977eeb44ec670c8a42f7815f692df933178c31030f80833ca868f"}
Jul 02 21:36:09.438609 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:09.438484    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2","Type":"ContainerStarted","Data":"e501733daf38214145a89221d2e3bbca810409a9005c79b58978a16334fd2a3c"}
Jul 02 21:36:10.145722 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:10.145682    2575 patch_prober.go:28] interesting pod/image-registry-79c7886d7b-qks2t container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 21:36:10.146193 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:10.145748    2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-79c7886d7b-qks2t" podUID="7323c660-49e7-4690-9457-8ff1780fd89e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 21:36:11.338875 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:11.338809    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-79c7886d7b-qks2t"
Jul 02 21:36:11.449707 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:11.449666    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2","Type":"ContainerStarted","Data":"857f8a6195b17b1e09d5f5a003c459679c181c7ddd18cbba40c5e4f5b80c0c10"}
Jul 02 21:36:11.449875 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:11.449744    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2","Type":"ContainerStarted","Data":"58237ad986959d50e7d724552b927d4374b2ab396154a96901795b65ade8d13c"}
Jul 02 21:36:11.449875 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:11.449782    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2","Type":"ContainerStarted","Data":"0f77f0cd2411b701039f0bfee156b661bd727a5682eb75e75e46f05441079d84"}
Jul 02 21:36:11.449875 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:11.449818    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2","Type":"ContainerStarted","Data":"75940637967f5be2de91ec7bf18510d08ef073bb5179d0a7e261d752c6c51052"}
Jul 02 21:36:11.477949 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:11.477914    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:11.479270 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:11.479223    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.079222241 podStartE2EDuration="7.479205946s" totalImagesPullingTime="5.373187411s" totalInitContainerRuntime="26.796294ms" isStatefulPod=false podCreationTimestamp="2026-07-02 21:36:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:36:11.477086361 +0000 UTC m=+304.514565679" watchObservedRunningTime="2026-07-02 21:36:11.479205946 +0000 UTC m=+304.516685254"
Jul 02 21:36:11.579186 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:11.579161    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:11.672548 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:11.672499    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:12.726811 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:12.726779    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:12.779556 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:12.779530    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:14.225594 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:14.225562    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:14.326542 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:14.326517    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:14.519418 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:14.519359    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:36:14.913920 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:14.913895    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:36:20.851802 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:20.851768    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:20.903263 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:20.903233    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:21.598594 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:21.598562    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:22.956747 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:22.956712    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:22.957095 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:22.956770    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:23.236422 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:23.236341    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:23.336252 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:23.336225    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:25.206707 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:25.206675    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:25.309741 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:25.309705    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:27.726183 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:27.726152    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:27.825755 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:27.825725    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:29.924591 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:29.924562    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:30.028430 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:30.028402    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:31.408405 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:31.408369    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:31.465480 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:31.465448    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:34.191041 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:34.190989    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:34.245279 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:34.245255    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:42.724864 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:42.724823    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:42.828433 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:42.828398    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:42.961199 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:42.961170    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:42.964997 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:42.964966    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5867c5989b-kd45z"
Jul 02 21:36:48.580473 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:48.580439    2575 generic.go:356] "Generic (PLEG): container finished" podID="ff158097-815f-4969-aa21-8352654fd18f" containerID="31ce372fee6e2e710c01bf2a01f8bee034b7aeb56bbad95891c92bf8ef251c97" exitCode=0
Jul 02 21:36:48.580769 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:48.580485    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx" event={"ID":"ff158097-815f-4969-aa21-8352654fd18f","Type":"ContainerDied","Data":"31ce372fee6e2e710c01bf2a01f8bee034b7aeb56bbad95891c92bf8ef251c97"}
Jul 02 21:36:48.580806 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:48.580774    2575 scope.go:117] "RemoveContainer" containerID="31ce372fee6e2e710c01bf2a01f8bee034b7aeb56bbad95891c92bf8ef251c97"
Jul 02 21:36:49.585606 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:49.585572    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-jmfnx" event={"ID":"ff158097-815f-4969-aa21-8352654fd18f","Type":"ContainerStarted","Data":"0843043405e52c790c7f713e6e543c8468d33e5c356c1adf38e89c88224f0cd9"}
Jul 02 21:36:54.493942 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:54.493901    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:36:54.604686 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:54.604653    2575 generic.go:356] "Generic (PLEG): container finished" podID="008eabf7-ce57-4467-8eb0-dd94a34f2147" containerID="da753be2b85712ab898a64c80e542c916c979b8d4b08162ca931a6ba2782f2ff" exitCode=0
Jul 02 21:36:54.604838 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:54.604726    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn" event={"ID":"008eabf7-ce57-4467-8eb0-dd94a34f2147","Type":"ContainerDied","Data":"da753be2b85712ab898a64c80e542c916c979b8d4b08162ca931a6ba2782f2ff"}
Jul 02 21:36:54.605102 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:54.605084    2575 scope.go:117] "RemoveContainer" containerID="da753be2b85712ab898a64c80e542c916c979b8d4b08162ca931a6ba2782f2ff"
Jul 02 21:36:54.606376 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:54.606356    2575 generic.go:356] "Generic (PLEG): container finished" podID="2105cd7b-38da-4788-8094-fd92efcff9bc" containerID="40a6a87c3738565d88acac3884513e378a31fa201f08a3cf348828b80a4bfcef" exitCode=0
Jul 02 21:36:54.606432 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:54.606396    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6" event={"ID":"2105cd7b-38da-4788-8094-fd92efcff9bc","Type":"ContainerDied","Data":"40a6a87c3738565d88acac3884513e378a31fa201f08a3cf348828b80a4bfcef"}
Jul 02 21:36:54.606688 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:54.606674    2575 scope.go:117] "RemoveContainer" containerID="40a6a87c3738565d88acac3884513e378a31fa201f08a3cf348828b80a4bfcef"
Jul 02 21:36:55.613199 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:55.613167    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-x7dqn" event={"ID":"008eabf7-ce57-4467-8eb0-dd94a34f2147","Type":"ContainerStarted","Data":"148e91d88665e4cd409fb57597819af90a716c9cd105c0196de320ed1f13d962"}
Jul 02 21:36:55.615140 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:36:55.615105    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-jmfq6" event={"ID":"2105cd7b-38da-4788-8094-fd92efcff9bc","Type":"ContainerStarted","Data":"af1b303149f6aadc87c4e64940712130ed3382253082a6c959183e890d36c4c1"}
Jul 02 21:37:04.913931 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:04.913838    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:04.933792 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:04.933768    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:05.673685 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:05.673663    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:17.539142 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:17.539110    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:37:18.193666 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:18.193629    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:37:18.591585 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:18.591505    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:37:18.591956 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:18.591779    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="alertmanager" containerID="cri-o://5a36c80684ab0ded2a60b914ae81072c8eb7be8852789aa0d191da2d4443326a" gracePeriod=120
Jul 02 21:37:18.591956 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:18.591835    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="kube-rbac-proxy-metric" containerID="cri-o://c51aac9c90dc2d4e580d6b7dbb26e7b46cebc103cf632c1492c97037ea67aff3" gracePeriod=120
Jul 02 21:37:18.591956 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:18.591898    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="prom-label-proxy" containerID="cri-o://8388695eeb9a3d0ad7a16d1e51e68aba7d9806435ba6fdab9b918837011faa09" gracePeriod=120
Jul 02 21:37:18.591956 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:18.591947    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="kube-rbac-proxy" containerID="cri-o://7653659f38801df53bb4faabfb088226f9b250003b4187611bc50a7dc1adc994" gracePeriod=120
Jul 02 21:37:18.592216 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:18.591934    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="config-reloader" containerID="cri-o://7c91f08cc192bcbcfd83e201b4ea7b4d4ce7fdd26b75ab2191b1669003d0a622" gracePeriod=120
Jul 02 21:37:18.592216 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:18.591908    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="kube-rbac-proxy-web" containerID="cri-o://03fc1d679fe876f027602b7e0577023a17939533a6398d33396a7f93e164eb65" gracePeriod=120
Jul 02 21:37:18.712294 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:18.712264    2575 generic.go:356] "Generic (PLEG): container finished" podID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerID="8388695eeb9a3d0ad7a16d1e51e68aba7d9806435ba6fdab9b918837011faa09" exitCode=0
Jul 02 21:37:18.712294 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:18.712290    2575 generic.go:356] "Generic (PLEG): container finished" podID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerID="7653659f38801df53bb4faabfb088226f9b250003b4187611bc50a7dc1adc994" exitCode=0
Jul 02 21:37:18.712294 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:18.712296    2575 generic.go:356] "Generic (PLEG): container finished" podID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerID="7c91f08cc192bcbcfd83e201b4ea7b4d4ce7fdd26b75ab2191b1669003d0a622" exitCode=0
Jul 02 21:37:18.712467 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:18.712303    2575 generic.go:356] "Generic (PLEG): container finished" podID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerID="5a36c80684ab0ded2a60b914ae81072c8eb7be8852789aa0d191da2d4443326a" exitCode=0
Jul 02 21:37:18.712467 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:18.712335    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0eb16785-edb3-4ceb-b570-b72875241bf9","Type":"ContainerDied","Data":"8388695eeb9a3d0ad7a16d1e51e68aba7d9806435ba6fdab9b918837011faa09"}
Jul 02 21:37:18.712467 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:18.712396    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0eb16785-edb3-4ceb-b570-b72875241bf9","Type":"ContainerDied","Data":"7653659f38801df53bb4faabfb088226f9b250003b4187611bc50a7dc1adc994"}
Jul 02 21:37:18.712467 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:18.712422    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0eb16785-edb3-4ceb-b570-b72875241bf9","Type":"ContainerDied","Data":"7c91f08cc192bcbcfd83e201b4ea7b4d4ce7fdd26b75ab2191b1669003d0a622"}
Jul 02 21:37:18.712467 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:18.712447    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0eb16785-edb3-4ceb-b570-b72875241bf9","Type":"ContainerDied","Data":"5a36c80684ab0ded2a60b914ae81072c8eb7be8852789aa0d191da2d4443326a"}
Jul 02 21:37:19.719298 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.719272    2575 generic.go:356] "Generic (PLEG): container finished" podID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerID="c51aac9c90dc2d4e580d6b7dbb26e7b46cebc103cf632c1492c97037ea67aff3" exitCode=0
Jul 02 21:37:19.719298 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.719295    2575 generic.go:356] "Generic (PLEG): container finished" podID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerID="03fc1d679fe876f027602b7e0577023a17939533a6398d33396a7f93e164eb65" exitCode=0
Jul 02 21:37:19.719606 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.719340    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0eb16785-edb3-4ceb-b570-b72875241bf9","Type":"ContainerDied","Data":"c51aac9c90dc2d4e580d6b7dbb26e7b46cebc103cf632c1492c97037ea67aff3"}
Jul 02 21:37:19.719606 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.719406    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0eb16785-edb3-4ceb-b570-b72875241bf9","Type":"ContainerDied","Data":"03fc1d679fe876f027602b7e0577023a17939533a6398d33396a7f93e164eb65"}
Jul 02 21:37:19.843992 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.843968    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:19.967613 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.967543    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6br9k\" (UniqueName: \"kubernetes.io/projected/0eb16785-edb3-4ceb-b570-b72875241bf9-kube-api-access-6br9k\") pod \"0eb16785-edb3-4ceb-b570-b72875241bf9\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") "
Jul 02 21:37:19.967613 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.967576    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy\") pod \"0eb16785-edb3-4ceb-b570-b72875241bf9\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") "
Jul 02 21:37:19.967613 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.967595    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-config-volume\") pod \"0eb16785-edb3-4ceb-b570-b72875241bf9\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") "
Jul 02 21:37:19.967867 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.967623    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eb16785-edb3-4ceb-b570-b72875241bf9-alertmanager-trusted-ca-bundle\") pod \"0eb16785-edb3-4ceb-b570-b72875241bf9\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") "
Jul 02 21:37:19.967867 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.967766    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0eb16785-edb3-4ceb-b570-b72875241bf9-config-out\") pod \"0eb16785-edb3-4ceb-b570-b72875241bf9\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") "
Jul 02 21:37:19.967867 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.967818    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-web-config\") pod \"0eb16785-edb3-4ceb-b570-b72875241bf9\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") "
Jul 02 21:37:19.967867 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.967864    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0eb16785-edb3-4ceb-b570-b72875241bf9-alertmanager-main-db\") pod \"0eb16785-edb3-4ceb-b570-b72875241bf9\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") "
Jul 02 21:37:19.968083 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.967941    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-cluster-tls-config\") pod \"0eb16785-edb3-4ceb-b570-b72875241bf9\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") "
Jul 02 21:37:19.968083 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.967984    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0eb16785-edb3-4ceb-b570-b72875241bf9\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") "
Jul 02 21:37:19.968083 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.968040    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0eb16785-edb3-4ceb-b570-b72875241bf9-tls-assets\") pod \"0eb16785-edb3-4ceb-b570-b72875241bf9\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") "
Jul 02 21:37:19.968083 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.968044    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eb16785-edb3-4ceb-b570-b72875241bf9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0eb16785-edb3-4ceb-b570-b72875241bf9" (UID: "0eb16785-edb3-4ceb-b570-b72875241bf9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:37:19.968083 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.968068    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0eb16785-edb3-4ceb-b570-b72875241bf9-metrics-client-ca\") pod \"0eb16785-edb3-4ceb-b570-b72875241bf9\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") "
Jul 02 21:37:19.968313 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.968122    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy-web\") pod \"0eb16785-edb3-4ceb-b570-b72875241bf9\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") "
Jul 02 21:37:19.968313 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.968163    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-main-tls\") pod \"0eb16785-edb3-4ceb-b570-b72875241bf9\" (UID: \"0eb16785-edb3-4ceb-b570-b72875241bf9\") "
Jul 02 21:37:19.968408 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.968321    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eb16785-edb3-4ceb-b570-b72875241bf9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0eb16785-edb3-4ceb-b570-b72875241bf9" (UID: "0eb16785-edb3-4ceb-b570-b72875241bf9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:37:19.968536 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.968512    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0eb16785-edb3-4ceb-b570-b72875241bf9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:19.968609 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.968539    2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0eb16785-edb3-4ceb-b570-b72875241bf9-alertmanager-main-db\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:19.969134 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.969094    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eb16785-edb3-4ceb-b570-b72875241bf9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0eb16785-edb3-4ceb-b570-b72875241bf9" (UID: "0eb16785-edb3-4ceb-b570-b72875241bf9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:37:19.970219 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.970182    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0eb16785-edb3-4ceb-b570-b72875241bf9" (UID: "0eb16785-edb3-4ceb-b570-b72875241bf9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:19.970393 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.970350    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eb16785-edb3-4ceb-b570-b72875241bf9-kube-api-access-6br9k" (OuterVolumeSpecName: "kube-api-access-6br9k") pod "0eb16785-edb3-4ceb-b570-b72875241bf9" (UID: "0eb16785-edb3-4ceb-b570-b72875241bf9"). InnerVolumeSpecName "kube-api-access-6br9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:37:19.970591 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.970566    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eb16785-edb3-4ceb-b570-b72875241bf9-config-out" (OuterVolumeSpecName: "config-out") pod "0eb16785-edb3-4ceb-b570-b72875241bf9" (UID: "0eb16785-edb3-4ceb-b570-b72875241bf9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:37:19.970676 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.970604    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0eb16785-edb3-4ceb-b570-b72875241bf9" (UID: "0eb16785-edb3-4ceb-b570-b72875241bf9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:19.971345 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.971302    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-config-volume" (OuterVolumeSpecName: "config-volume") pod "0eb16785-edb3-4ceb-b570-b72875241bf9" (UID: "0eb16785-edb3-4ceb-b570-b72875241bf9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:19.971446 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.971337    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eb16785-edb3-4ceb-b570-b72875241bf9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0eb16785-edb3-4ceb-b570-b72875241bf9" (UID: "0eb16785-edb3-4ceb-b570-b72875241bf9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:37:19.971446 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.971338    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0eb16785-edb3-4ceb-b570-b72875241bf9" (UID: "0eb16785-edb3-4ceb-b570-b72875241bf9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:19.971937 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.971918    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0eb16785-edb3-4ceb-b570-b72875241bf9" (UID: "0eb16785-edb3-4ceb-b570-b72875241bf9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:19.976928 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.976903    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0eb16785-edb3-4ceb-b570-b72875241bf9" (UID: "0eb16785-edb3-4ceb-b570-b72875241bf9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:19.982820 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:19.982800    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-web-config" (OuterVolumeSpecName: "web-config") pod "0eb16785-edb3-4ceb-b570-b72875241bf9" (UID: "0eb16785-edb3-4ceb-b570-b72875241bf9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:20.069309 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.069284    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0eb16785-edb3-4ceb-b570-b72875241bf9-tls-assets\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:20.069309 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.069309    2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0eb16785-edb3-4ceb-b570-b72875241bf9-metrics-client-ca\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:20.069459 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.069324    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:20.069459 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.069339    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-main-tls\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:20.069459 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.069352    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6br9k\" (UniqueName: \"kubernetes.io/projected/0eb16785-edb3-4ceb-b570-b72875241bf9-kube-api-access-6br9k\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:20.069459 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.069365    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:20.069459 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.069377    2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-config-volume\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:20.069459 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.069390    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0eb16785-edb3-4ceb-b570-b72875241bf9-config-out\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:20.069459 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.069402    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-web-config\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:20.069459 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.069413    2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-cluster-tls-config\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:20.069459 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.069428    2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0eb16785-edb3-4ceb-b570-b72875241bf9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:20.597400 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.597370    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:37:20.649086 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.649064    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:37:20.726401 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.726371    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0eb16785-edb3-4ceb-b570-b72875241bf9","Type":"ContainerDied","Data":"12086091e588bf75073e05770bdece7ec92f4c4ea4a1417b5d19ec1fc404a9bc"}
Jul 02 21:37:20.726781 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.726449    2575 scope.go:117] "RemoveContainer" containerID="8388695eeb9a3d0ad7a16d1e51e68aba7d9806435ba6fdab9b918837011faa09"
Jul 02 21:37:20.726781 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.726380    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.734551 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.734532    2575 scope.go:117] "RemoveContainer" containerID="c51aac9c90dc2d4e580d6b7dbb26e7b46cebc103cf632c1492c97037ea67aff3"
Jul 02 21:37:20.741426 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.741409    2575 scope.go:117] "RemoveContainer" containerID="7653659f38801df53bb4faabfb088226f9b250003b4187611bc50a7dc1adc994"
Jul 02 21:37:20.749037 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.748989    2575 scope.go:117] "RemoveContainer" containerID="03fc1d679fe876f027602b7e0577023a17939533a6398d33396a7f93e164eb65"
Jul 02 21:37:20.749247 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.749226    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:37:20.754191 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.754172    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:37:20.756641 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.756626    2575 scope.go:117] "RemoveContainer" containerID="7c91f08cc192bcbcfd83e201b4ea7b4d4ce7fdd26b75ab2191b1669003d0a622"
Jul 02 21:37:20.763067 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.763047    2575 scope.go:117] "RemoveContainer" containerID="5a36c80684ab0ded2a60b914ae81072c8eb7be8852789aa0d191da2d4443326a"
Jul 02 21:37:20.769582 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.769568    2575 scope.go:117] "RemoveContainer" containerID="ef24e8abdd9c80489c541f9682a8098f54d6a72cd45b25d693b179b90befa37c"
Jul 02 21:37:20.780332 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780314    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:37:20.780568 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780557    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="kube-rbac-proxy-web"
Jul 02 21:37:20.780618 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780570    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="kube-rbac-proxy-web"
Jul 02 21:37:20.780618 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780580    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="prom-label-proxy"
Jul 02 21:37:20.780618 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780586    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="prom-label-proxy"
Jul 02 21:37:20.780618 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780595    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="init-config-reloader"
Jul 02 21:37:20.780618 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780599    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="init-config-reloader"
Jul 02 21:37:20.780618 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780607    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="alertmanager"
Jul 02 21:37:20.780618 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780611    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="alertmanager"
Jul 02 21:37:20.780618 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780617    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="kube-rbac-proxy"
Jul 02 21:37:20.780847 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780623    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="kube-rbac-proxy"
Jul 02 21:37:20.780847 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780629    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="kube-rbac-proxy-metric"
Jul 02 21:37:20.780847 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780634    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="kube-rbac-proxy-metric"
Jul 02 21:37:20.780847 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780646    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="config-reloader"
Jul 02 21:37:20.780847 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780650    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="config-reloader"
Jul 02 21:37:20.780847 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780695    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="kube-rbac-proxy-metric"
Jul 02 21:37:20.780847 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780702    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="alertmanager"
Jul 02 21:37:20.780847 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780708    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="config-reloader"
Jul 02 21:37:20.780847 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780713    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="kube-rbac-proxy"
Jul 02 21:37:20.780847 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780718    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="kube-rbac-proxy-web"
Jul 02 21:37:20.780847 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.780723    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" containerName="prom-label-proxy"
Jul 02 21:37:20.785405 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.785390    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.787942 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.787922    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 02 21:37:20.788053 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.787942    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 02 21:37:20.788314 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.788300    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 02 21:37:20.788468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.788454    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jw6zl\""
Jul 02 21:37:20.788652 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.788636    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 02 21:37:20.788652 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.788647    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 02 21:37:20.788781 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.788679    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 02 21:37:20.788781 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.788744    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 02 21:37:20.788975 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.788960    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 02 21:37:20.795544 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.795522    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 02 21:37:20.800205 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.800182    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:37:20.875342 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.875321    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45f7eea0-cf70-4d1d-b89a-875b1f14583e-config-out\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.875448 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.875351    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45f7eea0-cf70-4d1d-b89a-875b1f14583e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.875448 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.875369    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.875448 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.875390    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45f7eea0-cf70-4d1d-b89a-875b1f14583e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.875448 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.875407    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.875578 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.875457    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45f7eea0-cf70-4d1d-b89a-875b1f14583e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.875578 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.875482    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.875578 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.875513    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.875578 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.875568    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.875703 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.875603    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hthtf\" (UniqueName: \"kubernetes.io/projected/45f7eea0-cf70-4d1d-b89a-875b1f14583e-kube-api-access-hthtf\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.875703 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.875643    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-web-config\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.875703 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.875672    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-config-volume\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.875793 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.875708    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45f7eea0-cf70-4d1d-b89a-875b1f14583e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.976731 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.976698    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45f7eea0-cf70-4d1d-b89a-875b1f14583e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.976731 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.976737    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.976868 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.976760    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45f7eea0-cf70-4d1d-b89a-875b1f14583e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.976907 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.976877    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.976940 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.976914    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45f7eea0-cf70-4d1d-b89a-875b1f14583e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.976978 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.976939    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.977040 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.976985    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.977098 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.977055    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.977098 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.977083    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hthtf\" (UniqueName: \"kubernetes.io/projected/45f7eea0-cf70-4d1d-b89a-875b1f14583e-kube-api-access-hthtf\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.977198 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.977113    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-web-config\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.977198 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.977155    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-config-volume\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.977303 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.977195    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45f7eea0-cf70-4d1d-b89a-875b1f14583e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.977303 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.977224    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45f7eea0-cf70-4d1d-b89a-875b1f14583e-config-out\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.978252 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.977657    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/45f7eea0-cf70-4d1d-b89a-875b1f14583e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.978252 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.977113    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/45f7eea0-cf70-4d1d-b89a-875b1f14583e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.980001 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.979960    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/45f7eea0-cf70-4d1d-b89a-875b1f14583e-config-out\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.980495 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.980199    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/45f7eea0-cf70-4d1d-b89a-875b1f14583e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.980495 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.980257    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.980495 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.980331    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.980495 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.980337    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.980495 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.980424    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.980495 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.980450    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.980756 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.980603    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-web-config\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.980967 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.980944    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/45f7eea0-cf70-4d1d-b89a-875b1f14583e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.981956 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.981941    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/45f7eea0-cf70-4d1d-b89a-875b1f14583e-config-volume\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:20.986979 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:20.986957    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hthtf\" (UniqueName: \"kubernetes.io/projected/45f7eea0-cf70-4d1d-b89a-875b1f14583e-kube-api-access-hthtf\") pod \"alertmanager-main-0\" (UID: \"45f7eea0-cf70-4d1d-b89a-875b1f14583e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:21.099686 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:21.099665    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 21:37:21.235617 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:21.235596    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 21:37:21.237073 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:37:21.237048    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f7eea0_cf70_4d1d_b89a_875b1f14583e.slice/crio-50ab09c5152d86f718327d88127d82beecba0b42da39dca766c174359724df2e WatchSource:0}: Error finding container 50ab09c5152d86f718327d88127d82beecba0b42da39dca766c174359724df2e: Status 404 returned error can't find the container with id 50ab09c5152d86f718327d88127d82beecba0b42da39dca766c174359724df2e
Jul 02 21:37:21.278707 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:21.278683    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs\") pod \"network-metrics-daemon-d8wzk\" (UID: \"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740\") " pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:37:21.280816 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:21.280792    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad9a4f7b-552f-469a-be1b-7ab6b4bd3740-metrics-certs\") pod \"network-metrics-daemon-d8wzk\" (UID: \"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740\") " pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:37:21.423176 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:21.423116    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7x7kj\""
Jul 02 21:37:21.431222 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:21.431204    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-d8wzk"
Jul 02 21:37:21.524721 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:21.524693    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0eb16785-edb3-4ceb-b570-b72875241bf9" path="/var/lib/kubelet/pods/0eb16785-edb3-4ceb-b570-b72875241bf9/volumes"
Jul 02 21:37:21.550915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:21.550888    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-d8wzk"]
Jul 02 21:37:21.553719 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:37:21.553697    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad9a4f7b_552f_469a_be1b_7ab6b4bd3740.slice/crio-27e39c4ad7390718c9f29660369e62ad6a1257f0483fb91bd198c2fd44afb38c WatchSource:0}: Error finding container 27e39c4ad7390718c9f29660369e62ad6a1257f0483fb91bd198c2fd44afb38c: Status 404 returned error can't find the container with id 27e39c4ad7390718c9f29660369e62ad6a1257f0483fb91bd198c2fd44afb38c
Jul 02 21:37:21.730846 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:21.730782    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d8wzk" event={"ID":"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740","Type":"ContainerStarted","Data":"27e39c4ad7390718c9f29660369e62ad6a1257f0483fb91bd198c2fd44afb38c"}
Jul 02 21:37:21.732206 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:21.732186    2575 generic.go:356] "Generic (PLEG): container finished" podID="45f7eea0-cf70-4d1d-b89a-875b1f14583e" containerID="22b3d2acfcf69760fe9de607c686647b2280d984a0c81833cde98781ca195b77" exitCode=0
Jul 02 21:37:21.732315 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:21.732268    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45f7eea0-cf70-4d1d-b89a-875b1f14583e","Type":"ContainerDied","Data":"22b3d2acfcf69760fe9de607c686647b2280d984a0c81833cde98781ca195b77"}
Jul 02 21:37:21.732377 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:21.732333    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45f7eea0-cf70-4d1d-b89a-875b1f14583e","Type":"ContainerStarted","Data":"50ab09c5152d86f718327d88127d82beecba0b42da39dca766c174359724df2e"}
Jul 02 21:37:22.739276 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.739204    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d8wzk" event={"ID":"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740","Type":"ContainerStarted","Data":"f643d3c93f2d9a929c92b21b0fb5e59913c269baf460ad4547a531af5cb29807"}
Jul 02 21:37:22.739276 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.739261    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-d8wzk" event={"ID":"ad9a4f7b-552f-469a-be1b-7ab6b4bd3740","Type":"ContainerStarted","Data":"1b78e7b4ccc43f3d23a99f79c7e4d4ad807fd623577bba8ff830301e31b604a6"}
Jul 02 21:37:22.742376 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.742352    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45f7eea0-cf70-4d1d-b89a-875b1f14583e","Type":"ContainerStarted","Data":"fa9d5d6b95460102d27a3357e6c73b208b4a8957a1a4662957bd6f8c413c2013"}
Jul 02 21:37:22.742491 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.742406    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45f7eea0-cf70-4d1d-b89a-875b1f14583e","Type":"ContainerStarted","Data":"279f1886d4663da755b30f04a8e473808864e3c5b48d218fd4e33bce6fef5dec"}
Jul 02 21:37:22.742491 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.742433    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45f7eea0-cf70-4d1d-b89a-875b1f14583e","Type":"ContainerStarted","Data":"b972779761dc9fd3bae597c41b2a5661879caca645be2f403071870868c275b2"}
Jul 02 21:37:22.742491 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.742455    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45f7eea0-cf70-4d1d-b89a-875b1f14583e","Type":"ContainerStarted","Data":"f13b06136ae67a04c5dce291f2e86f5a857e4895d6554eb0fa601796a4804318"}
Jul 02 21:37:22.742491 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.742479    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45f7eea0-cf70-4d1d-b89a-875b1f14583e","Type":"ContainerStarted","Data":"aae17ac5ffb838644462292810d110958e2ed8d723d403be70f506baf3b6c519"}
Jul 02 21:37:22.742659 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.742528    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"45f7eea0-cf70-4d1d-b89a-875b1f14583e","Type":"ContainerStarted","Data":"c43d7bdc9bba62c64269d3ce8ed91dba728951dce682beff548fc5e0d25f6e72"}
Jul 02 21:37:22.775918 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.775873    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-d8wzk" podStartSLOduration=373.904195642 podStartE2EDuration="6m14.775859896s" totalImagesPullingTime="871.664254ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:22.774581671 +0000 UTC m=+375.812060978" watchObservedRunningTime="2026-07-02 21:37:22.775859896 +0000 UTC m=+375.813339203"
Jul 02 21:37:22.816286 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.816245    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.801555251 podStartE2EDuration="2.81623347s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.678219ms" isStatefulPod=false podCreationTimestamp="2026-07-02 21:37:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:22.814253836 +0000 UTC m=+375.851733147" watchObservedRunningTime="2026-07-02 21:37:22.81623347 +0000 UTC m=+375.853712777"
Jul 02 21:37:22.943450 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.943406    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:37:22.943981 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.943964    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 21:37:22.944359 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.944233    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="prometheus" containerID="cri-o://e501733daf38214145a89221d2e3bbca810409a9005c79b58978a16334fd2a3c" gracePeriod=600
Jul 02 21:37:22.944359 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.944243    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="kube-rbac-proxy" containerID="cri-o://58237ad986959d50e7d724552b927d4374b2ab396154a96901795b65ade8d13c" gracePeriod=600
Jul 02 21:37:22.944359 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.944259    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="kube-rbac-proxy-thanos" containerID="cri-o://857f8a6195b17b1e09d5f5a003c459679c181c7ddd18cbba40c5e4f5b80c0c10" gracePeriod=600
Jul 02 21:37:22.944359 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.944273    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="kube-rbac-proxy-web" containerID="cri-o://0f77f0cd2411b701039f0bfee156b661bd727a5682eb75e75e46f05441079d84" gracePeriod=600
Jul 02 21:37:22.944359 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.944284    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="thanos-sidecar" containerID="cri-o://75940637967f5be2de91ec7bf18510d08ef073bb5179d0a7e261d752c6c51052" gracePeriod=600
Jul 02 21:37:22.944359 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:22.944291    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="config-reloader" containerID="cri-o://032d5c58856977eeb44ec670c8a42f7815f692df933178c31030f80833ca868f" gracePeriod=600
Jul 02 21:37:23.042936 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:23.042911    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:37:23.748799 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:23.748769    2575 generic.go:356] "Generic (PLEG): container finished" podID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerID="857f8a6195b17b1e09d5f5a003c459679c181c7ddd18cbba40c5e4f5b80c0c10" exitCode=0
Jul 02 21:37:23.748799 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:23.748794    2575 generic.go:356] "Generic (PLEG): container finished" podID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerID="58237ad986959d50e7d724552b927d4374b2ab396154a96901795b65ade8d13c" exitCode=0
Jul 02 21:37:23.748799 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:23.748800    2575 generic.go:356] "Generic (PLEG): container finished" podID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerID="75940637967f5be2de91ec7bf18510d08ef073bb5179d0a7e261d752c6c51052" exitCode=0
Jul 02 21:37:23.748799 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:23.748805    2575 generic.go:356] "Generic (PLEG): container finished" podID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerID="032d5c58856977eeb44ec670c8a42f7815f692df933178c31030f80833ca868f" exitCode=0
Jul 02 21:37:23.749386 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:23.748811    2575 generic.go:356] "Generic (PLEG): container finished" podID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerID="e501733daf38214145a89221d2e3bbca810409a9005c79b58978a16334fd2a3c" exitCode=0
Jul 02 21:37:23.749386 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:23.748840    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2","Type":"ContainerDied","Data":"857f8a6195b17b1e09d5f5a003c459679c181c7ddd18cbba40c5e4f5b80c0c10"}
Jul 02 21:37:23.749386 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:23.748929    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2","Type":"ContainerDied","Data":"58237ad986959d50e7d724552b927d4374b2ab396154a96901795b65ade8d13c"}
Jul 02 21:37:23.749386 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:23.748970    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2","Type":"ContainerDied","Data":"75940637967f5be2de91ec7bf18510d08ef073bb5179d0a7e261d752c6c51052"}
Jul 02 21:37:23.749386 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:23.749027    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2","Type":"ContainerDied","Data":"032d5c58856977eeb44ec670c8a42f7815f692df933178c31030f80833ca868f"}
Jul 02 21:37:23.749386 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:23.749077    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2","Type":"ContainerDied","Data":"e501733daf38214145a89221d2e3bbca810409a9005c79b58978a16334fd2a3c"}
Jul 02 21:37:24.195837 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.195812    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.300951 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.300878    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-metrics-client-certs\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.300951 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.300911    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-tls-assets\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.300951 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.300938    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-metrics-client-ca\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.300965    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-1\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.300993    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301038    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-web-config\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301064    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-tls\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301107    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-2\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301132    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301158    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-thanos-prometheus-http-client-file\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301185    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-0\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301218    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-serving-certs-ca-bundle\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301242    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-grpc-tls\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301274    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-trusted-ca-bundle\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301287    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:37:24.301843 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301304    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-config-out\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301843 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301334    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-config\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301843 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301336    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:37:24.301843 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301386    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-db\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301843 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301438    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97xq7\" (UniqueName: \"kubernetes.io/projected/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-kube-api-access-97xq7\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301843 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301492    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-kubelet-serving-ca-bundle\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301843 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301521    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-kube-rbac-proxy\") pod \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\" (UID: \"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2\") "
Jul 02 21:37:24.301843 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301792    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-metrics-client-ca\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.301843 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301811    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.301843 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.301789    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:37:24.302320 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.302087    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:37:24.302370 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.302344    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:37:24.302564 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.302545    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:37:24.303167 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.303077    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 21:37:24.304038 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.303534    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:37:24.304038 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.303938    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:24.304213 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.304161    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:37:24.304635 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.304599    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:24.305736 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.305713    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:24.305908 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.305884    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:24.306345 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.306320    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:24.306345 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.306330    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-config-out" (OuterVolumeSpecName: "config-out") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:37:24.306480 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.306322    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-kube-api-access-97xq7" (OuterVolumeSpecName: "kube-api-access-97xq7") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "kube-api-access-97xq7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:37:24.306480 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.306442    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:24.306563 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.306503    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-config" (OuterVolumeSpecName: "config") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:24.307237 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.307220    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:24.314829 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.314808    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-web-config" (OuterVolumeSpecName: "web-config") pod "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" (UID: "8748fbf6-b3f2-42bb-b0e9-fdd519e802d2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 21:37:24.403128 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403093    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.403128 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403127    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.403128 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403139    2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.403293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403149    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.403293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403158    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.403293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403167    2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-grpc-tls\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.403293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403175    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.403293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403183    2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-config-out\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.403293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403191    2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-config\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.403293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403198    2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-prometheus-k8s-db\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.403293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403206    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97xq7\" (UniqueName: \"kubernetes.io/projected/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-kube-api-access-97xq7\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.403293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403214    2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.403293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403222    2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-kube-rbac-proxy\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.403293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403232    2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-metrics-client-certs\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.403293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403240    2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-tls-assets\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.403293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403248    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.403293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403256    2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-web-config\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.403293 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.403264    2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:37:24.755357 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.755326    2575 generic.go:356] "Generic (PLEG): container finished" podID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerID="0f77f0cd2411b701039f0bfee156b661bd727a5682eb75e75e46f05441079d84" exitCode=0
Jul 02 21:37:24.755744 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.755413    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.755744 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.755404    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2","Type":"ContainerDied","Data":"0f77f0cd2411b701039f0bfee156b661bd727a5682eb75e75e46f05441079d84"}
Jul 02 21:37:24.755744 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.755564    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8748fbf6-b3f2-42bb-b0e9-fdd519e802d2","Type":"ContainerDied","Data":"c0c9619899ee9fbf5e6085136d6e7e887528fe20d57829e4de63ce0c2684a71e"}
Jul 02 21:37:24.755744 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.755620    2575 scope.go:117] "RemoveContainer" containerID="857f8a6195b17b1e09d5f5a003c459679c181c7ddd18cbba40c5e4f5b80c0c10"
Jul 02 21:37:24.763684 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.763611    2575 scope.go:117] "RemoveContainer" containerID="58237ad986959d50e7d724552b927d4374b2ab396154a96901795b65ade8d13c"
Jul 02 21:37:24.770674 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.770655    2575 scope.go:117] "RemoveContainer" containerID="0f77f0cd2411b701039f0bfee156b661bd727a5682eb75e75e46f05441079d84"
Jul 02 21:37:24.776912 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.776895    2575 scope.go:117] "RemoveContainer" containerID="75940637967f5be2de91ec7bf18510d08ef073bb5179d0a7e261d752c6c51052"
Jul 02 21:37:24.780118 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.780099    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 21:37:24.783961 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.783946    2575 scope.go:117] "RemoveContainer" containerID="032d5c58856977eeb44ec670c8a42f7815f692df933178c31030f80833ca868f"
Jul 02 21:37:24.784855 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.784804    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 21:37:24.791872 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.791780    2575 scope.go:117] "RemoveContainer" containerID="e501733daf38214145a89221d2e3bbca810409a9005c79b58978a16334fd2a3c"
Jul 02 21:37:24.798860 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.798846    2575 scope.go:117] "RemoveContainer" containerID="47f03c10520d10355d1be8b3f009c0ed1bd517feed9bd1490823d8f7d3dc1a7a"
Jul 02 21:37:24.805215 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.805199    2575 scope.go:117] "RemoveContainer" containerID="857f8a6195b17b1e09d5f5a003c459679c181c7ddd18cbba40c5e4f5b80c0c10"
Jul 02 21:37:24.805479 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:37:24.805461    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"857f8a6195b17b1e09d5f5a003c459679c181c7ddd18cbba40c5e4f5b80c0c10\": container with ID starting with 857f8a6195b17b1e09d5f5a003c459679c181c7ddd18cbba40c5e4f5b80c0c10 not found: ID does not exist" containerID="857f8a6195b17b1e09d5f5a003c459679c181c7ddd18cbba40c5e4f5b80c0c10"
Jul 02 21:37:24.805523 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.805486    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"857f8a6195b17b1e09d5f5a003c459679c181c7ddd18cbba40c5e4f5b80c0c10"} err="failed to get container status \"857f8a6195b17b1e09d5f5a003c459679c181c7ddd18cbba40c5e4f5b80c0c10\": rpc error: code = NotFound desc = could not find container \"857f8a6195b17b1e09d5f5a003c459679c181c7ddd18cbba40c5e4f5b80c0c10\": container with ID starting with 857f8a6195b17b1e09d5f5a003c459679c181c7ddd18cbba40c5e4f5b80c0c10 not found: ID does not exist"
Jul 02 21:37:24.805523 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.805515    2575 scope.go:117] "RemoveContainer" containerID="58237ad986959d50e7d724552b927d4374b2ab396154a96901795b65ade8d13c"
Jul 02 21:37:24.805709 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:37:24.805692    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58237ad986959d50e7d724552b927d4374b2ab396154a96901795b65ade8d13c\": container with ID starting with 58237ad986959d50e7d724552b927d4374b2ab396154a96901795b65ade8d13c not found: ID does not exist" containerID="58237ad986959d50e7d724552b927d4374b2ab396154a96901795b65ade8d13c"
Jul 02 21:37:24.805780 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.805710    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58237ad986959d50e7d724552b927d4374b2ab396154a96901795b65ade8d13c"} err="failed to get container status \"58237ad986959d50e7d724552b927d4374b2ab396154a96901795b65ade8d13c\": rpc error: code = NotFound desc = could not find container \"58237ad986959d50e7d724552b927d4374b2ab396154a96901795b65ade8d13c\": container with ID starting with 58237ad986959d50e7d724552b927d4374b2ab396154a96901795b65ade8d13c not found: ID does not exist"
Jul 02 21:37:24.805780 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.805722    2575 scope.go:117] "RemoveContainer" containerID="0f77f0cd2411b701039f0bfee156b661bd727a5682eb75e75e46f05441079d84"
Jul 02 21:37:24.805948 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:37:24.805932    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f77f0cd2411b701039f0bfee156b661bd727a5682eb75e75e46f05441079d84\": container with ID starting with 0f77f0cd2411b701039f0bfee156b661bd727a5682eb75e75e46f05441079d84 not found: ID does not exist" containerID="0f77f0cd2411b701039f0bfee156b661bd727a5682eb75e75e46f05441079d84"
Jul 02 21:37:24.806026 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.805949    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f77f0cd2411b701039f0bfee156b661bd727a5682eb75e75e46f05441079d84"} err="failed to get container status \"0f77f0cd2411b701039f0bfee156b661bd727a5682eb75e75e46f05441079d84\": rpc error: code = NotFound desc = could not find container \"0f77f0cd2411b701039f0bfee156b661bd727a5682eb75e75e46f05441079d84\": container with ID starting with 0f77f0cd2411b701039f0bfee156b661bd727a5682eb75e75e46f05441079d84 not found: ID does not exist"
Jul 02 21:37:24.806026 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.805961    2575 scope.go:117] "RemoveContainer" containerID="75940637967f5be2de91ec7bf18510d08ef073bb5179d0a7e261d752c6c51052"
Jul 02 21:37:24.806222 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:37:24.806204    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75940637967f5be2de91ec7bf18510d08ef073bb5179d0a7e261d752c6c51052\": container with ID starting with 75940637967f5be2de91ec7bf18510d08ef073bb5179d0a7e261d752c6c51052 not found: ID does not exist" containerID="75940637967f5be2de91ec7bf18510d08ef073bb5179d0a7e261d752c6c51052"
Jul 02 21:37:24.806310 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.806222    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75940637967f5be2de91ec7bf18510d08ef073bb5179d0a7e261d752c6c51052"} err="failed to get container status \"75940637967f5be2de91ec7bf18510d08ef073bb5179d0a7e261d752c6c51052\": rpc error: code = NotFound desc = could not find container \"75940637967f5be2de91ec7bf18510d08ef073bb5179d0a7e261d752c6c51052\": container with ID starting with 75940637967f5be2de91ec7bf18510d08ef073bb5179d0a7e261d752c6c51052 not found: ID does not exist"
Jul 02 21:37:24.806310 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.806237    2575 scope.go:117] "RemoveContainer" containerID="032d5c58856977eeb44ec670c8a42f7815f692df933178c31030f80833ca868f"
Jul 02 21:37:24.806487 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:37:24.806466    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"032d5c58856977eeb44ec670c8a42f7815f692df933178c31030f80833ca868f\": container with ID starting with 032d5c58856977eeb44ec670c8a42f7815f692df933178c31030f80833ca868f not found: ID does not exist" containerID="032d5c58856977eeb44ec670c8a42f7815f692df933178c31030f80833ca868f"
Jul 02 21:37:24.806527 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.806493    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"032d5c58856977eeb44ec670c8a42f7815f692df933178c31030f80833ca868f"} err="failed to get container status \"032d5c58856977eeb44ec670c8a42f7815f692df933178c31030f80833ca868f\": rpc error: code = NotFound desc = could not find container \"032d5c58856977eeb44ec670c8a42f7815f692df933178c31030f80833ca868f\": container with ID starting with 032d5c58856977eeb44ec670c8a42f7815f692df933178c31030f80833ca868f not found: ID does not exist"
Jul 02 21:37:24.806527 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.806507    2575 scope.go:117] "RemoveContainer" containerID="e501733daf38214145a89221d2e3bbca810409a9005c79b58978a16334fd2a3c"
Jul 02 21:37:24.806744 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:37:24.806729    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e501733daf38214145a89221d2e3bbca810409a9005c79b58978a16334fd2a3c\": container with ID starting with e501733daf38214145a89221d2e3bbca810409a9005c79b58978a16334fd2a3c not found: ID does not exist" containerID="e501733daf38214145a89221d2e3bbca810409a9005c79b58978a16334fd2a3c"
Jul 02 21:37:24.806797 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.806749    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e501733daf38214145a89221d2e3bbca810409a9005c79b58978a16334fd2a3c"} err="failed to get container status \"e501733daf38214145a89221d2e3bbca810409a9005c79b58978a16334fd2a3c\": rpc error: code = NotFound desc = could not find container \"e501733daf38214145a89221d2e3bbca810409a9005c79b58978a16334fd2a3c\": container with ID starting with e501733daf38214145a89221d2e3bbca810409a9005c79b58978a16334fd2a3c not found: ID does not exist"
Jul 02 21:37:24.806797 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.806765    2575 scope.go:117] "RemoveContainer" containerID="47f03c10520d10355d1be8b3f009c0ed1bd517feed9bd1490823d8f7d3dc1a7a"
Jul 02 21:37:24.806971 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:37:24.806955    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47f03c10520d10355d1be8b3f009c0ed1bd517feed9bd1490823d8f7d3dc1a7a\": container with ID starting with 47f03c10520d10355d1be8b3f009c0ed1bd517feed9bd1490823d8f7d3dc1a7a not found: ID does not exist" containerID="47f03c10520d10355d1be8b3f009c0ed1bd517feed9bd1490823d8f7d3dc1a7a"
Jul 02 21:37:24.807083 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.806973    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47f03c10520d10355d1be8b3f009c0ed1bd517feed9bd1490823d8f7d3dc1a7a"} err="failed to get container status \"47f03c10520d10355d1be8b3f009c0ed1bd517feed9bd1490823d8f7d3dc1a7a\": rpc error: code = NotFound desc = could not find container \"47f03c10520d10355d1be8b3f009c0ed1bd517feed9bd1490823d8f7d3dc1a7a\": container with ID starting with 47f03c10520d10355d1be8b3f009c0ed1bd517feed9bd1490823d8f7d3dc1a7a not found: ID does not exist"
Jul 02 21:37:24.811947 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.811928    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 21:37:24.812204 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812192    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="thanos-sidecar"
Jul 02 21:37:24.812252 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812206    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="thanos-sidecar"
Jul 02 21:37:24.812252 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812213    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="kube-rbac-proxy-thanos"
Jul 02 21:37:24.812252 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812219    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="kube-rbac-proxy-thanos"
Jul 02 21:37:24.812252 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812227    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="kube-rbac-proxy"
Jul 02 21:37:24.812252 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812233    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="kube-rbac-proxy"
Jul 02 21:37:24.812252 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812245    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="init-config-reloader"
Jul 02 21:37:24.812252 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812250    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="init-config-reloader"
Jul 02 21:37:24.812444 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812259    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="config-reloader"
Jul 02 21:37:24.812444 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812264    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="config-reloader"
Jul 02 21:37:24.812444 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812271    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="prometheus"
Jul 02 21:37:24.812444 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812276    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="prometheus"
Jul 02 21:37:24.812444 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812282    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="kube-rbac-proxy-web"
Jul 02 21:37:24.812444 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812287    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="kube-rbac-proxy-web"
Jul 02 21:37:24.812444 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812330    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="prometheus"
Jul 02 21:37:24.812444 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812336    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="kube-rbac-proxy"
Jul 02 21:37:24.812444 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812343    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="kube-rbac-proxy-thanos"
Jul 02 21:37:24.812444 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812350    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="thanos-sidecar"
Jul 02 21:37:24.812444 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812357    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="kube-rbac-proxy-web"
Jul 02 21:37:24.812444 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.812362    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" containerName="config-reloader"
Jul 02 21:37:24.817438 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.817423    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.819919 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.819902    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 21:37:24.820061 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.819947    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 21:37:24.820188 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.820172    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 21:37:24.820319 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.820176    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 21:37:24.820403 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.820388    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 21:37:24.820656 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.820638    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 21:37:24.820988 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.820974    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 21:37:24.821091 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.820979    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 21:37:24.821238 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.821213    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 21:37:24.821343 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.821256    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 21:37:24.821343 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.821272    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 21:37:24.821533 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.821415    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2mdonv2r5reua\""
Jul 02 21:37:24.821533 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.821513    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 21:37:24.821974 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.821953    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8lnqx\""
Jul 02 21:37:24.823871 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.823854    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 21:37:24.826854 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.826834    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 21:37:24.833070 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.833047    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 21:37:24.906782 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.906728    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/add7f5b8-2492-493c-b6bb-c052c594dc74-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.906782 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.906754    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.906782 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.906775    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.906991 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.906794    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.906991 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.906835    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/add7f5b8-2492-493c-b6bb-c052c594dc74-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.906991 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.906875    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.906991 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.906921    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-config\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.906991 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.906948    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.907197 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.906996    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.907197 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.907043    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.907197 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.907063    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-web-config\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.907197 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.907123    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.907197 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.907147    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.907197 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.907167    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.907197 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.907188    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.907422 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.907221    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.907422 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.907253    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/add7f5b8-2492-493c-b6bb-c052c594dc74-config-out\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.907422 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.907270    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.907422 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.907290    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:24.907422 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:24.907313    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpp42\" (UniqueName: \"kubernetes.io/projected/add7f5b8-2492-493c-b6bb-c052c594dc74-kube-api-access-gpp42\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008054 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008029    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/add7f5b8-2492-493c-b6bb-c052c594dc74-config-out\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008149 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008063    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008149 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008089    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008149 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008114    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpp42\" (UniqueName: \"kubernetes.io/projected/add7f5b8-2492-493c-b6bb-c052c594dc74-kube-api-access-gpp42\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008394 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008149    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/add7f5b8-2492-493c-b6bb-c052c594dc74-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008394 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008179    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008394 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008210    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008394 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008240    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008394 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008269    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/add7f5b8-2492-493c-b6bb-c052c594dc74-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008394 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008299    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008394 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008335    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-config\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008748 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008748 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008447    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008748 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008748 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008497    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-web-config\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008748 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008555    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008748 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008595    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/add7f5b8-2492-493c-b6bb-c052c594dc74-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008748 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008584    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008748 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008651    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008748 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008703    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.008748 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.008731    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.009986 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.009304    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.009986 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.009356    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.010267 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.010242    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.010331 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.010258    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.010944 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.010881    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.010944 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.010894    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.011984 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.011925    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.012091 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.011982    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.012344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.012321    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/add7f5b8-2492-493c-b6bb-c052c594dc74-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.013143 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.013060    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.013143 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.013104    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.013320 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.013298    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.013470 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.013449    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/add7f5b8-2492-493c-b6bb-c052c594dc74-config-out\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.013985 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.013964    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.014268 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.014245    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-config\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.014518 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.014487    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.014593 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.014569    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/add7f5b8-2492-493c-b6bb-c052c594dc74-web-config\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.014783 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.014766    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/add7f5b8-2492-493c-b6bb-c052c594dc74-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.016043 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.016023    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpp42\" (UniqueName: \"kubernetes.io/projected/add7f5b8-2492-493c-b6bb-c052c594dc74-kube-api-access-gpp42\") pod \"prometheus-k8s-0\" (UID: \"add7f5b8-2492-493c-b6bb-c052c594dc74\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.098156 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.098135    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:37:25.128074 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.128039    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:25.196084 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.196054    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:37:25.261685 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.261652    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 21:37:25.264276 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:37:25.264249    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadd7f5b8_2492_493c_b6bb_c052c594dc74.slice/crio-7e85c0eab5a211a9c9137e02aff9b220d566b0f469a8d2a270ae6fe557ab5d5f WatchSource:0}: Error finding container 7e85c0eab5a211a9c9137e02aff9b220d566b0f469a8d2a270ae6fe557ab5d5f: Status 404 returned error can't find the container with id 7e85c0eab5a211a9c9137e02aff9b220d566b0f469a8d2a270ae6fe557ab5d5f
Jul 02 21:37:25.524270 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.524206    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8748fbf6-b3f2-42bb-b0e9-fdd519e802d2" path="/var/lib/kubelet/pods/8748fbf6-b3f2-42bb-b0e9-fdd519e802d2/volumes"
Jul 02 21:37:25.760841 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.760808    2575 generic.go:356] "Generic (PLEG): container finished" podID="add7f5b8-2492-493c-b6bb-c052c594dc74" containerID="70f1603a862537cbf361cd61239cf2d2fbb1e4edf920908eeed3ef839dcdb1f4" exitCode=0
Jul 02 21:37:25.761287 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.760901    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"add7f5b8-2492-493c-b6bb-c052c594dc74","Type":"ContainerDied","Data":"70f1603a862537cbf361cd61239cf2d2fbb1e4edf920908eeed3ef839dcdb1f4"}
Jul 02 21:37:25.761287 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:25.760990    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"add7f5b8-2492-493c-b6bb-c052c594dc74","Type":"ContainerStarted","Data":"7e85c0eab5a211a9c9137e02aff9b220d566b0f469a8d2a270ae6fe557ab5d5f"}
Jul 02 21:37:26.768333 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:26.768297    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"add7f5b8-2492-493c-b6bb-c052c594dc74","Type":"ContainerStarted","Data":"f925e29aa87689c6f8206da16e1e9c60683f9471fa1d6fe7d50842fa247de77e"}
Jul 02 21:37:26.768734 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:26.768360    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"add7f5b8-2492-493c-b6bb-c052c594dc74","Type":"ContainerStarted","Data":"52ed3f58a485f6e5c4294680c428ebe859efc6d80f98a028cdaf10675ca9fd9d"}
Jul 02 21:37:26.768734 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:26.768387    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"add7f5b8-2492-493c-b6bb-c052c594dc74","Type":"ContainerStarted","Data":"33a031757a03b91edacfe98a61f1d481b4650cdac441aa093b420eaf59db0291"}
Jul 02 21:37:26.768734 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:26.768414    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"add7f5b8-2492-493c-b6bb-c052c594dc74","Type":"ContainerStarted","Data":"eb2271d054bb1767e1ba4d0ff7fb517f5d1799b97cff29585fe85701941b5c94"}
Jul 02 21:37:26.768734 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:26.768442    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"add7f5b8-2492-493c-b6bb-c052c594dc74","Type":"ContainerStarted","Data":"71001e910a7143ae364e5e35de46d2e595ef93e73f7222077db9b6a624daca69"}
Jul 02 21:37:26.768734 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:26.768469    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"add7f5b8-2492-493c-b6bb-c052c594dc74","Type":"ContainerStarted","Data":"8f0d6942635e82a9c773f5fffe307d600c09edca5e4950d4b9b777a50a7d4ddc"}
Jul 02 21:37:26.793705 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:26.793651    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.771254249 podStartE2EDuration="2.793636669s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.38242ms" isStatefulPod=false podCreationTimestamp="2026-07-02 21:37:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:37:26.792631469 +0000 UTC m=+379.830110781" watchObservedRunningTime="2026-07-02 21:37:26.793636669 +0000 UTC m=+379.831115976"
Jul 02 21:37:27.285722 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:27.285686    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:37:30.128578 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:30.128535    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:37:37.720648 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:37.720616    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:37:37.774913 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:37.774887    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:37:37.828471 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:37:37.828442    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:38:05.875892 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:05.875856    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:38:25.128872 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:25.128845    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:38:25.144089 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:25.144066    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:38:25.934806 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:25.934775    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:38:26.011683 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:26.011655    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 21:38:32.786242 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:32.786209    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:38:32.836932 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:32.836904    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:38:34.459581 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:34.459551    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:38:34.510829 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:34.510798    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:38:44.654758 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:44.654723    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:38:44.756269 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:44.756238    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:38:44.985756 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:44.985674    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:38:45.086903 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:45.086876    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:38:45.187553 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:45.187528    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:38:45.234539 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:45.234514    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:38:53.106676 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:53.106642    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:38:57.733751 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:57.733717    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:38:57.831990 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:57.831959    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:38:58.124203 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:38:58.124175    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:39:26.163576 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:39:26.163542    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:41:37.125464 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:41:37.125389    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:42:40.596906 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:42:40.596874    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:42:40.645994 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:42:40.645939    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:42:42.542022 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:42:42.541953    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:42:42.596704 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:42:42.596677    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:42:54.053213 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:42:54.053175    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:42:54.110828 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:42:54.110801    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:05.005813 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:05.005737    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:05.120461 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:05.120434    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:08.697737 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:08.697687    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:08.794495 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:08.794464    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:40.239023 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:40.238971    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:41.613146 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:41.613111    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:43.817729 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:43.817693    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:43.920588 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:43.920527    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:45.629058 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:45.629025    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:45.741709 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:45.741671    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:45.864305 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:45.864274    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:46.064961 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:46.064877    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:47.814531 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:47.814500    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:48.443391 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:48.443360    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:50.816301 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:50.816267    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:50.917850 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:50.917824    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:54.620367 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:54.620331    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:54.719325 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:54.719287    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:56.813204 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:56.813164    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:59.831629 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:59.831595    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:43:59.933546 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:43:59.933518    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:01.961639 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:01.961601    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:16.469540 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:16.469509    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:16.581815 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:16.581785    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:17.064307 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.064269    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:17.376107 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.376083    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:17.497477 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.497440    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:17.570379 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.570350    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"]
Jul 02 21:44:17.573560 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.573539    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:17.579947 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:44:17.579880    2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"opendatahub-operator-controller-manager-6c4697655-snvmv\" is forbidden: User \"system:node:ip-10-0-139-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-110.ec2.internal' and this object" podUID="86d57bf6-71e6-41d2-bfa9-3690f0ed4277" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:17.579947 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:44:17.579886    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-service-cert\" is forbidden: User \"system:node:ip-10-0-139-110.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-110.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" type="*v1.Secret"
Jul 02 21:44:17.580158 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:44:17.580045    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-139-110.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-110.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 02 21:44:17.580277 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:44:17.580247    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-manager-dockercfg-9ghtb\" is forbidden: User \"system:node:ip-10-0-139-110.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-110.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9ghtb\"" type="*v1.Secret"
Jul 02 21:44:17.580277 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:44:17.580260    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-139-110.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-110.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 02 21:44:17.580386 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:44:17.580293    2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"opendatahub-operator-controller-webhook-cert\" is forbidden: User \"system:node:ip-10-0-139-110.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-110.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" type="*v1.Secret"
Jul 02 21:44:17.601450 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.601417    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"]
Jul 02 21:44:17.701215 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.701157    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c4697655-snvmv\" (UID: \"86d57bf6-71e6-41d2-bfa9-3690f0ed4277\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:17.701215 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.701207    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-tmp\") pod \"opendatahub-operator-controller-manager-6c4697655-snvmv\" (UID: \"86d57bf6-71e6-41d2-bfa9-3690f0ed4277\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:17.701349 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.701223    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c4697655-snvmv\" (UID: \"86d57bf6-71e6-41d2-bfa9-3690f0ed4277\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:17.701349 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.701317    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-manifests\") pod \"opendatahub-operator-controller-manager-6c4697655-snvmv\" (UID: \"86d57bf6-71e6-41d2-bfa9-3690f0ed4277\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:17.701426 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.701359    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w68nn\" (UniqueName: \"kubernetes.io/projected/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-kube-api-access-w68nn\") pod \"opendatahub-operator-controller-manager-6c4697655-snvmv\" (UID: \"86d57bf6-71e6-41d2-bfa9-3690f0ed4277\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:17.802522 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.802497    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-tmp\") pod \"opendatahub-operator-controller-manager-6c4697655-snvmv\" (UID: \"86d57bf6-71e6-41d2-bfa9-3690f0ed4277\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:17.802522 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.802523    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c4697655-snvmv\" (UID: \"86d57bf6-71e6-41d2-bfa9-3690f0ed4277\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:17.802654 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.802545    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-manifests\") pod \"opendatahub-operator-controller-manager-6c4697655-snvmv\" (UID: \"86d57bf6-71e6-41d2-bfa9-3690f0ed4277\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:17.802696 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.802673    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w68nn\" (UniqueName: \"kubernetes.io/projected/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-kube-api-access-w68nn\") pod \"opendatahub-operator-controller-manager-6c4697655-snvmv\" (UID: \"86d57bf6-71e6-41d2-bfa9-3690f0ed4277\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:17.802744 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.802724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c4697655-snvmv\" (UID: \"86d57bf6-71e6-41d2-bfa9-3690f0ed4277\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:17.802854 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.802839    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-manifests\") pod \"opendatahub-operator-controller-manager-6c4697655-snvmv\" (UID: \"86d57bf6-71e6-41d2-bfa9-3690f0ed4277\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:17.804468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.804441    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-tmp\") pod \"opendatahub-operator-controller-manager-6c4697655-snvmv\" (UID: \"86d57bf6-71e6-41d2-bfa9-3690f0ed4277\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:17.820184 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.820157    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:17.938120 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:17.938094    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:18.044517 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:18.044445    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:18.153299 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:18.153273    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:18.250564 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:18.250532    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:18.397950 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:18.397928    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9ghtb\""
Jul 02 21:44:18.645337 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:18.645308    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 21:44:18.679567 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:18.679501    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 21:44:18.803748 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:44:18.803723    2575 secret.go:189] Couldn't get secret opendatahub/opendatahub-operator-controller-manager-service-cert: failed to sync secret cache: timed out waiting for the condition
Jul 02 21:44:18.803866 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:44:18.803784    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-webhook-cert podName:86d57bf6-71e6-41d2-bfa9-3690f0ed4277 nodeName:}" failed. No retries permitted until 2026-07-02 21:44:19.303769175 +0000 UTC m=+792.341248461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-webhook-cert") pod "opendatahub-operator-controller-manager-6c4697655-snvmv" (UID: "86d57bf6-71e6-41d2-bfa9-3690f0ed4277") : failed to sync secret cache: timed out waiting for the condition
Jul 02 21:44:18.803866 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:44:18.803730    2575 secret.go:189] Couldn't get secret opendatahub/opendatahub-operator-controller-manager-service-cert: failed to sync secret cache: timed out waiting for the condition
Jul 02 21:44:18.803968 ip-10-0-139-110 kubenswrapper[2575]: E0702 21:44:18.803893    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-apiservice-cert podName:86d57bf6-71e6-41d2-bfa9-3690f0ed4277 nodeName:}" failed. No retries permitted until 2026-07-02 21:44:19.303874014 +0000 UTC m=+792.341353317 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "apiservice-cert" (UniqueName: "kubernetes.io/secret/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-apiservice-cert") pod "opendatahub-operator-controller-manager-6c4697655-snvmv" (UID: "86d57bf6-71e6-41d2-bfa9-3690f0ed4277") : failed to sync secret cache: timed out waiting for the condition
Jul 02 21:44:18.937728 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:18.937658    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 21:44:18.945273 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:18.945251    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w68nn\" (UniqueName: \"kubernetes.io/projected/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-kube-api-access-w68nn\") pod \"opendatahub-operator-controller-manager-6c4697655-snvmv\" (UID: \"86d57bf6-71e6-41d2-bfa9-3690f0ed4277\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:18.961974 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:18.961953    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 21:44:19.315472 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:19.315393    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c4697655-snvmv\" (UID: \"86d57bf6-71e6-41d2-bfa9-3690f0ed4277\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:19.315472 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:19.315451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c4697655-snvmv\" (UID: \"86d57bf6-71e6-41d2-bfa9-3690f0ed4277\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:19.317920 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:19.317882    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c4697655-snvmv\" (UID: \"86d57bf6-71e6-41d2-bfa9-3690f0ed4277\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:19.318138 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:19.318118    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86d57bf6-71e6-41d2-bfa9-3690f0ed4277-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c4697655-snvmv\" (UID: \"86d57bf6-71e6-41d2-bfa9-3690f0ed4277\") " pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:19.385455 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:19.385430    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:19.523797 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:44:19.523766    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d57bf6_71e6_41d2_bfa9_3690f0ed4277.slice/crio-afcbba97e99222eedcb0903fbb50f25aa584b765f6363d180196047be311137e WatchSource:0}: Error finding container afcbba97e99222eedcb0903fbb50f25aa584b765f6363d180196047be311137e: Status 404 returned error can't find the container with id afcbba97e99222eedcb0903fbb50f25aa584b765f6363d180196047be311137e
Jul 02 21:44:19.525424 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:19.525406    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"]
Jul 02 21:44:19.525723 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:19.525707    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 21:44:20.326165 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:20.326084    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv" event={"ID":"86d57bf6-71e6-41d2-bfa9-3690f0ed4277","Type":"ContainerStarted","Data":"afcbba97e99222eedcb0903fbb50f25aa584b765f6363d180196047be311137e"}
Jul 02 21:44:20.491982 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:20.491943    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:20.603972 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:20.603941    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:23.342134 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:23.342106    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv" event={"ID":"86d57bf6-71e6-41d2-bfa9-3690f0ed4277","Type":"ContainerStarted","Data":"6eceb3bcdf7235540e19dd89a82d1111b117dc9de48d8df0d8fb535441010b7a"}
Jul 02 21:44:24.347956 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:24.347922    2575 generic.go:356] "Generic (PLEG): container finished" podID="86d57bf6-71e6-41d2-bfa9-3690f0ed4277" containerID="6eceb3bcdf7235540e19dd89a82d1111b117dc9de48d8df0d8fb535441010b7a" exitCode=0
Jul 02 21:44:24.348356 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:24.347981    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv" event={"ID":"86d57bf6-71e6-41d2-bfa9-3690f0ed4277","Type":"ContainerDied","Data":"6eceb3bcdf7235540e19dd89a82d1111b117dc9de48d8df0d8fb535441010b7a"}
Jul 02 21:44:25.360541 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:25.360507    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv" event={"ID":"86d57bf6-71e6-41d2-bfa9-3690f0ed4277","Type":"ContainerStarted","Data":"f3918dee5adc012ccd75f58ab35c727770788971e8ef4815986ae7187ad875be"}
Jul 02 21:44:25.360915 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:25.360610    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:25.387862 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:25.387820    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv" podStartSLOduration=4.230433033 podStartE2EDuration="8.3878062s" totalImagesPullingTime="3.074011352s" totalInitContainerRuntime="1.083361815s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:44:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:44:25.385468878 +0000 UTC m=+798.422948186" watchObservedRunningTime="2026-07-02 21:44:25.3878062 +0000 UTC m=+798.425285508"
Jul 02 21:44:36.366994 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:36.366919    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c4697655-snvmv"
Jul 02 21:44:37.964385 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:37.964356    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:38.180392 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:38.180360    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:38.645849 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:38.645819    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:38.826662 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:38.826627    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:38.946734 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:38.946656    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:39.067037 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:39.066995    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:39.159052 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:39.159025    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:39.238549 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:39.238481    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:39.843991 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:39.843956    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:40.106228 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:40.106188    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:40.191225 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:40.191199    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:40.289749 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:40.289724    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:41.178246 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:41.178184    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:42.691301 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:42.691270    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:42.754790 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:42.754762    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"]
Jul 02 21:44:42.763361 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:42.763341    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"
Jul 02 21:44:42.767153 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:42.767129    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 02 21:44:42.767274 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:42.767195    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 02 21:44:42.767346 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:42.767195    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 21:44:42.767401 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:42.767345    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-t9ltp\""
Jul 02 21:44:42.767451 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:42.767129    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 21:44:42.767684 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:42.767667    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 02 21:44:42.769208 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:42.769188    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"]
Jul 02 21:44:42.771310 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:42.771285    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:42.907834 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:42.907803    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-554bn\" (UniqueName: \"kubernetes.io/projected/55c95344-82d4-4a57-8d16-626635c0abe9-kube-api-access-554bn\") pod \"lws-controller-manager-bb99d9bb4-2qsnn\" (UID: \"55c95344-82d4-4a57-8d16-626635c0abe9\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"
Jul 02 21:44:42.907997 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:42.907855    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/55c95344-82d4-4a57-8d16-626635c0abe9-manager-config\") pod \"lws-controller-manager-bb99d9bb4-2qsnn\" (UID: \"55c95344-82d4-4a57-8d16-626635c0abe9\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"
Jul 02 21:44:42.907997 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:42.907876    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/55c95344-82d4-4a57-8d16-626635c0abe9-metrics-cert\") pod \"lws-controller-manager-bb99d9bb4-2qsnn\" (UID: \"55c95344-82d4-4a57-8d16-626635c0abe9\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"
Jul 02 21:44:42.907997 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:42.907931    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55c95344-82d4-4a57-8d16-626635c0abe9-cert\") pod \"lws-controller-manager-bb99d9bb4-2qsnn\" (UID: \"55c95344-82d4-4a57-8d16-626635c0abe9\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"
Jul 02 21:44:43.008696 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:43.008624    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/55c95344-82d4-4a57-8d16-626635c0abe9-manager-config\") pod \"lws-controller-manager-bb99d9bb4-2qsnn\" (UID: \"55c95344-82d4-4a57-8d16-626635c0abe9\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"
Jul 02 21:44:43.008696 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:43.008654    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/55c95344-82d4-4a57-8d16-626635c0abe9-metrics-cert\") pod \"lws-controller-manager-bb99d9bb4-2qsnn\" (UID: \"55c95344-82d4-4a57-8d16-626635c0abe9\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"
Jul 02 21:44:43.008696 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:43.008679    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55c95344-82d4-4a57-8d16-626635c0abe9-cert\") pod \"lws-controller-manager-bb99d9bb4-2qsnn\" (UID: \"55c95344-82d4-4a57-8d16-626635c0abe9\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"
Jul 02 21:44:43.009045 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:43.008735    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-554bn\" (UniqueName: \"kubernetes.io/projected/55c95344-82d4-4a57-8d16-626635c0abe9-kube-api-access-554bn\") pod \"lws-controller-manager-bb99d9bb4-2qsnn\" (UID: \"55c95344-82d4-4a57-8d16-626635c0abe9\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"
Jul 02 21:44:43.009362 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:43.009339    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/55c95344-82d4-4a57-8d16-626635c0abe9-manager-config\") pod \"lws-controller-manager-bb99d9bb4-2qsnn\" (UID: \"55c95344-82d4-4a57-8d16-626635c0abe9\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"
Jul 02 21:44:43.011201 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:43.011183    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/55c95344-82d4-4a57-8d16-626635c0abe9-cert\") pod \"lws-controller-manager-bb99d9bb4-2qsnn\" (UID: \"55c95344-82d4-4a57-8d16-626635c0abe9\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"
Jul 02 21:44:43.011261 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:43.011227    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/55c95344-82d4-4a57-8d16-626635c0abe9-metrics-cert\") pod \"lws-controller-manager-bb99d9bb4-2qsnn\" (UID: \"55c95344-82d4-4a57-8d16-626635c0abe9\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"
Jul 02 21:44:43.024600 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:43.024577    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-554bn\" (UniqueName: \"kubernetes.io/projected/55c95344-82d4-4a57-8d16-626635c0abe9-kube-api-access-554bn\") pod \"lws-controller-manager-bb99d9bb4-2qsnn\" (UID: \"55c95344-82d4-4a57-8d16-626635c0abe9\") " pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"
Jul 02 21:44:43.073414 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:43.073390    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"
Jul 02 21:44:43.202941 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:43.202918    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"]
Jul 02 21:44:43.205049 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:44:43.205023    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c95344_82d4_4a57_8d16_626635c0abe9.slice/crio-28c140598faf614b8034ab72cc2bcb3547ba8d6a76ea7c982a4864ae4f5a898e WatchSource:0}: Error finding container 28c140598faf614b8034ab72cc2bcb3547ba8d6a76ea7c982a4864ae4f5a898e: Status 404 returned error can't find the container with id 28c140598faf614b8034ab72cc2bcb3547ba8d6a76ea7c982a4864ae4f5a898e
Jul 02 21:44:43.431804 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:43.431763    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn" event={"ID":"55c95344-82d4-4a57-8d16-626635c0abe9","Type":"ContainerStarted","Data":"28c140598faf614b8034ab72cc2bcb3547ba8d6a76ea7c982a4864ae4f5a898e"}
Jul 02 21:44:47.294488 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.294448    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"]
Jul 02 21:44:47.298173 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.298148    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.308221 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.308201    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 02 21:44:47.308415 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.308260    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 02 21:44:47.308536 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.308490    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 02 21:44:47.308611 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.308560    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pkmfn\""
Jul 02 21:44:47.308611 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.308499    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 02 21:44:47.308853 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.308839    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 21:44:47.309332 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.309318    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 21:44:47.318981 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.318962    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"]
Jul 02 21:44:47.446899 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.446846    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d766c99e-1d37-43f1-93ac-ac7dd597e106-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.447160 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.446919    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d766c99e-1d37-43f1-93ac-ac7dd597e106-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.447160 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.446947    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d766c99e-1d37-43f1-93ac-ac7dd597e106-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.447160 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.446982    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdljr\" (UniqueName: \"kubernetes.io/projected/d766c99e-1d37-43f1-93ac-ac7dd597e106-kube-api-access-cdljr\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.447160 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.447111    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d766c99e-1d37-43f1-93ac-ac7dd597e106-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.447405 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.447164    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d766c99e-1d37-43f1-93ac-ac7dd597e106-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.447405 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.447210    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d766c99e-1d37-43f1-93ac-ac7dd597e106-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.548145 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.548067    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d766c99e-1d37-43f1-93ac-ac7dd597e106-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.548145 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.548134    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d766c99e-1d37-43f1-93ac-ac7dd597e106-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.548364 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.548178    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d766c99e-1d37-43f1-93ac-ac7dd597e106-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.548364 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.548222    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d766c99e-1d37-43f1-93ac-ac7dd597e106-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.548364 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.548255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d766c99e-1d37-43f1-93ac-ac7dd597e106-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.548364 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.548271    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d766c99e-1d37-43f1-93ac-ac7dd597e106-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.548364 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.548289    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdljr\" (UniqueName: \"kubernetes.io/projected/d766c99e-1d37-43f1-93ac-ac7dd597e106-kube-api-access-cdljr\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.549599 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.549552    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d766c99e-1d37-43f1-93ac-ac7dd597e106-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.551363 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.551316    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d766c99e-1d37-43f1-93ac-ac7dd597e106-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.551479 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.551369    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d766c99e-1d37-43f1-93ac-ac7dd597e106-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.551840 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.551821    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d766c99e-1d37-43f1-93ac-ac7dd597e106-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.551909 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.551881    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d766c99e-1d37-43f1-93ac-ac7dd597e106-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.557073 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.557039    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdljr\" (UniqueName: \"kubernetes.io/projected/d766c99e-1d37-43f1-93ac-ac7dd597e106-kube-api-access-cdljr\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.557268 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.557225    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d766c99e-1d37-43f1-93ac-ac7dd597e106-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-j7hhc\" (UID: \"d766c99e-1d37-43f1-93ac-ac7dd597e106\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.609104 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.609068    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:44:47.802226 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:47.802200    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"]
Jul 02 21:44:47.804068 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:44:47.804042    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd766c99e_1d37_43f1_93ac_ac7dd597e106.slice/crio-039682b846adc818f4735bc7325c7e29c419a5e248cc3e0fc829a668264384b3 WatchSource:0}: Error finding container 039682b846adc818f4735bc7325c7e29c419a5e248cc3e0fc829a668264384b3: Status 404 returned error can't find the container with id 039682b846adc818f4735bc7325c7e29c419a5e248cc3e0fc829a668264384b3
Jul 02 21:44:48.455173 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:48.455131    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc" event={"ID":"d766c99e-1d37-43f1-93ac-ac7dd597e106","Type":"ContainerStarted","Data":"039682b846adc818f4735bc7325c7e29c419a5e248cc3e0fc829a668264384b3"}
Jul 02 21:44:48.456657 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:48.456638    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn" event={"ID":"55c95344-82d4-4a57-8d16-626635c0abe9","Type":"ContainerStarted","Data":"1018ef3c0274879e2baae796b50d5a307484263ee868fd77499c4d675d569144"}
Jul 02 21:44:48.456771 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:48.456758    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"
Jul 02 21:44:48.506518 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:48.506477    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn" podStartSLOduration=2.05674259 podStartE2EDuration="6.506464678s" totalImagesPullingTime="4.449722088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:44:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:44:48.504133172 +0000 UTC m=+821.541612480" watchObservedRunningTime="2026-07-02 21:44:48.506464678 +0000 UTC m=+821.543944046"
Jul 02 21:44:50.257797 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:50.257768    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:50.484296 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:50.484259    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:50.617897 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:50.617871    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:51.337237 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:51.337207    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:52.449090 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:52.449058    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:52.613971 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:52.613940    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:55.365378 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:55.365333    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:55.514821 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:55.514784    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:55.836415 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:55.836330    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:56.160737 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:56.160709    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:56.282107 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:56.282081    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:44:59.462980 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:44:59.462950    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-bb99d9bb4-2qsnn"
Jul 02 21:45:14.108739 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:45:14.108702    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 21:45:14.109167 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:45:14.108779    2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 02 21:45:14.568983 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:45:14.568893    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc" event={"ID":"d766c99e-1d37-43f1-93ac-ac7dd597e106","Type":"ContainerStarted","Data":"3f1b3b3cbdcd9e50d7f87f923916c9b376d1e64ac59c6751fe92e6cfb003054d"}
Jul 02 21:45:14.569154 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:45:14.569043    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:45:14.596179 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:45:14.596126    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc" podStartSLOduration=1.293878712 podStartE2EDuration="27.596104094s" totalImagesPullingTime="26.302225382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:45:14.59372588 +0000 UTC m=+847.631205189" watchObservedRunningTime="2026-07-02 21:45:14.596104094 +0000 UTC m=+847.633583402"
Jul 02 21:45:15.574854 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:45:15.574826    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-j7hhc"
Jul 02 21:45:39.557577 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:45:39.557514    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:45:39.659859 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:45:39.659818    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:45:39.749873 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:45:39.749829    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:45:40.434513 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:45:40.434481    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:45:40.631810 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:45:40.631755    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:08.561080 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:08.561047    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:12.208427 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:12.208392    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:12.301516 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:12.301486    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:16.762232 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:16.762203    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:17.213138 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:17.213103    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:18.665615 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:18.665581    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:20.187061 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:20.187024    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:21.005973 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:21.005943    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:21.101379 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:21.101338    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:23.006756 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:23.006726    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:24.373939 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:24.373913    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:24.478679 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:24.478626    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:26.044410 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:26.044365    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:26.426921 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:26.426888    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:27.576843 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:27.576809    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:27.677298 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:27.677270    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:29.674410 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:29.674382    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:29.776594 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:29.776569    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:36.414783 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:36.414747    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:36.511383 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:36.511354    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:37.181972 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:37.181875    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"]
Jul 02 21:46:37.190554 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:37.185095    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"
Jul 02 21:46:37.190554 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:37.190497    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 21:46:37.190780 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:37.190765    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nkt56\""
Jul 02 21:46:37.191064 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:37.191051    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 21:46:37.203602 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:37.203584    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"]
Jul 02 21:46:37.300877 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:37.300853    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jljnw\" (UniqueName: \"kubernetes.io/projected/ae459f7a-3574-47ab-ae51-d1ff836a7b8f-kube-api-access-jljnw\") pod \"kuadrant-operator-controller-manager-86878c769f-w9xlc\" (UID: \"ae459f7a-3574-47ab-ae51-d1ff836a7b8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"
Jul 02 21:46:37.301033 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:37.300885    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae459f7a-3574-47ab-ae51-d1ff836a7b8f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w9xlc\" (UID: \"ae459f7a-3574-47ab-ae51-d1ff836a7b8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"
Jul 02 21:46:37.401972 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:37.401943    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jljnw\" (UniqueName: \"kubernetes.io/projected/ae459f7a-3574-47ab-ae51-d1ff836a7b8f-kube-api-access-jljnw\") pod \"kuadrant-operator-controller-manager-86878c769f-w9xlc\" (UID: \"ae459f7a-3574-47ab-ae51-d1ff836a7b8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"
Jul 02 21:46:37.402121 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:37.401979    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae459f7a-3574-47ab-ae51-d1ff836a7b8f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w9xlc\" (UID: \"ae459f7a-3574-47ab-ae51-d1ff836a7b8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"
Jul 02 21:46:37.402306 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:37.402288    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae459f7a-3574-47ab-ae51-d1ff836a7b8f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w9xlc\" (UID: \"ae459f7a-3574-47ab-ae51-d1ff836a7b8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"
Jul 02 21:46:37.411109 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:37.411090    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jljnw\" (UniqueName: \"kubernetes.io/projected/ae459f7a-3574-47ab-ae51-d1ff836a7b8f-kube-api-access-jljnw\") pod \"kuadrant-operator-controller-manager-86878c769f-w9xlc\" (UID: \"ae459f7a-3574-47ab-ae51-d1ff836a7b8f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"
Jul 02 21:46:37.495073 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:37.495020    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"
Jul 02 21:46:37.630850 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:37.630828    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"]
Jul 02 21:46:37.633585 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:46:37.633559    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae459f7a_3574_47ab_ae51_d1ff836a7b8f.slice/crio-979537d4aacc5d1a5f8edb8d1cb8bb9b5d641a9bfdebb801412bb0c0e2565bf6 WatchSource:0}: Error finding container 979537d4aacc5d1a5f8edb8d1cb8bb9b5d641a9bfdebb801412bb0c0e2565bf6: Status 404 returned error can't find the container with id 979537d4aacc5d1a5f8edb8d1cb8bb9b5d641a9bfdebb801412bb0c0e2565bf6
Jul 02 21:46:37.922167 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:37.922137    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc" event={"ID":"ae459f7a-3574-47ab-ae51-d1ff836a7b8f","Type":"ContainerStarted","Data":"979537d4aacc5d1a5f8edb8d1cb8bb9b5d641a9bfdebb801412bb0c0e2565bf6"}
Jul 02 21:46:38.857020 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:38.856973    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:40.202861 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:40.202817    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:42.949338 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:42.949302    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc" event={"ID":"ae459f7a-3574-47ab-ae51-d1ff836a7b8f","Type":"ContainerStarted","Data":"78d0bdba247f35c36fb478fda66f2fd040ad5034f7a68021166d6b20be5b3fec"}
Jul 02 21:46:42.949780 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:42.949358    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"
Jul 02 21:46:42.970093 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:42.969968    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc" podStartSLOduration=1.198070874 podStartE2EDuration="5.969950092s" totalImagesPullingTime="4.771879218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:46:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:46:42.968228009 +0000 UTC m=+936.005707311" watchObservedRunningTime="2026-07-02 21:46:42.969950092 +0000 UTC m=+936.007429401"
Jul 02 21:46:43.185302 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:43.185263    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:43.290811 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:43.290729    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:45.388586 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:45.388550    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:45.489356 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:45.489325    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:53.955509 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:53.955483    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"
Jul 02 21:46:54.143496 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:54.143464    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:54.242097 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:54.242026    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:56.576470 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:56.576431    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:46:56.637159 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:46:56.637132    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:00.935371 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:00.935344    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:01.036111 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:01.036074    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:03.737870 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:03.737834    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:03.801977 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:03.801946    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:05.680045 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:05.679989    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:05.734356 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:05.734328    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:10.497631 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:10.497602    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:10.653316 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:10.653287    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:12.347976 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:12.347943    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:12.455321 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:12.455285    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:12.512862 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:12.512827    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:12.940671 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:12.940634    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:13.006224 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:13.006195    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:13.213119 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:13.213048    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:13.272221 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:13.272195    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:15.394215 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:15.394186    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:15.449307 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:15.449282    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:17.133859 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:17.133822    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:17.235227 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:17.235193    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:22.005678 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:22.005645    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:22.057795 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:22.057770    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:34.032214 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:34.032136    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:45.871149 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:45.871118    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:46.013219 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:46.013187    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:52.180379 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:52.180345    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:52.282123 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:52.282088    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:52.345588 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:52.345562    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:52.454175 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:52.454112    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:55.478799 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:55.478758    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:47:55.564136 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:47:55.564107    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:48:13.047323 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:13.047289    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:48:13.149091 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:13.149062    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:48:26.325906 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:26.325871    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:48:26.761534 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:26.761496    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:48:26.832609 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:26.832578    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-789554f86d-pct74"]
Jul 02 21:48:26.835855 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:26.835837    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-789554f86d-pct74"
Jul 02 21:48:26.838344 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:26.838325    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-vnrlr\""
Jul 02 21:48:26.839408 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:26.839390    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 02 21:48:26.845638 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:26.845619    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-789554f86d-pct74"]
Jul 02 21:48:26.875646 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:26.875625    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:48:26.896439 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:26.896413    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af49ec9e-5422-405b-a4e0-2ef80d793939-openshift-service-ca\") pod \"maas-api-789554f86d-pct74\" (UID: \"af49ec9e-5422-405b-a4e0-2ef80d793939\") " pod="opendatahub/maas-api-789554f86d-pct74"
Jul 02 21:48:26.896531 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:26.896469    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af49ec9e-5422-405b-a4e0-2ef80d793939-maas-api-tls\") pod \"maas-api-789554f86d-pct74\" (UID: \"af49ec9e-5422-405b-a4e0-2ef80d793939\") " pod="opendatahub/maas-api-789554f86d-pct74"
Jul 02 21:48:26.896581 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:26.896556    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmclr\" (UniqueName: \"kubernetes.io/projected/af49ec9e-5422-405b-a4e0-2ef80d793939-kube-api-access-kmclr\") pod \"maas-api-789554f86d-pct74\" (UID: \"af49ec9e-5422-405b-a4e0-2ef80d793939\") " pod="opendatahub/maas-api-789554f86d-pct74"
Jul 02 21:48:26.997850 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:26.997818    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af49ec9e-5422-405b-a4e0-2ef80d793939-maas-api-tls\") pod \"maas-api-789554f86d-pct74\" (UID: \"af49ec9e-5422-405b-a4e0-2ef80d793939\") " pod="opendatahub/maas-api-789554f86d-pct74"
Jul 02 21:48:26.997984 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:26.997889    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmclr\" (UniqueName: \"kubernetes.io/projected/af49ec9e-5422-405b-a4e0-2ef80d793939-kube-api-access-kmclr\") pod \"maas-api-789554f86d-pct74\" (UID: \"af49ec9e-5422-405b-a4e0-2ef80d793939\") " pod="opendatahub/maas-api-789554f86d-pct74"
Jul 02 21:48:26.997984 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:26.997960    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af49ec9e-5422-405b-a4e0-2ef80d793939-openshift-service-ca\") pod \"maas-api-789554f86d-pct74\" (UID: \"af49ec9e-5422-405b-a4e0-2ef80d793939\") " pod="opendatahub/maas-api-789554f86d-pct74"
Jul 02 21:48:26.998649 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:26.998627    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af49ec9e-5422-405b-a4e0-2ef80d793939-openshift-service-ca\") pod \"maas-api-789554f86d-pct74\" (UID: \"af49ec9e-5422-405b-a4e0-2ef80d793939\") " pod="opendatahub/maas-api-789554f86d-pct74"
Jul 02 21:48:27.000220 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:27.000197    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af49ec9e-5422-405b-a4e0-2ef80d793939-maas-api-tls\") pod \"maas-api-789554f86d-pct74\" (UID: \"af49ec9e-5422-405b-a4e0-2ef80d793939\") " pod="opendatahub/maas-api-789554f86d-pct74"
Jul 02 21:48:27.016953 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:27.016901    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmclr\" (UniqueName: \"kubernetes.io/projected/af49ec9e-5422-405b-a4e0-2ef80d793939-kube-api-access-kmclr\") pod \"maas-api-789554f86d-pct74\" (UID: \"af49ec9e-5422-405b-a4e0-2ef80d793939\") " pod="opendatahub/maas-api-789554f86d-pct74"
Jul 02 21:48:27.147309 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:27.147278    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-789554f86d-pct74"
Jul 02 21:48:27.233656 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:27.233628    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:48:27.286399 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:27.286376    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-789554f86d-pct74"]
Jul 02 21:48:27.288711 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:48:27.288682    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf49ec9e_5422_405b_a4e0_2ef80d793939.slice/crio-c76df4bdd2563abf8fc049ded3bf9d08a1b36c227650ad8f2c1de35e64a00ebe WatchSource:0}: Error finding container c76df4bdd2563abf8fc049ded3bf9d08a1b36c227650ad8f2c1de35e64a00ebe: Status 404 returned error can't find the container with id c76df4bdd2563abf8fc049ded3bf9d08a1b36c227650ad8f2c1de35e64a00ebe
Jul 02 21:48:27.333578 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:27.333536    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:48:27.391030 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:27.390973    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-789554f86d-pct74" event={"ID":"af49ec9e-5422-405b-a4e0-2ef80d793939","Type":"ContainerStarted","Data":"c76df4bdd2563abf8fc049ded3bf9d08a1b36c227650ad8f2c1de35e64a00ebe"}
Jul 02 21:48:30.409284 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:30.409241    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-789554f86d-pct74" event={"ID":"af49ec9e-5422-405b-a4e0-2ef80d793939","Type":"ContainerStarted","Data":"581231e68eef31a7e35a9415738f29a552d428db3fdc2e51f547d97bcd852919"}
Jul 02 21:48:30.409675 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:30.409378    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-789554f86d-pct74"
Jul 02 21:48:30.428141 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:30.428092    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-789554f86d-pct74" podStartSLOduration=2.123240048 podStartE2EDuration="4.428078104s" totalImagesPullingTime="2.304838056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:48:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:48:30.426524668 +0000 UTC m=+1043.464003967" watchObservedRunningTime="2026-07-02 21:48:30.428078104 +0000 UTC m=+1043.465557413"
Jul 02 21:48:36.419450 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:36.419422    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-789554f86d-pct74"
Jul 02 21:48:37.408408 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:37.408368    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:48:37.507953 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:37.507919    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:48:52.174522 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:52.174485    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:48:53.186796 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:53.186762    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:48:55.958797 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:55.958752    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:48:56.060374 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:56.060337    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:48:59.316451 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.316375    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"]
Jul 02 21:48:59.320090 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.320070    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.324180 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.324160    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p7grx\""
Jul 02 21:48:59.324297 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.324194    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 02 21:48:59.324297 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.324160    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 21:48:59.324466 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.324446    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 21:48:59.329395 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.329373    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"]
Jul 02 21:48:59.361173 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.361147    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:48:59.372205 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.372183    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf7985b-2c93-4661-8a86-880d3a51be4e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.372271 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.372230    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adf7985b-2c93-4661-8a86-880d3a51be4e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.372308 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.372269    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adf7985b-2c93-4661-8a86-880d3a51be4e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.372308 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.372299    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adf7985b-2c93-4661-8a86-880d3a51be4e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.372371 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.372326    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9mhm\" (UniqueName: \"kubernetes.io/projected/adf7985b-2c93-4661-8a86-880d3a51be4e-kube-api-access-b9mhm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.372408 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.372390    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf7985b-2c93-4661-8a86-880d3a51be4e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.473454 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.473425    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adf7985b-2c93-4661-8a86-880d3a51be4e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.473567 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.473467    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adf7985b-2c93-4661-8a86-880d3a51be4e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.473567 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.473489    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adf7985b-2c93-4661-8a86-880d3a51be4e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.473567 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.473526    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9mhm\" (UniqueName: \"kubernetes.io/projected/adf7985b-2c93-4661-8a86-880d3a51be4e-kube-api-access-b9mhm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.473732 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.473570    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf7985b-2c93-4661-8a86-880d3a51be4e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.473732 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.473622    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf7985b-2c93-4661-8a86-880d3a51be4e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.473874 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.473823    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adf7985b-2c93-4661-8a86-880d3a51be4e-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.473934 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.473914    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adf7985b-2c93-4661-8a86-880d3a51be4e-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.473995 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.473943    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adf7985b-2c93-4661-8a86-880d3a51be4e-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.475593 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.475574    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adf7985b-2c93-4661-8a86-880d3a51be4e-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.475997 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.475978    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adf7985b-2c93-4661-8a86-880d3a51be4e-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.481715 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.481694    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9mhm\" (UniqueName: \"kubernetes.io/projected/adf7985b-2c93-4661-8a86-880d3a51be4e-kube-api-access-b9mhm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pmfht\" (UID: \"adf7985b-2c93-4661-8a86-880d3a51be4e\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.631451 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.631426    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:48:59.762492 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:48:59.762462    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"]
Jul 02 21:48:59.764291 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:48:59.764268    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadf7985b_2c93_4661_8a86_880d3a51be4e.slice/crio-0290b782483c332e5e7270ca2bc238171b3606a3b0440194bceda07ad5791b33 WatchSource:0}: Error finding container 0290b782483c332e5e7270ca2bc238171b3606a3b0440194bceda07ad5791b33: Status 404 returned error can't find the container with id 0290b782483c332e5e7270ca2bc238171b3606a3b0440194bceda07ad5791b33
Jul 02 21:49:00.544946 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:00.544910    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht" event={"ID":"adf7985b-2c93-4661-8a86-880d3a51be4e","Type":"ContainerStarted","Data":"0290b782483c332e5e7270ca2bc238171b3606a3b0440194bceda07ad5791b33"}
Jul 02 21:49:01.550219 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:01.550184    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht" event={"ID":"adf7985b-2c93-4661-8a86-880d3a51be4e","Type":"ContainerStarted","Data":"918bbc6a67ba7193774dfc9e39827e6ced946fbed5955b8a8a8832ca3810b034"}
Jul 02 21:49:01.568929 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:01.568837    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht" podStartSLOduration=1.540264052 podStartE2EDuration="2.568822279s" totalImagesPullingTime="1.028558227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:48:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:49:01.566963985 +0000 UTC m=+1074.604443294" watchObservedRunningTime="2026-07-02 21:49:01.568822279 +0000 UTC m=+1074.606301587"
Jul 02 21:49:09.632176 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:09.632140    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:49:09.632576 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:09.632201    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:49:09.644534 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:09.644504    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:49:10.599721 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:10.599683    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pmfht"
Jul 02 21:49:12.222398 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.222367    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"]
Jul 02 21:49:12.225960 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.225939    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.228585 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.228562    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 02 21:49:12.237573 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.237547    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"]
Jul 02 21:49:12.264994 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.264969    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:49:12.383398 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.383372    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/054f3c37-e658-4840-9cde-da8cedda43ca-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.383398 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.383401    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/054f3c37-e658-4840-9cde-da8cedda43ca-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.383580 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.383425    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/054f3c37-e658-4840-9cde-da8cedda43ca-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.383580 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.383445    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbpjr\" (UniqueName: \"kubernetes.io/projected/054f3c37-e658-4840-9cde-da8cedda43ca-kube-api-access-pbpjr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.383580 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.383523    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/054f3c37-e658-4840-9cde-da8cedda43ca-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.383685 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.383592    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/054f3c37-e658-4840-9cde-da8cedda43ca-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.484217 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.484153    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/054f3c37-e658-4840-9cde-da8cedda43ca-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.484217 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.484197    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/054f3c37-e658-4840-9cde-da8cedda43ca-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.484386 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.484223    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/054f3c37-e658-4840-9cde-da8cedda43ca-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.484386 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.484255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/054f3c37-e658-4840-9cde-da8cedda43ca-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.484386 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.484283    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbpjr\" (UniqueName: \"kubernetes.io/projected/054f3c37-e658-4840-9cde-da8cedda43ca-kube-api-access-pbpjr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.484386 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.484348    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/054f3c37-e658-4840-9cde-da8cedda43ca-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.484617 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.484595    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/054f3c37-e658-4840-9cde-da8cedda43ca-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.484667 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.484639    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/054f3c37-e658-4840-9cde-da8cedda43ca-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.484703 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.484687    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/054f3c37-e658-4840-9cde-da8cedda43ca-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.486475 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.486456    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/054f3c37-e658-4840-9cde-da8cedda43ca-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.486657 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.486638    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/054f3c37-e658-4840-9cde-da8cedda43ca-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.492699 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.492678    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbpjr\" (UniqueName: \"kubernetes.io/projected/054f3c37-e658-4840-9cde-da8cedda43ca-kube-api-access-pbpjr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-sp6l4\" (UID: \"054f3c37-e658-4840-9cde-da8cedda43ca\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.537477 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.537447    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:12.667604 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:12.667574    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"]
Jul 02 21:49:12.669436 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:49:12.669402    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054f3c37_e658_4840_9cde_da8cedda43ca.slice/crio-16d546c1edae5c17af71a84def6e0c7f37a771bd9bb4918c3a91df09470f538d WatchSource:0}: Error finding container 16d546c1edae5c17af71a84def6e0c7f37a771bd9bb4918c3a91df09470f538d: Status 404 returned error can't find the container with id 16d546c1edae5c17af71a84def6e0c7f37a771bd9bb4918c3a91df09470f538d
Jul 02 21:49:13.602711 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:13.602680    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4" event={"ID":"054f3c37-e658-4840-9cde-da8cedda43ca","Type":"ContainerStarted","Data":"2c6ee98da6cc26dc77aefaa910137833edc6932acfa3f97d666e364348f488b9"}
Jul 02 21:49:13.603110 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:13.602722    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4" event={"ID":"054f3c37-e658-4840-9cde-da8cedda43ca","Type":"ContainerStarted","Data":"16d546c1edae5c17af71a84def6e0c7f37a771bd9bb4918c3a91df09470f538d"}
Jul 02 21:49:13.621239 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:13.621196    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4" podStartSLOduration=1.444036184 podStartE2EDuration="1.621179152s" totalImagesPullingTime="177.142968ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:49:13.619896229 +0000 UTC m=+1086.657375540" watchObservedRunningTime="2026-07-02 21:49:13.621179152 +0000 UTC m=+1086.658658459"
Jul 02 21:49:20.856441 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:20.856403    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:49:22.537593 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:22.537556    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:22.537998 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:22.537618    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:22.550786 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:22.550764    2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:22.653225 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:22.653201    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-sp6l4"
Jul 02 21:49:32.301422 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:32.301385    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:49:41.169507 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:49:41.169478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:50:43.511386 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:50:43.511305    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:50:43.606613 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:50:43.606582    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:50:44.703953 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:50:44.703922    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:50:44.807695 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:50:44.807653    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:51:59.245334 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:51:59.245259    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:52:00.810530 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:52:00.810492    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:52:36.192756 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:52:36.192720    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:52:36.325000 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:52:36.324967    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:52:36.430194 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:52:36.430166    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:52:42.533481 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:52:42.533443    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:52:42.635567 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:52:42.635532    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:52:42.734090 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:52:42.734054    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:52:42.883581 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:52:42.883549    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:52:46.921263 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:52:46.921230    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:52:48.461388 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:52:48.461347    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:52:48.560552 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:52:48.560517    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:53:26.479522 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:53:26.479460    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:55:52.859130 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:55:52.859098    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:56:12.948394 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:12.948351    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:56:40.749823 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:40.749747    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"]
Jul 02 21:56:40.750468 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:40.749967    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc" podUID="ae459f7a-3574-47ab-ae51-d1ff836a7b8f" containerName="manager" containerID="cri-o://78d0bdba247f35c36fb478fda66f2fd040ad5034f7a68021166d6b20be5b3fec" gracePeriod=10
Jul 02 21:56:42.598214 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:42.598183    2575 generic.go:356] "Generic (PLEG): container finished" podID="ae459f7a-3574-47ab-ae51-d1ff836a7b8f" containerID="78d0bdba247f35c36fb478fda66f2fd040ad5034f7a68021166d6b20be5b3fec" exitCode=0
Jul 02 21:56:42.598565 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:42.598256    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc" event={"ID":"ae459f7a-3574-47ab-ae51-d1ff836a7b8f","Type":"ContainerDied","Data":"78d0bdba247f35c36fb478fda66f2fd040ad5034f7a68021166d6b20be5b3fec"}
Jul 02 21:56:42.995864 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:42.995835    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"
Jul 02 21:56:43.078927 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:43.078900    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae459f7a-3574-47ab-ae51-d1ff836a7b8f-extensions-socket-volume\") pod \"ae459f7a-3574-47ab-ae51-d1ff836a7b8f\" (UID: \"ae459f7a-3574-47ab-ae51-d1ff836a7b8f\") "
Jul 02 21:56:43.079087 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:43.078958    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jljnw\" (UniqueName: \"kubernetes.io/projected/ae459f7a-3574-47ab-ae51-d1ff836a7b8f-kube-api-access-jljnw\") pod \"ae459f7a-3574-47ab-ae51-d1ff836a7b8f\" (UID: \"ae459f7a-3574-47ab-ae51-d1ff836a7b8f\") "
Jul 02 21:56:43.079342 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:43.079320    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae459f7a-3574-47ab-ae51-d1ff836a7b8f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ae459f7a-3574-47ab-ae51-d1ff836a7b8f" (UID: "ae459f7a-3574-47ab-ae51-d1ff836a7b8f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 21:56:43.080976 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:43.080957    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae459f7a-3574-47ab-ae51-d1ff836a7b8f-kube-api-access-jljnw" (OuterVolumeSpecName: "kube-api-access-jljnw") pod "ae459f7a-3574-47ab-ae51-d1ff836a7b8f" (UID: "ae459f7a-3574-47ab-ae51-d1ff836a7b8f"). InnerVolumeSpecName "kube-api-access-jljnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 21:56:43.180455 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:43.180390    2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ae459f7a-3574-47ab-ae51-d1ff836a7b8f-extensions-socket-volume\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:56:43.180455 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:43.180415    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jljnw\" (UniqueName: \"kubernetes.io/projected/ae459f7a-3574-47ab-ae51-d1ff836a7b8f-kube-api-access-jljnw\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 21:56:43.603362 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:43.603333    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc" event={"ID":"ae459f7a-3574-47ab-ae51-d1ff836a7b8f","Type":"ContainerDied","Data":"979537d4aacc5d1a5f8edb8d1cb8bb9b5d641a9bfdebb801412bb0c0e2565bf6"}
Jul 02 21:56:43.603362 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:43.603353    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"
Jul 02 21:56:43.603819 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:43.603390    2575 scope.go:117] "RemoveContainer" containerID="78d0bdba247f35c36fb478fda66f2fd040ad5034f7a68021166d6b20be5b3fec"
Jul 02 21:56:43.621917 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:43.621896    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"]
Jul 02 21:56:43.627903 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:43.627883    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w9xlc"]
Jul 02 21:56:45.524385 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:56:45.524356    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae459f7a-3574-47ab-ae51-d1ff836a7b8f" path="/var/lib/kubelet/pods/ae459f7a-3574-47ab-ae51-d1ff836a7b8f/volumes"
Jul 02 21:57:41.922492 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:41.922460    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dhfkm"]
Jul 02 21:57:41.922952 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:41.922786    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae459f7a-3574-47ab-ae51-d1ff836a7b8f" containerName="manager"
Jul 02 21:57:41.922952 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:41.922797    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae459f7a-3574-47ab-ae51-d1ff836a7b8f" containerName="manager"
Jul 02 21:57:41.922952 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:41.922867    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae459f7a-3574-47ab-ae51-d1ff836a7b8f" containerName="manager"
Jul 02 21:57:41.925742 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:41.925727    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dhfkm"
Jul 02 21:57:41.928452 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:41.928431    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nkt56\""
Jul 02 21:57:41.928452 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:41.928441    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 21:57:41.928651 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:41.928430    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 21:57:41.939216 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:41.939193    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dhfkm"]
Jul 02 21:57:42.073790 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:42.073761    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1c5c10f-b8e4-4433-8b6e-116ca2e2cdd6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dhfkm\" (UID: \"a1c5c10f-b8e4-4433-8b6e-116ca2e2cdd6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dhfkm"
Jul 02 21:57:42.073938 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:42.073802    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m2f5\" (UniqueName: \"kubernetes.io/projected/a1c5c10f-b8e4-4433-8b6e-116ca2e2cdd6-kube-api-access-6m2f5\") pod \"kuadrant-operator-controller-manager-86878c769f-dhfkm\" (UID: \"a1c5c10f-b8e4-4433-8b6e-116ca2e2cdd6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dhfkm"
Jul 02 21:57:42.174631 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:42.174563    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1c5c10f-b8e4-4433-8b6e-116ca2e2cdd6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dhfkm\" (UID: \"a1c5c10f-b8e4-4433-8b6e-116ca2e2cdd6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dhfkm"
Jul 02 21:57:42.174631 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:42.174598    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m2f5\" (UniqueName: \"kubernetes.io/projected/a1c5c10f-b8e4-4433-8b6e-116ca2e2cdd6-kube-api-access-6m2f5\") pod \"kuadrant-operator-controller-manager-86878c769f-dhfkm\" (UID: \"a1c5c10f-b8e4-4433-8b6e-116ca2e2cdd6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dhfkm"
Jul 02 21:57:42.174905 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:42.174886    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a1c5c10f-b8e4-4433-8b6e-116ca2e2cdd6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dhfkm\" (UID: \"a1c5c10f-b8e4-4433-8b6e-116ca2e2cdd6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dhfkm"
Jul 02 21:57:42.183287 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:42.183265    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m2f5\" (UniqueName: \"kubernetes.io/projected/a1c5c10f-b8e4-4433-8b6e-116ca2e2cdd6-kube-api-access-6m2f5\") pod \"kuadrant-operator-controller-manager-86878c769f-dhfkm\" (UID: \"a1c5c10f-b8e4-4433-8b6e-116ca2e2cdd6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dhfkm"
Jul 02 21:57:42.235658 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:42.235636    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dhfkm"
Jul 02 21:57:42.375060 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:42.375037    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dhfkm"]
Jul 02 21:57:42.376877 ip-10-0-139-110 kubenswrapper[2575]: W0702 21:57:42.376848    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c5c10f_b8e4_4433_8b6e_116ca2e2cdd6.slice/crio-4c9905cd68a3c25092a231c329f9f1407310414bf75f951cebb3bd7ed5c2fbde WatchSource:0}: Error finding container 4c9905cd68a3c25092a231c329f9f1407310414bf75f951cebb3bd7ed5c2fbde: Status 404 returned error can't find the container with id 4c9905cd68a3c25092a231c329f9f1407310414bf75f951cebb3bd7ed5c2fbde
Jul 02 21:57:42.864449 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:42.864412    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dhfkm" event={"ID":"a1c5c10f-b8e4-4433-8b6e-116ca2e2cdd6","Type":"ContainerStarted","Data":"c81199b41d4f0d3bad8a145a88a25103268ec49737b7ddef683a790d5167d4bb"}
Jul 02 21:57:42.864614 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:42.864474    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dhfkm" event={"ID":"a1c5c10f-b8e4-4433-8b6e-116ca2e2cdd6","Type":"ContainerStarted","Data":"4c9905cd68a3c25092a231c329f9f1407310414bf75f951cebb3bd7ed5c2fbde"}
Jul 02 21:57:42.864614 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:42.864591    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dhfkm"
Jul 02 21:57:42.884920 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:42.884874    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dhfkm" podStartSLOduration=1.884859984 podStartE2EDuration="1.884859984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 21:57:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:57:42.882305694 +0000 UTC m=+1595.919785003" watchObservedRunningTime="2026-07-02 21:57:42.884859984 +0000 UTC m=+1595.922339355"
Jul 02 21:57:48.283684 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:48.283648    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 21:57:53.870999 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:53.870969    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dhfkm"
Jul 02 21:57:59.158268 ip-10-0-139-110 kubenswrapper[2575]: I0702 21:57:59.158181    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:02:42.927099 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:02:42.926988    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:03:20.201751 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:03:20.201704    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:03:43.877661 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:03:43.877627    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:03:52.158308 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:03:52.158268    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:03:57.281498 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:03:57.281455    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:00.092544 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:00.092457    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:00.193887 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:00.193853    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:00.518819 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:00.518786    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:06.411876 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:06.411760    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:06.477838 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:06.477805    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:06.644396 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:06.644363    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:06.722043 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:06.721935    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:07.829127 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:07.829089    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:07.937068 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:07.937037    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"]
Jul 02 22:04:07.940641 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:07.940624    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"
Jul 02 22:04:07.944217 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:07.944196    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-21dcdf63-serving-cert\""
Jul 02 22:04:07.971151 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:07.971126    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"]
Jul 02 22:04:07.972448 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:07.972426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d9e348f-7f94-41a4-816f-8246fa12420c-maas-api-tls\") pod \"maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg\" (UID: \"7d9e348f-7f94-41a4-816f-8246fa12420c\") " pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"
Jul 02 22:04:07.972567 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:07.972459    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbrpn\" (UniqueName: \"kubernetes.io/projected/7d9e348f-7f94-41a4-816f-8246fa12420c-kube-api-access-tbrpn\") pod \"maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg\" (UID: \"7d9e348f-7f94-41a4-816f-8246fa12420c\") " pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"
Jul 02 22:04:07.972567 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:07.972518    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d9e348f-7f94-41a4-816f-8246fa12420c-openshift-service-ca\") pod \"maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg\" (UID: \"7d9e348f-7f94-41a4-816f-8246fa12420c\") " pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"
Jul 02 22:04:08.050987 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:08.050951    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:08.073200 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:08.073171    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d9e348f-7f94-41a4-816f-8246fa12420c-maas-api-tls\") pod \"maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg\" (UID: \"7d9e348f-7f94-41a4-816f-8246fa12420c\") " pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"
Jul 02 22:04:08.073343 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:08.073205    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbrpn\" (UniqueName: \"kubernetes.io/projected/7d9e348f-7f94-41a4-816f-8246fa12420c-kube-api-access-tbrpn\") pod \"maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg\" (UID: \"7d9e348f-7f94-41a4-816f-8246fa12420c\") " pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"
Jul 02 22:04:08.073343 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:08.073250    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d9e348f-7f94-41a4-816f-8246fa12420c-openshift-service-ca\") pod \"maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg\" (UID: \"7d9e348f-7f94-41a4-816f-8246fa12420c\") " pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"
Jul 02 22:04:08.073860 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:08.073841    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d9e348f-7f94-41a4-816f-8246fa12420c-openshift-service-ca\") pod \"maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg\" (UID: \"7d9e348f-7f94-41a4-816f-8246fa12420c\") " pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"
Jul 02 22:04:08.075542 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:08.075525    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d9e348f-7f94-41a4-816f-8246fa12420c-maas-api-tls\") pod \"maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg\" (UID: \"7d9e348f-7f94-41a4-816f-8246fa12420c\") " pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"
Jul 02 22:04:08.092516 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:08.092455    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbrpn\" (UniqueName: \"kubernetes.io/projected/7d9e348f-7f94-41a4-816f-8246fa12420c-kube-api-access-tbrpn\") pod \"maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg\" (UID: \"7d9e348f-7f94-41a4-816f-8246fa12420c\") " pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"
Jul 02 22:04:08.158196 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:08.158172    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:08.251488 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:08.251461    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"
Jul 02 22:04:08.385394 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:08.385220    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"]
Jul 02 22:04:08.389532 ip-10-0-139-110 kubenswrapper[2575]: W0702 22:04:08.389506    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d9e348f_7f94_41a4_816f_8246fa12420c.slice/crio-a43ab5c8da78592d70be3e7de5e006400a130523674066fc48b52c52e1e4da32 WatchSource:0}: Error finding container a43ab5c8da78592d70be3e7de5e006400a130523674066fc48b52c52e1e4da32: Status 404 returned error can't find the container with id a43ab5c8da78592d70be3e7de5e006400a130523674066fc48b52c52e1e4da32
Jul 02 22:04:08.390858 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:08.390837    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 22:04:08.544050 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:08.543995    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:08.591361 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:08.591332    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg" event={"ID":"7d9e348f-7f94-41a4-816f-8246fa12420c","Type":"ContainerStarted","Data":"a43ab5c8da78592d70be3e7de5e006400a130523674066fc48b52c52e1e4da32"}
Jul 02 22:04:08.644822 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:08.644736    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:09.597118 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:09.597088    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg" event={"ID":"7d9e348f-7f94-41a4-816f-8246fa12420c","Type":"ContainerStarted","Data":"5f8cb2ee5fdc518f51bcc230f866ccbf73942c305f3a1ae7f3016c2ce992e055"}
Jul 02 22:04:09.597471 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:09.597209    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"
Jul 02 22:04:09.616225 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:09.616177    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg" podStartSLOduration=2.096515359 podStartE2EDuration="2.616162554s" totalImagesPullingTime="519.647195ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:04:09.613944153 +0000 UTC m=+1982.651423480" watchObservedRunningTime="2026-07-02 22:04:09.616162554 +0000 UTC m=+1982.653641863"
Jul 02 22:04:10.439339 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:10.439302    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:13.133878 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:13.133837    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:13.268017 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:13.267978    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:13.368999 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:13.368966    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:13.527268 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:13.527185    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"]
Jul 02 22:04:13.527419 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:13.527388    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg" podUID="7d9e348f-7f94-41a4-816f-8246fa12420c" containerName="maas-api" containerID="cri-o://5f8cb2ee5fdc518f51bcc230f866ccbf73942c305f3a1ae7f3016c2ce992e055" gracePeriod=30
Jul 02 22:04:13.532955 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:13.532934    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"
Jul 02 22:04:13.549505 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:13.549478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:13.779807 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:13.779754    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"
Jul 02 22:04:13.824542 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:13.824514    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d9e348f-7f94-41a4-816f-8246fa12420c-maas-api-tls\") pod \"7d9e348f-7f94-41a4-816f-8246fa12420c\" (UID: \"7d9e348f-7f94-41a4-816f-8246fa12420c\") "
Jul 02 22:04:13.824695 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:13.824574    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbrpn\" (UniqueName: \"kubernetes.io/projected/7d9e348f-7f94-41a4-816f-8246fa12420c-kube-api-access-tbrpn\") pod \"7d9e348f-7f94-41a4-816f-8246fa12420c\" (UID: \"7d9e348f-7f94-41a4-816f-8246fa12420c\") "
Jul 02 22:04:13.824695 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:13.824623    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d9e348f-7f94-41a4-816f-8246fa12420c-openshift-service-ca\") pod \"7d9e348f-7f94-41a4-816f-8246fa12420c\" (UID: \"7d9e348f-7f94-41a4-816f-8246fa12420c\") "
Jul 02 22:04:13.825031 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:13.824976    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d9e348f-7f94-41a4-816f-8246fa12420c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7d9e348f-7f94-41a4-816f-8246fa12420c" (UID: "7d9e348f-7f94-41a4-816f-8246fa12420c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 22:04:13.826718 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:13.826695    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d9e348f-7f94-41a4-816f-8246fa12420c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7d9e348f-7f94-41a4-816f-8246fa12420c" (UID: "7d9e348f-7f94-41a4-816f-8246fa12420c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:04:13.826838 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:13.826744    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d9e348f-7f94-41a4-816f-8246fa12420c-kube-api-access-tbrpn" (OuterVolumeSpecName: "kube-api-access-tbrpn") pod "7d9e348f-7f94-41a4-816f-8246fa12420c" (UID: "7d9e348f-7f94-41a4-816f-8246fa12420c"). InnerVolumeSpecName "kube-api-access-tbrpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:04:13.926172 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:13.926148    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d9e348f-7f94-41a4-816f-8246fa12420c-maas-api-tls\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:04:13.926172 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:13.926168    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbrpn\" (UniqueName: \"kubernetes.io/projected/7d9e348f-7f94-41a4-816f-8246fa12420c-kube-api-access-tbrpn\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:04:13.926312 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:13.926179    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d9e348f-7f94-41a4-816f-8246fa12420c-openshift-service-ca\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:04:14.623101 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:14.623064    2575 generic.go:356] "Generic (PLEG): container finished" podID="7d9e348f-7f94-41a4-816f-8246fa12420c" containerID="5f8cb2ee5fdc518f51bcc230f866ccbf73942c305f3a1ae7f3016c2ce992e055" exitCode=0
Jul 02 22:04:14.623529 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:14.623117    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"
Jul 02 22:04:14.623529 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:14.623135    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg" event={"ID":"7d9e348f-7f94-41a4-816f-8246fa12420c","Type":"ContainerDied","Data":"5f8cb2ee5fdc518f51bcc230f866ccbf73942c305f3a1ae7f3016c2ce992e055"}
Jul 02 22:04:14.623529 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:14.623184    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg" event={"ID":"7d9e348f-7f94-41a4-816f-8246fa12420c","Type":"ContainerDied","Data":"a43ab5c8da78592d70be3e7de5e006400a130523674066fc48b52c52e1e4da32"}
Jul 02 22:04:14.623529 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:14.623215    2575 scope.go:117] "RemoveContainer" containerID="5f8cb2ee5fdc518f51bcc230f866ccbf73942c305f3a1ae7f3016c2ce992e055"
Jul 02 22:04:14.632521 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:14.632500    2575 scope.go:117] "RemoveContainer" containerID="5f8cb2ee5fdc518f51bcc230f866ccbf73942c305f3a1ae7f3016c2ce992e055"
Jul 02 22:04:14.632807 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:04:14.632783    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f8cb2ee5fdc518f51bcc230f866ccbf73942c305f3a1ae7f3016c2ce992e055\": container with ID starting with 5f8cb2ee5fdc518f51bcc230f866ccbf73942c305f3a1ae7f3016c2ce992e055 not found: ID does not exist" containerID="5f8cb2ee5fdc518f51bcc230f866ccbf73942c305f3a1ae7f3016c2ce992e055"
Jul 02 22:04:14.632860 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:14.632819    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8cb2ee5fdc518f51bcc230f866ccbf73942c305f3a1ae7f3016c2ce992e055"} err="failed to get container status \"5f8cb2ee5fdc518f51bcc230f866ccbf73942c305f3a1ae7f3016c2ce992e055\": rpc error: code = NotFound desc = could not find container \"5f8cb2ee5fdc518f51bcc230f866ccbf73942c305f3a1ae7f3016c2ce992e055\": container with ID starting with 5f8cb2ee5fdc518f51bcc230f866ccbf73942c305f3a1ae7f3016c2ce992e055 not found: ID does not exist"
Jul 02 22:04:14.644514 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:14.644489    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"]
Jul 02 22:04:14.648459 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:14.648438    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-21dcdf63-8576b8d7f8-txzmg"]
Jul 02 22:04:15.469719 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:15.469692    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:15.530891 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:15.530852    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d9e348f-7f94-41a4-816f-8246fa12420c" path="/var/lib/kubelet/pods/7d9e348f-7f94-41a4-816f-8246fa12420c/volumes"
Jul 02 22:04:19.073158 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:19.073116    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:19.174358 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:19.174302    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:19.292608 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:19.292573    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:19.393217 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:19.393180    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:20.513539 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.513500    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:20.565670 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.565629    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"]
Jul 02 22:04:20.566057 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.566031    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d9e348f-7f94-41a4-816f-8246fa12420c" containerName="maas-api"
Jul 02 22:04:20.566057 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.566050    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d9e348f-7f94-41a4-816f-8246fa12420c" containerName="maas-api"
Jul 02 22:04:20.566267 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.566130    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d9e348f-7f94-41a4-816f-8246fa12420c" containerName="maas-api"
Jul 02 22:04:20.570537 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.570521    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"
Jul 02 22:04:20.572945 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.572927    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-0956ab05-serving-cert\""
Jul 02 22:04:20.580673 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.580650    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"]
Jul 02 22:04:20.597466 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.597441    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:20.665342 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.665282    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:20.686870 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.686846    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n6tz\" (UniqueName: \"kubernetes.io/projected/5f17bc37-4d61-4f07-9778-a2d1047940f1-kube-api-access-8n6tz\") pod \"maas-api-e2e-ait-0956ab05-7766894997-lgr8g\" (UID: \"5f17bc37-4d61-4f07-9778-a2d1047940f1\") " pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"
Jul 02 22:04:20.686989 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.686893    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f17bc37-4d61-4f07-9778-a2d1047940f1-maas-api-tls\") pod \"maas-api-e2e-ait-0956ab05-7766894997-lgr8g\" (UID: \"5f17bc37-4d61-4f07-9778-a2d1047940f1\") " pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"
Jul 02 22:04:20.687057 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.687034    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f17bc37-4d61-4f07-9778-a2d1047940f1-openshift-service-ca\") pod \"maas-api-e2e-ait-0956ab05-7766894997-lgr8g\" (UID: \"5f17bc37-4d61-4f07-9778-a2d1047940f1\") " pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"
Jul 02 22:04:20.765542 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.765452    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:20.787722 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.787695    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n6tz\" (UniqueName: \"kubernetes.io/projected/5f17bc37-4d61-4f07-9778-a2d1047940f1-kube-api-access-8n6tz\") pod \"maas-api-e2e-ait-0956ab05-7766894997-lgr8g\" (UID: \"5f17bc37-4d61-4f07-9778-a2d1047940f1\") " pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"
Jul 02 22:04:20.787842 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.787729    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f17bc37-4d61-4f07-9778-a2d1047940f1-maas-api-tls\") pod \"maas-api-e2e-ait-0956ab05-7766894997-lgr8g\" (UID: \"5f17bc37-4d61-4f07-9778-a2d1047940f1\") " pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"
Jul 02 22:04:20.787842 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.787758    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f17bc37-4d61-4f07-9778-a2d1047940f1-openshift-service-ca\") pod \"maas-api-e2e-ait-0956ab05-7766894997-lgr8g\" (UID: \"5f17bc37-4d61-4f07-9778-a2d1047940f1\") " pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"
Jul 02 22:04:20.788428 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.788406    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f17bc37-4d61-4f07-9778-a2d1047940f1-openshift-service-ca\") pod \"maas-api-e2e-ait-0956ab05-7766894997-lgr8g\" (UID: \"5f17bc37-4d61-4f07-9778-a2d1047940f1\") " pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"
Jul 02 22:04:20.790092 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.790074    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f17bc37-4d61-4f07-9778-a2d1047940f1-maas-api-tls\") pod \"maas-api-e2e-ait-0956ab05-7766894997-lgr8g\" (UID: \"5f17bc37-4d61-4f07-9778-a2d1047940f1\") " pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"
Jul 02 22:04:20.797091 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.797071    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n6tz\" (UniqueName: \"kubernetes.io/projected/5f17bc37-4d61-4f07-9778-a2d1047940f1-kube-api-access-8n6tz\") pod \"maas-api-e2e-ait-0956ab05-7766894997-lgr8g\" (UID: \"5f17bc37-4d61-4f07-9778-a2d1047940f1\") " pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"
Jul 02 22:04:20.882366 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:20.882328    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"
Jul 02 22:04:21.015304 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:21.015280    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"]
Jul 02 22:04:21.017856 ip-10-0-139-110 kubenswrapper[2575]: W0702 22:04:21.017819    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f17bc37_4d61_4f07_9778_a2d1047940f1.slice/crio-6d8d2e398fdeb6b13d6b09be726532b3ee8722d09156806bdb4a3aa078acfe20 WatchSource:0}: Error finding container 6d8d2e398fdeb6b13d6b09be726532b3ee8722d09156806bdb4a3aa078acfe20: Status 404 returned error can't find the container with id 6d8d2e398fdeb6b13d6b09be726532b3ee8722d09156806bdb4a3aa078acfe20
Jul 02 22:04:21.061652 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:21.061618    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:21.164581 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:21.164549    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:21.658551 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:21.658520    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g" event={"ID":"5f17bc37-4d61-4f07-9778-a2d1047940f1","Type":"ContainerStarted","Data":"c49fbfdf88ab1e8e8334a08d999167b470c1bd13d11de6ba192ce0ee9462b914"}
Jul 02 22:04:21.658929 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:21.658570    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g" event={"ID":"5f17bc37-4d61-4f07-9778-a2d1047940f1","Type":"ContainerStarted","Data":"6d8d2e398fdeb6b13d6b09be726532b3ee8722d09156806bdb4a3aa078acfe20"}
Jul 02 22:04:21.658929 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:21.658640    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"
Jul 02 22:04:21.675516 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:21.675476    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g" podStartSLOduration=1.353902062 podStartE2EDuration="1.675462396s" totalImagesPullingTime="321.560334ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:04:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:04:21.67511301 +0000 UTC m=+1994.712592318" watchObservedRunningTime="2026-07-02 22:04:21.675462396 +0000 UTC m=+1994.712941704"
Jul 02 22:04:22.952518 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:22.952483    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:25.617632 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:25.617589    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:25.946754 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:25.946672    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"]
Jul 02 22:04:25.947203 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:25.947158    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g" podUID="5f17bc37-4d61-4f07-9778-a2d1047940f1" containerName="maas-api" containerID="cri-o://c49fbfdf88ab1e8e8334a08d999167b470c1bd13d11de6ba192ce0ee9462b914" gracePeriod=30
Jul 02 22:04:25.979653 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:25.979610    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:26.191603 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.191579    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"
Jul 02 22:04:26.337777 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.337700    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f17bc37-4d61-4f07-9778-a2d1047940f1-maas-api-tls\") pod \"5f17bc37-4d61-4f07-9778-a2d1047940f1\" (UID: \"5f17bc37-4d61-4f07-9778-a2d1047940f1\") "
Jul 02 22:04:26.337777 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.337757    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8n6tz\" (UniqueName: \"kubernetes.io/projected/5f17bc37-4d61-4f07-9778-a2d1047940f1-kube-api-access-8n6tz\") pod \"5f17bc37-4d61-4f07-9778-a2d1047940f1\" (UID: \"5f17bc37-4d61-4f07-9778-a2d1047940f1\") "
Jul 02 22:04:26.337943 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.337844    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f17bc37-4d61-4f07-9778-a2d1047940f1-openshift-service-ca\") pod \"5f17bc37-4d61-4f07-9778-a2d1047940f1\" (UID: \"5f17bc37-4d61-4f07-9778-a2d1047940f1\") "
Jul 02 22:04:26.338225 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.338195    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f17bc37-4d61-4f07-9778-a2d1047940f1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5f17bc37-4d61-4f07-9778-a2d1047940f1" (UID: "5f17bc37-4d61-4f07-9778-a2d1047940f1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 22:04:26.340145 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.340098    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f17bc37-4d61-4f07-9778-a2d1047940f1-kube-api-access-8n6tz" (OuterVolumeSpecName: "kube-api-access-8n6tz") pod "5f17bc37-4d61-4f07-9778-a2d1047940f1" (UID: "5f17bc37-4d61-4f07-9778-a2d1047940f1"). InnerVolumeSpecName "kube-api-access-8n6tz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:04:26.340407 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.340384    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f17bc37-4d61-4f07-9778-a2d1047940f1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5f17bc37-4d61-4f07-9778-a2d1047940f1" (UID: "5f17bc37-4d61-4f07-9778-a2d1047940f1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:04:26.439342 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.439311    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f17bc37-4d61-4f07-9778-a2d1047940f1-openshift-service-ca\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:04:26.439342 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.439338    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f17bc37-4d61-4f07-9778-a2d1047940f1-maas-api-tls\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:04:26.439342 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.439346    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8n6tz\" (UniqueName: \"kubernetes.io/projected/5f17bc37-4d61-4f07-9778-a2d1047940f1-kube-api-access-8n6tz\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:04:26.680280 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.680249    2575 generic.go:356] "Generic (PLEG): container finished" podID="5f17bc37-4d61-4f07-9778-a2d1047940f1" containerID="c49fbfdf88ab1e8e8334a08d999167b470c1bd13d11de6ba192ce0ee9462b914" exitCode=0
Jul 02 22:04:26.680721 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.680293    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"
Jul 02 22:04:26.680721 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.680328    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g" event={"ID":"5f17bc37-4d61-4f07-9778-a2d1047940f1","Type":"ContainerDied","Data":"c49fbfdf88ab1e8e8334a08d999167b470c1bd13d11de6ba192ce0ee9462b914"}
Jul 02 22:04:26.680721 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.680383    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g" event={"ID":"5f17bc37-4d61-4f07-9778-a2d1047940f1","Type":"ContainerDied","Data":"6d8d2e398fdeb6b13d6b09be726532b3ee8722d09156806bdb4a3aa078acfe20"}
Jul 02 22:04:26.680721 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.680405    2575 scope.go:117] "RemoveContainer" containerID="c49fbfdf88ab1e8e8334a08d999167b470c1bd13d11de6ba192ce0ee9462b914"
Jul 02 22:04:26.689143 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.689125    2575 scope.go:117] "RemoveContainer" containerID="c49fbfdf88ab1e8e8334a08d999167b470c1bd13d11de6ba192ce0ee9462b914"
Jul 02 22:04:26.689384 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:04:26.689366    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c49fbfdf88ab1e8e8334a08d999167b470c1bd13d11de6ba192ce0ee9462b914\": container with ID starting with c49fbfdf88ab1e8e8334a08d999167b470c1bd13d11de6ba192ce0ee9462b914 not found: ID does not exist" containerID="c49fbfdf88ab1e8e8334a08d999167b470c1bd13d11de6ba192ce0ee9462b914"
Jul 02 22:04:26.689430 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.689394    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c49fbfdf88ab1e8e8334a08d999167b470c1bd13d11de6ba192ce0ee9462b914"} err="failed to get container status \"c49fbfdf88ab1e8e8334a08d999167b470c1bd13d11de6ba192ce0ee9462b914\": rpc error: code = NotFound desc = could not find container \"c49fbfdf88ab1e8e8334a08d999167b470c1bd13d11de6ba192ce0ee9462b914\": container with ID starting with c49fbfdf88ab1e8e8334a08d999167b470c1bd13d11de6ba192ce0ee9462b914 not found: ID does not exist"
Jul 02 22:04:26.702855 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.702834    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"]
Jul 02 22:04:26.706814 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:26.706795    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-0956ab05-7766894997-lgr8g"]
Jul 02 22:04:27.524734 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:27.524699    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f17bc37-4d61-4f07-9778-a2d1047940f1" path="/var/lib/kubelet/pods/5f17bc37-4d61-4f07-9778-a2d1047940f1/volumes"
Jul 02 22:04:32.040386 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:32.040296    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:32.139565 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:32.139535    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:33.490231 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:33.490198    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:37.920989 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:37.920945    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:37.983051 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:37.983022    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:38.162206 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:38.162166    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:38.225456 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:38.225365    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:39.360573 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.360542    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:39.453798 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.453750    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:39.527033 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.526991    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"]
Jul 02 22:04:39.527608 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.527550    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f17bc37-4d61-4f07-9778-a2d1047940f1" containerName="maas-api"
Jul 02 22:04:39.527608 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.527572    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f17bc37-4d61-4f07-9778-a2d1047940f1" containerName="maas-api"
Jul 02 22:04:39.527770 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.527664    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f17bc37-4d61-4f07-9778-a2d1047940f1" containerName="maas-api"
Jul 02 22:04:39.532430 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.532410    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"
Jul 02 22:04:39.535365 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.535347    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-1e99f232-serving-cert\""
Jul 02 22:04:39.540265 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.540245    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"]
Jul 02 22:04:39.559087 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.559062    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/854b1b08-91ef-404c-8e16-10c4e596ed3b-maas-api-tls\") pod \"maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd\" (UID: \"854b1b08-91ef-404c-8e16-10c4e596ed3b\") " pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"
Jul 02 22:04:39.559187 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.559116    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jll62\" (UniqueName: \"kubernetes.io/projected/854b1b08-91ef-404c-8e16-10c4e596ed3b-kube-api-access-jll62\") pod \"maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd\" (UID: \"854b1b08-91ef-404c-8e16-10c4e596ed3b\") " pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"
Jul 02 22:04:39.559187 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.559165    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/854b1b08-91ef-404c-8e16-10c4e596ed3b-openshift-service-ca\") pod \"maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd\" (UID: \"854b1b08-91ef-404c-8e16-10c4e596ed3b\") " pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"
Jul 02 22:04:39.573563 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.573534    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:39.660015 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.659910    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/854b1b08-91ef-404c-8e16-10c4e596ed3b-maas-api-tls\") pod \"maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd\" (UID: \"854b1b08-91ef-404c-8e16-10c4e596ed3b\") " pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"
Jul 02 22:04:39.660015 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.659975    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jll62\" (UniqueName: \"kubernetes.io/projected/854b1b08-91ef-404c-8e16-10c4e596ed3b-kube-api-access-jll62\") pod \"maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd\" (UID: \"854b1b08-91ef-404c-8e16-10c4e596ed3b\") " pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"
Jul 02 22:04:39.660227 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.660041    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/854b1b08-91ef-404c-8e16-10c4e596ed3b-openshift-service-ca\") pod \"maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd\" (UID: \"854b1b08-91ef-404c-8e16-10c4e596ed3b\") " pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"
Jul 02 22:04:39.660227 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:04:39.660059    2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-1e99f232-serving-cert: secret "maas-api-e2e-derive-1e99f232-serving-cert" not found
Jul 02 22:04:39.660227 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:04:39.660127    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/854b1b08-91ef-404c-8e16-10c4e596ed3b-maas-api-tls podName:854b1b08-91ef-404c-8e16-10c4e596ed3b nodeName:}" failed. No retries permitted until 2026-07-02 22:04:40.160107506 +0000 UTC m=+2013.197586794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/854b1b08-91ef-404c-8e16-10c4e596ed3b-maas-api-tls") pod "maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd" (UID: "854b1b08-91ef-404c-8e16-10c4e596ed3b") : secret "maas-api-e2e-derive-1e99f232-serving-cert" not found
Jul 02 22:04:39.660707 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.660684    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/854b1b08-91ef-404c-8e16-10c4e596ed3b-openshift-service-ca\") pod \"maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd\" (UID: \"854b1b08-91ef-404c-8e16-10c4e596ed3b\") " pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"
Jul 02 22:04:39.668864 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.668839    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jll62\" (UniqueName: \"kubernetes.io/projected/854b1b08-91ef-404c-8e16-10c4e596ed3b-kube-api-access-jll62\") pod \"maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd\" (UID: \"854b1b08-91ef-404c-8e16-10c4e596ed3b\") " pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"
Jul 02 22:04:39.922350 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:39.922247    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:40.025024 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:40.024975    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:40.128584 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:40.128538    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:40.163139 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:40.163092    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/854b1b08-91ef-404c-8e16-10c4e596ed3b-maas-api-tls\") pod \"maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd\" (UID: \"854b1b08-91ef-404c-8e16-10c4e596ed3b\") " pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"
Jul 02 22:04:40.165280 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:40.165257    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/854b1b08-91ef-404c-8e16-10c4e596ed3b-maas-api-tls\") pod \"maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd\" (UID: \"854b1b08-91ef-404c-8e16-10c4e596ed3b\") " pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"
Jul 02 22:04:40.446110 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:40.446075    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"
Jul 02 22:04:40.578337 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:40.578314    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"]
Jul 02 22:04:40.581130 ip-10-0-139-110 kubenswrapper[2575]: W0702 22:04:40.581105    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod854b1b08_91ef_404c_8e16_10c4e596ed3b.slice/crio-5759150b94f0738a50c0e93d2de634eba9a31faa8114a49114d168bd7a9d0bc7 WatchSource:0}: Error finding container 5759150b94f0738a50c0e93d2de634eba9a31faa8114a49114d168bd7a9d0bc7: Status 404 returned error can't find the container with id 5759150b94f0738a50c0e93d2de634eba9a31faa8114a49114d168bd7a9d0bc7
Jul 02 22:04:40.750423 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:40.750350    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd" event={"ID":"854b1b08-91ef-404c-8e16-10c4e596ed3b","Type":"ContainerStarted","Data":"5759150b94f0738a50c0e93d2de634eba9a31faa8114a49114d168bd7a9d0bc7"}
Jul 02 22:04:41.491240 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:41.491205    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:41.759104 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:41.758992    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd" event={"ID":"854b1b08-91ef-404c-8e16-10c4e596ed3b","Type":"ContainerStarted","Data":"d126f0ebcb84c2a51a66d88d43bcde462fe205afd0ec2d93b8ab519360ba00b9"}
Jul 02 22:04:41.759104 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:41.759082    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"
Jul 02 22:04:41.777668 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:41.777622    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd" podStartSLOduration=2.326954864 podStartE2EDuration="2.777608875s" totalImagesPullingTime="450.654011ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:04:41.775398415 +0000 UTC m=+2014.812877726" watchObservedRunningTime="2026-07-02 22:04:41.777608875 +0000 UTC m=+2014.815088221"
Jul 02 22:04:43.791030 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:43.790972    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:43.973070 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:43.973033    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:44.078491 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.078408    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:44.083728 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.083700    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"]
Jul 02 22:04:44.083932 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.083909    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd" podUID="854b1b08-91ef-404c-8e16-10c4e596ed3b" containerName="maas-api" containerID="cri-o://d126f0ebcb84c2a51a66d88d43bcde462fe205afd0ec2d93b8ab519360ba00b9" gracePeriod=30
Jul 02 22:04:44.141910 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.141883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:44.319980 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.319958    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"
Jul 02 22:04:44.394481 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.394452    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/854b1b08-91ef-404c-8e16-10c4e596ed3b-openshift-service-ca\") pod \"854b1b08-91ef-404c-8e16-10c4e596ed3b\" (UID: \"854b1b08-91ef-404c-8e16-10c4e596ed3b\") "
Jul 02 22:04:44.394631 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.394529    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/854b1b08-91ef-404c-8e16-10c4e596ed3b-maas-api-tls\") pod \"854b1b08-91ef-404c-8e16-10c4e596ed3b\" (UID: \"854b1b08-91ef-404c-8e16-10c4e596ed3b\") "
Jul 02 22:04:44.394631 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.394557    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jll62\" (UniqueName: \"kubernetes.io/projected/854b1b08-91ef-404c-8e16-10c4e596ed3b-kube-api-access-jll62\") pod \"854b1b08-91ef-404c-8e16-10c4e596ed3b\" (UID: \"854b1b08-91ef-404c-8e16-10c4e596ed3b\") "
Jul 02 22:04:44.394755 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.394735    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/854b1b08-91ef-404c-8e16-10c4e596ed3b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "854b1b08-91ef-404c-8e16-10c4e596ed3b" (UID: "854b1b08-91ef-404c-8e16-10c4e596ed3b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 22:04:44.396632 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.396609    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/854b1b08-91ef-404c-8e16-10c4e596ed3b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "854b1b08-91ef-404c-8e16-10c4e596ed3b" (UID: "854b1b08-91ef-404c-8e16-10c4e596ed3b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:04:44.396731 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.396647    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/854b1b08-91ef-404c-8e16-10c4e596ed3b-kube-api-access-jll62" (OuterVolumeSpecName: "kube-api-access-jll62") pod "854b1b08-91ef-404c-8e16-10c4e596ed3b" (UID: "854b1b08-91ef-404c-8e16-10c4e596ed3b"). InnerVolumeSpecName "kube-api-access-jll62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:04:44.495800 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.495772    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/854b1b08-91ef-404c-8e16-10c4e596ed3b-maas-api-tls\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:04:44.495800 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.495797    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jll62\" (UniqueName: \"kubernetes.io/projected/854b1b08-91ef-404c-8e16-10c4e596ed3b-kube-api-access-jll62\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:04:44.495954 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.495806    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/854b1b08-91ef-404c-8e16-10c4e596ed3b-openshift-service-ca\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:04:44.773820 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.773745    2575 generic.go:356] "Generic (PLEG): container finished" podID="854b1b08-91ef-404c-8e16-10c4e596ed3b" containerID="d126f0ebcb84c2a51a66d88d43bcde462fe205afd0ec2d93b8ab519360ba00b9" exitCode=0
Jul 02 22:04:44.773820 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.773789    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"
Jul 02 22:04:44.773995 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.773830    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd" event={"ID":"854b1b08-91ef-404c-8e16-10c4e596ed3b","Type":"ContainerDied","Data":"d126f0ebcb84c2a51a66d88d43bcde462fe205afd0ec2d93b8ab519360ba00b9"}
Jul 02 22:04:44.773995 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.773876    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd" event={"ID":"854b1b08-91ef-404c-8e16-10c4e596ed3b","Type":"ContainerDied","Data":"5759150b94f0738a50c0e93d2de634eba9a31faa8114a49114d168bd7a9d0bc7"}
Jul 02 22:04:44.773995 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.773899    2575 scope.go:117] "RemoveContainer" containerID="d126f0ebcb84c2a51a66d88d43bcde462fe205afd0ec2d93b8ab519360ba00b9"
Jul 02 22:04:44.783114 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.783097    2575 scope.go:117] "RemoveContainer" containerID="d126f0ebcb84c2a51a66d88d43bcde462fe205afd0ec2d93b8ab519360ba00b9"
Jul 02 22:04:44.783358 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:04:44.783340    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d126f0ebcb84c2a51a66d88d43bcde462fe205afd0ec2d93b8ab519360ba00b9\": container with ID starting with d126f0ebcb84c2a51a66d88d43bcde462fe205afd0ec2d93b8ab519360ba00b9 not found: ID does not exist" containerID="d126f0ebcb84c2a51a66d88d43bcde462fe205afd0ec2d93b8ab519360ba00b9"
Jul 02 22:04:44.783427 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.783364    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d126f0ebcb84c2a51a66d88d43bcde462fe205afd0ec2d93b8ab519360ba00b9"} err="failed to get container status \"d126f0ebcb84c2a51a66d88d43bcde462fe205afd0ec2d93b8ab519360ba00b9\": rpc error: code = NotFound desc = could not find container \"d126f0ebcb84c2a51a66d88d43bcde462fe205afd0ec2d93b8ab519360ba00b9\": container with ID starting with d126f0ebcb84c2a51a66d88d43bcde462fe205afd0ec2d93b8ab519360ba00b9 not found: ID does not exist"
Jul 02 22:04:44.795045 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.795020    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"]
Jul 02 22:04:44.802019 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:44.801981    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-1e99f232-5f644bf887-zq8qd"]
Jul 02 22:04:45.417973 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:45.417939    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:45.525253 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:45.525218    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="854b1b08-91ef-404c-8e16-10c4e596ed3b" path="/var/lib/kubelet/pods/854b1b08-91ef-404c-8e16-10c4e596ed3b/volumes"
Jul 02 22:04:49.905981 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:49.905948    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:50.006350 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:50.006313    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:50.361542 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:50.361511    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:50.463169 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:50.463130    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:50.564707 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:50.564665    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:51.949927 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:51.949883    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:57.753349 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:57.753309    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:57.822839 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:57.822806    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:57.903290 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:57.903258    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:58.003340 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:58.003305    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:58.103484 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:58.103445    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:04:58.473431 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:04:58.473338    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:05:13.408791 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:05:13.408746    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:05:13.509547 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:05:13.509512    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:05:24.494136 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:05:24.494093    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:05:30.096821 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:05:30.096737    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:05:30.167230 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:05:30.167205    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:05:30.257584 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:05:30.257548    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:05:30.352595 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:05:30.352559    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:05:46.323705 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:05:46.323665    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:05:51.968473 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:05:51.968435    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:05:52.110481 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:05:52.110447    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:05:52.225888 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:05:52.225816    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:02.746893 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:02.746862    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:03.568758 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:03.568725    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:09.310444 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:09.310399    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:09.416280 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:09.416246    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:09.510235 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:09.510204    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:09.610351 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:09.610328    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:10.380863 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:10.380814    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:10.480959 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:10.480930    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:10.581314 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:10.581284    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:12.209255 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:12.209214    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:17.846223 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:17.846185    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:17.946251 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:17.946219    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:18.518645 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:18.518605    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:24.178186 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:24.178148    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:24.278730 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:24.278693    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:24.484224 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:24.484147    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:24.853838 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:24.853805    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:25.030368 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:25.030335    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:28.452312 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.452277    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:28.551852 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.551819    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:28.622393 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.622365    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"]
Jul 02 22:06:28.622756 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.622740    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="854b1b08-91ef-404c-8e16-10c4e596ed3b" containerName="maas-api"
Jul 02 22:06:28.622826 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.622757    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="854b1b08-91ef-404c-8e16-10c4e596ed3b" containerName="maas-api"
Jul 02 22:06:28.622826 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.622813    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="854b1b08-91ef-404c-8e16-10c4e596ed3b" containerName="maas-api"
Jul 02 22:06:28.626059 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.626039    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"
Jul 02 22:06:28.632380 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.632355    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-9c549bca-serving-cert\""
Jul 02 22:06:28.638920 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.638898    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"]
Jul 02 22:06:28.654830 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.654799    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c932f7-5826-4320-97fa-81166ed4f993-openshift-service-ca\") pod \"maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms\" (UID: \"76c932f7-5826-4320-97fa-81166ed4f993\") " pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"
Jul 02 22:06:28.654994 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.654886    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c932f7-5826-4320-97fa-81166ed4f993-maas-api-tls\") pod \"maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms\" (UID: \"76c932f7-5826-4320-97fa-81166ed4f993\") " pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"
Jul 02 22:06:28.654994 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.654954    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jjrq\" (UniqueName: \"kubernetes.io/projected/76c932f7-5826-4320-97fa-81166ed4f993-kube-api-access-5jjrq\") pod \"maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms\" (UID: \"76c932f7-5826-4320-97fa-81166ed4f993\") " pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"
Jul 02 22:06:28.656416 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.656392    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:28.756241 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.756160    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c932f7-5826-4320-97fa-81166ed4f993-openshift-service-ca\") pod \"maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms\" (UID: \"76c932f7-5826-4320-97fa-81166ed4f993\") " pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"
Jul 02 22:06:28.756396 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.756250    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c932f7-5826-4320-97fa-81166ed4f993-maas-api-tls\") pod \"maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms\" (UID: \"76c932f7-5826-4320-97fa-81166ed4f993\") " pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"
Jul 02 22:06:28.756396 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.756314    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jjrq\" (UniqueName: \"kubernetes.io/projected/76c932f7-5826-4320-97fa-81166ed4f993-kube-api-access-5jjrq\") pod \"maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms\" (UID: \"76c932f7-5826-4320-97fa-81166ed4f993\") " pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"
Jul 02 22:06:28.756491 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:06:28.756388    2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-9c549bca-serving-cert: secret "maas-api-e2e-mt-9c549bca-serving-cert" not found
Jul 02 22:06:28.756491 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:06:28.756461    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76c932f7-5826-4320-97fa-81166ed4f993-maas-api-tls podName:76c932f7-5826-4320-97fa-81166ed4f993 nodeName:}" failed. No retries permitted until 2026-07-02 22:06:29.256445138 +0000 UTC m=+2122.293924424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/76c932f7-5826-4320-97fa-81166ed4f993-maas-api-tls") pod "maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms" (UID: "76c932f7-5826-4320-97fa-81166ed4f993") : secret "maas-api-e2e-mt-9c549bca-serving-cert" not found
Jul 02 22:06:28.756957 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.756935    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c932f7-5826-4320-97fa-81166ed4f993-openshift-service-ca\") pod \"maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms\" (UID: \"76c932f7-5826-4320-97fa-81166ed4f993\") " pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"
Jul 02 22:06:28.765555 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:28.765532    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jjrq\" (UniqueName: \"kubernetes.io/projected/76c932f7-5826-4320-97fa-81166ed4f993-kube-api-access-5jjrq\") pod \"maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms\" (UID: \"76c932f7-5826-4320-97fa-81166ed4f993\") " pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"
Jul 02 22:06:29.196235 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:29.196197    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:29.260323 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:29.260290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c932f7-5826-4320-97fa-81166ed4f993-maas-api-tls\") pod \"maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms\" (UID: \"76c932f7-5826-4320-97fa-81166ed4f993\") " pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"
Jul 02 22:06:29.262694 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:29.262670    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c932f7-5826-4320-97fa-81166ed4f993-maas-api-tls\") pod \"maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms\" (UID: \"76c932f7-5826-4320-97fa-81166ed4f993\") " pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"
Jul 02 22:06:29.326223 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:29.326196    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:29.425788 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:29.425725    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:29.536876 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:29.536802    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"
Jul 02 22:06:29.674614 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:29.674583    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"]
Jul 02 22:06:29.676418 ip-10-0-139-110 kubenswrapper[2575]: W0702 22:06:29.676394    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c932f7_5826_4320_97fa_81166ed4f993.slice/crio-b57d120e74e8659d4027d4e78c1aaede6dc636491b4c0554cdf817aae59fffe4 WatchSource:0}: Error finding container b57d120e74e8659d4027d4e78c1aaede6dc636491b4c0554cdf817aae59fffe4: Status 404 returned error can't find the container with id b57d120e74e8659d4027d4e78c1aaede6dc636491b4c0554cdf817aae59fffe4
Jul 02 22:06:30.252462 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:30.252438    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms" event={"ID":"76c932f7-5826-4320-97fa-81166ed4f993","Type":"ContainerStarted","Data":"f2965b3195dba7b1c9a40c28a144603cf4cc3d3d6f6bed0c69005132418046cc"}
Jul 02 22:06:30.252576 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:30.252491    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms" event={"ID":"76c932f7-5826-4320-97fa-81166ed4f993","Type":"ContainerStarted","Data":"b57d120e74e8659d4027d4e78c1aaede6dc636491b4c0554cdf817aae59fffe4"}
Jul 02 22:06:30.252576 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:30.252534    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"
Jul 02 22:06:30.270173 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:30.270133    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms" podStartSLOduration=1.76374693 podStartE2EDuration="2.270118204s" totalImagesPullingTime="506.371274ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:06:30.268399912 +0000 UTC m=+2123.305879219" watchObservedRunningTime="2026-07-02 22:06:30.270118204 +0000 UTC m=+2123.307597511"
Jul 02 22:06:32.949422 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:32.949382    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:33.589990 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:33.589957    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:33.689084 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:33.689019    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:34.029047 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:34.028993    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:36.262661 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:36.262635    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"
Jul 02 22:06:39.909246 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:39.909215    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:40.008940 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:40.008903    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:40.314633 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:40.314554    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:40.452521 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:40.452491    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:40.751505 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:40.751478    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"]
Jul 02 22:06:40.751755 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:40.751731    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms" podUID="76c932f7-5826-4320-97fa-81166ed4f993" containerName="maas-api" containerID="cri-o://f2965b3195dba7b1c9a40c28a144603cf4cc3d3d6f6bed0c69005132418046cc" gracePeriod=30
Jul 02 22:06:40.775389 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:40.775360    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:40.835275 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:40.835243    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:40.988567 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:40.988544    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"
Jul 02 22:06:41.064635 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.064557    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jjrq\" (UniqueName: \"kubernetes.io/projected/76c932f7-5826-4320-97fa-81166ed4f993-kube-api-access-5jjrq\") pod \"76c932f7-5826-4320-97fa-81166ed4f993\" (UID: \"76c932f7-5826-4320-97fa-81166ed4f993\") "
Jul 02 22:06:41.064635 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.064626    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c932f7-5826-4320-97fa-81166ed4f993-openshift-service-ca\") pod \"76c932f7-5826-4320-97fa-81166ed4f993\" (UID: \"76c932f7-5826-4320-97fa-81166ed4f993\") "
Jul 02 22:06:41.064850 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.064760    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c932f7-5826-4320-97fa-81166ed4f993-maas-api-tls\") pod \"76c932f7-5826-4320-97fa-81166ed4f993\" (UID: \"76c932f7-5826-4320-97fa-81166ed4f993\") "
Jul 02 22:06:41.064997 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.064975    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76c932f7-5826-4320-97fa-81166ed4f993-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "76c932f7-5826-4320-97fa-81166ed4f993" (UID: "76c932f7-5826-4320-97fa-81166ed4f993"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 22:06:41.066570 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.066547    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76c932f7-5826-4320-97fa-81166ed4f993-kube-api-access-5jjrq" (OuterVolumeSpecName: "kube-api-access-5jjrq") pod "76c932f7-5826-4320-97fa-81166ed4f993" (UID: "76c932f7-5826-4320-97fa-81166ed4f993"). InnerVolumeSpecName "kube-api-access-5jjrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:06:41.066697 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.066673    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76c932f7-5826-4320-97fa-81166ed4f993-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "76c932f7-5826-4320-97fa-81166ed4f993" (UID: "76c932f7-5826-4320-97fa-81166ed4f993"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:06:41.165992 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.165968    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c932f7-5826-4320-97fa-81166ed4f993-maas-api-tls\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:06:41.165992 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.165989    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jjrq\" (UniqueName: \"kubernetes.io/projected/76c932f7-5826-4320-97fa-81166ed4f993-kube-api-access-5jjrq\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:06:41.166136 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.165999    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c932f7-5826-4320-97fa-81166ed4f993-openshift-service-ca\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:06:41.304367 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.304334    2575 generic.go:356] "Generic (PLEG): container finished" podID="76c932f7-5826-4320-97fa-81166ed4f993" containerID="f2965b3195dba7b1c9a40c28a144603cf4cc3d3d6f6bed0c69005132418046cc" exitCode=0
Jul 02 22:06:41.304467 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.304382    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"
Jul 02 22:06:41.304467 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.304417    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms" event={"ID":"76c932f7-5826-4320-97fa-81166ed4f993","Type":"ContainerDied","Data":"f2965b3195dba7b1c9a40c28a144603cf4cc3d3d6f6bed0c69005132418046cc"}
Jul 02 22:06:41.304562 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.304471    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms" event={"ID":"76c932f7-5826-4320-97fa-81166ed4f993","Type":"ContainerDied","Data":"b57d120e74e8659d4027d4e78c1aaede6dc636491b4c0554cdf817aae59fffe4"}
Jul 02 22:06:41.304562 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.304495    2575 scope.go:117] "RemoveContainer" containerID="f2965b3195dba7b1c9a40c28a144603cf4cc3d3d6f6bed0c69005132418046cc"
Jul 02 22:06:41.313263 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.313247    2575 scope.go:117] "RemoveContainer" containerID="f2965b3195dba7b1c9a40c28a144603cf4cc3d3d6f6bed0c69005132418046cc"
Jul 02 22:06:41.313530 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:06:41.313515    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2965b3195dba7b1c9a40c28a144603cf4cc3d3d6f6bed0c69005132418046cc\": container with ID starting with f2965b3195dba7b1c9a40c28a144603cf4cc3d3d6f6bed0c69005132418046cc not found: ID does not exist" containerID="f2965b3195dba7b1c9a40c28a144603cf4cc3d3d6f6bed0c69005132418046cc"
Jul 02 22:06:41.313571 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.313538    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2965b3195dba7b1c9a40c28a144603cf4cc3d3d6f6bed0c69005132418046cc"} err="failed to get container status \"f2965b3195dba7b1c9a40c28a144603cf4cc3d3d6f6bed0c69005132418046cc\": rpc error: code = NotFound desc = could not find container \"f2965b3195dba7b1c9a40c28a144603cf4cc3d3d6f6bed0c69005132418046cc\": container with ID starting with f2965b3195dba7b1c9a40c28a144603cf4cc3d3d6f6bed0c69005132418046cc not found: ID does not exist"
Jul 02 22:06:41.326316 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.326265    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"]
Jul 02 22:06:41.330670 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.330651    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-9c549bca-7c7695fcb4-gtjms"]
Jul 02 22:06:41.524961 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:41.524932    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76c932f7-5826-4320-97fa-81166ed4f993" path="/var/lib/kubelet/pods/76c932f7-5826-4320-97fa-81166ed4f993/volumes"
Jul 02 22:06:46.527951 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:46.527909    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:46.629126 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:46.629094    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:46.768388 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:46.768359    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:46.996054 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:46.996018    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:47.146347 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:47.146311    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:47.241717 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:47.241683    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:47.355499 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:47.355469    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:52.985718 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:52.985678    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:53.047373 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:53.047340    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:53.133589 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:53.133555    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:53.232090 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:53.232050    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:53.342232 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:53.342162    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:59.006459 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:59.006371    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:06:59.107132 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:06:59.107100    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:05.823863 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:05.823830    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:06.129507 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:06.129474    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:06.268076 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:06.268025    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:09.654539 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:09.654502    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:09.724047 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:09.724017    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"]
Jul 02 22:07:09.724557 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:09.724540    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76c932f7-5826-4320-97fa-81166ed4f993" containerName="maas-api"
Jul 02 22:07:09.724660 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:09.724559    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="76c932f7-5826-4320-97fa-81166ed4f993" containerName="maas-api"
Jul 02 22:07:09.724660 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:09.724657    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="76c932f7-5826-4320-97fa-81166ed4f993" containerName="maas-api"
Jul 02 22:07:09.729072 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:09.729055    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"
Jul 02 22:07:09.731920 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:09.731896    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-7bd61c91-serving-cert\""
Jul 02 22:07:09.738439 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:09.738396    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"]
Jul 02 22:07:09.747857 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:09.747835    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:09.816043 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:09.815995    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:09.916628 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:09.916554    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af8959b0-98e6-4631-a259-65d96b464353-openshift-service-ca\") pod \"maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5\" (UID: \"af8959b0-98e6-4631-a259-65d96b464353\") " pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"
Jul 02 22:07:09.916748 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:09.916686    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af8959b0-98e6-4631-a259-65d96b464353-maas-api-tls\") pod \"maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5\" (UID: \"af8959b0-98e6-4631-a259-65d96b464353\") " pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"
Jul 02 22:07:09.916748 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:09.916737    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4724\" (UniqueName: \"kubernetes.io/projected/af8959b0-98e6-4631-a259-65d96b464353-kube-api-access-j4724\") pod \"maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5\" (UID: \"af8959b0-98e6-4631-a259-65d96b464353\") " pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"
Jul 02 22:07:10.017799 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:10.017765    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af8959b0-98e6-4631-a259-65d96b464353-maas-api-tls\") pod \"maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5\" (UID: \"af8959b0-98e6-4631-a259-65d96b464353\") " pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"
Jul 02 22:07:10.017927 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:10.017824    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4724\" (UniqueName: \"kubernetes.io/projected/af8959b0-98e6-4631-a259-65d96b464353-kube-api-access-j4724\") pod \"maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5\" (UID: \"af8959b0-98e6-4631-a259-65d96b464353\") " pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"
Jul 02 22:07:10.017927 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:10.017878    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af8959b0-98e6-4631-a259-65d96b464353-openshift-service-ca\") pod \"maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5\" (UID: \"af8959b0-98e6-4631-a259-65d96b464353\") " pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"
Jul 02 22:07:10.018074 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:07:10.017921    2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-7bd61c91-serving-cert: secret "maas-api-e2e-mt-7bd61c91-serving-cert" not found
Jul 02 22:07:10.018074 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:07:10.017993    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af8959b0-98e6-4631-a259-65d96b464353-maas-api-tls podName:af8959b0-98e6-4631-a259-65d96b464353 nodeName:}" failed. No retries permitted until 2026-07-02 22:07:10.517973359 +0000 UTC m=+2163.555452645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/af8959b0-98e6-4631-a259-65d96b464353-maas-api-tls") pod "maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5" (UID: "af8959b0-98e6-4631-a259-65d96b464353") : secret "maas-api-e2e-mt-7bd61c91-serving-cert" not found
Jul 02 22:07:10.018594 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:10.018569    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af8959b0-98e6-4631-a259-65d96b464353-openshift-service-ca\") pod \"maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5\" (UID: \"af8959b0-98e6-4631-a259-65d96b464353\") " pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"
Jul 02 22:07:10.030578 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:10.030558    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4724\" (UniqueName: \"kubernetes.io/projected/af8959b0-98e6-4631-a259-65d96b464353-kube-api-access-j4724\") pod \"maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5\" (UID: \"af8959b0-98e6-4631-a259-65d96b464353\") " pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"
Jul 02 22:07:10.096629 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:10.096604    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:10.227789 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:10.227708    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:10.376933 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:10.376897    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:10.524220 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:10.524146    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af8959b0-98e6-4631-a259-65d96b464353-maas-api-tls\") pod \"maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5\" (UID: \"af8959b0-98e6-4631-a259-65d96b464353\") " pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"
Jul 02 22:07:10.526506 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:10.526478    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af8959b0-98e6-4631-a259-65d96b464353-maas-api-tls\") pod \"maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5\" (UID: \"af8959b0-98e6-4631-a259-65d96b464353\") " pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"
Jul 02 22:07:10.642304 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:10.642275    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"
Jul 02 22:07:10.770641 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:10.770617    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"]
Jul 02 22:07:10.772740 ip-10-0-139-110 kubenswrapper[2575]: W0702 22:07:10.772708    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf8959b0_98e6_4631_a259_65d96b464353.slice/crio-01b1d7c12c7c04de20bb0a312f2af6ee9635033bf84e545e4bd8fd2609ce5e31 WatchSource:0}: Error finding container 01b1d7c12c7c04de20bb0a312f2af6ee9635033bf84e545e4bd8fd2609ce5e31: Status 404 returned error can't find the container with id 01b1d7c12c7c04de20bb0a312f2af6ee9635033bf84e545e4bd8fd2609ce5e31
Jul 02 22:07:11.440076 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:11.440042    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5" event={"ID":"af8959b0-98e6-4631-a259-65d96b464353","Type":"ContainerStarted","Data":"06a4a8e030b6283c99cd61cf3337eed4ac56a6ec5adbfd45d0cdb3a12284f895"}
Jul 02 22:07:11.440264 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:11.440096    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5" event={"ID":"af8959b0-98e6-4631-a259-65d96b464353","Type":"ContainerStarted","Data":"01b1d7c12c7c04de20bb0a312f2af6ee9635033bf84e545e4bd8fd2609ce5e31"}
Jul 02 22:07:11.440264 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:11.440124    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"
Jul 02 22:07:11.459564 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:11.459515    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5" podStartSLOduration=2.019398082 podStartE2EDuration="2.459499346s" totalImagesPullingTime="440.101264ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:07:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:07:11.458465934 +0000 UTC m=+2164.495945243" watchObservedRunningTime="2026-07-02 22:07:11.459499346 +0000 UTC m=+2164.496978653"
Jul 02 22:07:14.171018 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:14.170973    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:17.451722 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:17.451696    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"
Jul 02 22:07:22.234118 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:22.234081    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:22.336758 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:22.336705    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:30.988900 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:30.988857    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:31.089597 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:31.089563    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:32.771929 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:32.771899    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:51.853370 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:51.853335    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:52.135585 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.135502    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"]
Jul 02 22:07:52.135758 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.135723    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5" podUID="af8959b0-98e6-4631-a259-65d96b464353" containerName="maas-api" containerID="cri-o://06a4a8e030b6283c99cd61cf3337eed4ac56a6ec5adbfd45d0cdb3a12284f895" gracePeriod=30
Jul 02 22:07:52.148806 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.148777    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:07:52.378519 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.378498    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"
Jul 02 22:07:52.476561 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.476496    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af8959b0-98e6-4631-a259-65d96b464353-openshift-service-ca\") pod \"af8959b0-98e6-4631-a259-65d96b464353\" (UID: \"af8959b0-98e6-4631-a259-65d96b464353\") "
Jul 02 22:07:52.476561 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.476529    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4724\" (UniqueName: \"kubernetes.io/projected/af8959b0-98e6-4631-a259-65d96b464353-kube-api-access-j4724\") pod \"af8959b0-98e6-4631-a259-65d96b464353\" (UID: \"af8959b0-98e6-4631-a259-65d96b464353\") "
Jul 02 22:07:52.476743 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.476575    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af8959b0-98e6-4631-a259-65d96b464353-maas-api-tls\") pod \"af8959b0-98e6-4631-a259-65d96b464353\" (UID: \"af8959b0-98e6-4631-a259-65d96b464353\") "
Jul 02 22:07:52.476821 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.476798    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af8959b0-98e6-4631-a259-65d96b464353-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "af8959b0-98e6-4631-a259-65d96b464353" (UID: "af8959b0-98e6-4631-a259-65d96b464353"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 22:07:52.478458 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.478435    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af8959b0-98e6-4631-a259-65d96b464353-kube-api-access-j4724" (OuterVolumeSpecName: "kube-api-access-j4724") pod "af8959b0-98e6-4631-a259-65d96b464353" (UID: "af8959b0-98e6-4631-a259-65d96b464353"). InnerVolumeSpecName "kube-api-access-j4724". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:07:52.478572 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.478534    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af8959b0-98e6-4631-a259-65d96b464353-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "af8959b0-98e6-4631-a259-65d96b464353" (UID: "af8959b0-98e6-4631-a259-65d96b464353"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:07:52.577618 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.577595    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/af8959b0-98e6-4631-a259-65d96b464353-openshift-service-ca\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:07:52.577618 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.577617    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4724\" (UniqueName: \"kubernetes.io/projected/af8959b0-98e6-4631-a259-65d96b464353-kube-api-access-j4724\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:07:52.577763 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.577627    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/af8959b0-98e6-4631-a259-65d96b464353-maas-api-tls\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:07:52.629163 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.629137    2575 generic.go:356] "Generic (PLEG): container finished" podID="af8959b0-98e6-4631-a259-65d96b464353" containerID="06a4a8e030b6283c99cd61cf3337eed4ac56a6ec5adbfd45d0cdb3a12284f895" exitCode=0
Jul 02 22:07:52.629268 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.629170    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5" event={"ID":"af8959b0-98e6-4631-a259-65d96b464353","Type":"ContainerDied","Data":"06a4a8e030b6283c99cd61cf3337eed4ac56a6ec5adbfd45d0cdb3a12284f895"}
Jul 02 22:07:52.629268 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.629191    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"
Jul 02 22:07:52.629268 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.629206    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5" event={"ID":"af8959b0-98e6-4631-a259-65d96b464353","Type":"ContainerDied","Data":"01b1d7c12c7c04de20bb0a312f2af6ee9635033bf84e545e4bd8fd2609ce5e31"}
Jul 02 22:07:52.629268 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.629226    2575 scope.go:117] "RemoveContainer" containerID="06a4a8e030b6283c99cd61cf3337eed4ac56a6ec5adbfd45d0cdb3a12284f895"
Jul 02 22:07:52.638530 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.638514    2575 scope.go:117] "RemoveContainer" containerID="06a4a8e030b6283c99cd61cf3337eed4ac56a6ec5adbfd45d0cdb3a12284f895"
Jul 02 22:07:52.638788 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:07:52.638769    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06a4a8e030b6283c99cd61cf3337eed4ac56a6ec5adbfd45d0cdb3a12284f895\": container with ID starting with 06a4a8e030b6283c99cd61cf3337eed4ac56a6ec5adbfd45d0cdb3a12284f895 not found: ID does not exist" containerID="06a4a8e030b6283c99cd61cf3337eed4ac56a6ec5adbfd45d0cdb3a12284f895"
Jul 02 22:07:52.638833 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.638797    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06a4a8e030b6283c99cd61cf3337eed4ac56a6ec5adbfd45d0cdb3a12284f895"} err="failed to get container status \"06a4a8e030b6283c99cd61cf3337eed4ac56a6ec5adbfd45d0cdb3a12284f895\": rpc error: code = NotFound desc = could not find container \"06a4a8e030b6283c99cd61cf3337eed4ac56a6ec5adbfd45d0cdb3a12284f895\": container with ID starting with 06a4a8e030b6283c99cd61cf3337eed4ac56a6ec5adbfd45d0cdb3a12284f895 not found: ID does not exist"
Jul 02 22:07:52.652403 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.652380    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"]
Jul 02 22:07:52.657787 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:52.657766    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-7bd61c91-67498f4649-xvsc5"]
Jul 02 22:07:53.524976 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:53.524944    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af8959b0-98e6-4631-a259-65d96b464353" path="/var/lib/kubelet/pods/af8959b0-98e6-4631-a259-65d96b464353/volumes"
Jul 02 22:07:57.922992 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:07:57.922961    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:08:02.996598 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:08:02.996556    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:08:14.826201 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:08:14.826154    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:08:14.889380 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:08:14.889344    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:08:39.919928 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:08:39.919889    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:08:41.272607 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:08:41.272569    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:08:45.647266 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:08:45.647235    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:08:59.784140 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:08:59.784098    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:08:59.849364 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:08:59.849324    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:00.064021 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:00.063924    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:00.287857 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:00.287806    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:01.328171 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:01.328117    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:01.426807 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:01.426754    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:01.531788 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:01.531760    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:02.233467 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:02.233409    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:02.330401 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:02.330353    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:02.431173 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:02.431142    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:03.812099 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:03.812059    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:09.533644 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:09.533606    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:09.596493 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:09.596464    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:10.210624 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:10.210588    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:10.284665 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:10.284630    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:16.044833 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:16.044796    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:16.113406 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:16.113374    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:16.453131 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:16.453081    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:16.554379 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:16.554347    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:27.048399 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:27.048365    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:27.416441 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:27.416405    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:48.383305 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:48.383263    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:54.261467 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:54.261430    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:54.361488 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:54.361460    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:54.611136 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:54.611103    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:54.921054 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:54.920952    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:55.233617 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:55.233524    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:57.662334 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.662300    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:57.711369 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.711343    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"]
Jul 02 22:09:57.711748 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.711732    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af8959b0-98e6-4631-a259-65d96b464353" containerName="maas-api"
Jul 02 22:09:57.711748 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.711749    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="af8959b0-98e6-4631-a259-65d96b464353" containerName="maas-api"
Jul 02 22:09:57.711841 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.711824    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="af8959b0-98e6-4631-a259-65d96b464353" containerName="maas-api"
Jul 02 22:09:57.714745 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.714729    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"
Jul 02 22:09:57.717662 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.717646    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-f4f68d-serving-cert\""
Jul 02 22:09:57.723746 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.723713    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"]
Jul 02 22:09:57.745579 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.745552    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:57.809837 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.809808    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:57.828959 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.828937    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttclq\" (UniqueName: \"kubernetes.io/projected/02568bf6-866e-4da3-a881-668505fa73e5-kube-api-access-ttclq\") pod \"maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9\" (UID: \"02568bf6-866e-4da3-a881-668505fa73e5\") " pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"
Jul 02 22:09:57.829098 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.828974    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02568bf6-866e-4da3-a881-668505fa73e5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9\" (UID: \"02568bf6-866e-4da3-a881-668505fa73e5\") " pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"
Jul 02 22:09:57.829098 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.829032    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02568bf6-866e-4da3-a881-668505fa73e5-maas-api-tls\") pod \"maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9\" (UID: \"02568bf6-866e-4da3-a881-668505fa73e5\") " pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"
Jul 02 22:09:57.930385 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.930323    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02568bf6-866e-4da3-a881-668505fa73e5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9\" (UID: \"02568bf6-866e-4da3-a881-668505fa73e5\") " pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"
Jul 02 22:09:57.930385 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.930367    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02568bf6-866e-4da3-a881-668505fa73e5-maas-api-tls\") pod \"maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9\" (UID: \"02568bf6-866e-4da3-a881-668505fa73e5\") " pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"
Jul 02 22:09:57.930522 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.930421    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttclq\" (UniqueName: \"kubernetes.io/projected/02568bf6-866e-4da3-a881-668505fa73e5-kube-api-access-ttclq\") pod \"maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9\" (UID: \"02568bf6-866e-4da3-a881-668505fa73e5\") " pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"
Jul 02 22:09:57.930559 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:09:57.930541    2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-f4f68d-serving-cert: secret "maas-api-e2e-inf-a-f4f68d-serving-cert" not found
Jul 02 22:09:57.930631 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:09:57.930620    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02568bf6-866e-4da3-a881-668505fa73e5-maas-api-tls podName:02568bf6-866e-4da3-a881-668505fa73e5 nodeName:}" failed. No retries permitted until 2026-07-02 22:09:58.430604546 +0000 UTC m=+2331.468083831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/02568bf6-866e-4da3-a881-668505fa73e5-maas-api-tls") pod "maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9" (UID: "02568bf6-866e-4da3-a881-668505fa73e5") : secret "maas-api-e2e-inf-a-f4f68d-serving-cert" not found
Jul 02 22:09:57.931107 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.931089    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02568bf6-866e-4da3-a881-668505fa73e5-openshift-service-ca\") pod \"maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9\" (UID: \"02568bf6-866e-4da3-a881-668505fa73e5\") " pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"
Jul 02 22:09:57.939549 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:57.939524    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttclq\" (UniqueName: \"kubernetes.io/projected/02568bf6-866e-4da3-a881-668505fa73e5-kube-api-access-ttclq\") pod \"maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9\" (UID: \"02568bf6-866e-4da3-a881-668505fa73e5\") " pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"
Jul 02 22:09:58.207142 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:58.207049    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:58.308054 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:58.307988    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:09:58.435780 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:58.435745    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02568bf6-866e-4da3-a881-668505fa73e5-maas-api-tls\") pod \"maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9\" (UID: \"02568bf6-866e-4da3-a881-668505fa73e5\") " pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"
Jul 02 22:09:58.438403 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:58.438368    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02568bf6-866e-4da3-a881-668505fa73e5-maas-api-tls\") pod \"maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9\" (UID: \"02568bf6-866e-4da3-a881-668505fa73e5\") " pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"
Jul 02 22:09:58.627299 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:58.627262    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"
Jul 02 22:09:58.765367 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:58.765341    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"]
Jul 02 22:09:58.767254 ip-10-0-139-110 kubenswrapper[2575]: W0702 22:09:58.767217    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02568bf6_866e_4da3_a881_668505fa73e5.slice/crio-57f5bcd2fcfa2d035ee33a84b0cfe14869b6e7da8c7391311f38c2b5dc20107a WatchSource:0}: Error finding container 57f5bcd2fcfa2d035ee33a84b0cfe14869b6e7da8c7391311f38c2b5dc20107a: Status 404 returned error can't find the container with id 57f5bcd2fcfa2d035ee33a84b0cfe14869b6e7da8c7391311f38c2b5dc20107a
Jul 02 22:09:58.768573 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:58.768539    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 22:09:59.194072 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:09:59.194047    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9" event={"ID":"02568bf6-866e-4da3-a881-668505fa73e5","Type":"ContainerStarted","Data":"57f5bcd2fcfa2d035ee33a84b0cfe14869b6e7da8c7391311f38c2b5dc20107a"}
Jul 02 22:10:00.200286 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:00.200252    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9" event={"ID":"02568bf6-866e-4da3-a881-668505fa73e5","Type":"ContainerStarted","Data":"df690860f174c088a3153768905ff62bc714664557ba86d8b2e7429f30b679ee"}
Jul 02 22:10:00.200674 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:00.200317    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"
Jul 02 22:10:00.223191 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:00.223143    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9" podStartSLOduration=2.822147161 podStartE2EDuration="3.223126406s" totalImagesPullingTime="400.979245ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:10:00.222153114 +0000 UTC m=+2333.259632416" watchObservedRunningTime="2026-07-02 22:10:00.223126406 +0000 UTC m=+2333.260605713"
Jul 02 22:10:02.160678 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:02.160642    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:02.501808 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:02.501724    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:02.804784 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:02.804699    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:03.283677 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:03.283629    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:05.698455 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:05.698420    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:05.772987 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:05.772956    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"]
Jul 02 22:10:05.776754 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:05.776728    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"
Jul 02 22:10:05.779543 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:05.779518    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-37c632-serving-cert\""
Jul 02 22:10:05.786526 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:05.786501    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"]
Jul 02 22:10:05.789846 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:05.789799    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:05.801808 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:05.801781    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-maas-api-tls\") pod \"maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2\" (UID: \"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd\") " pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"
Jul 02 22:10:05.801808 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:05.801816    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2\" (UID: \"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd\") " pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"
Jul 02 22:10:05.801991 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:05.801850    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2zpp\" (UniqueName: \"kubernetes.io/projected/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-kube-api-access-k2zpp\") pod \"maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2\" (UID: \"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd\") " pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"
Jul 02 22:10:05.879966 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:05.879930    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:05.902873 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:05.902844    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-maas-api-tls\") pod \"maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2\" (UID: \"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd\") " pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"
Jul 02 22:10:05.903030 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:05.902882    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2\" (UID: \"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd\") " pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"
Jul 02 22:10:05.903030 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:05.902921    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2zpp\" (UniqueName: \"kubernetes.io/projected/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-kube-api-access-k2zpp\") pod \"maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2\" (UID: \"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd\") " pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"
Jul 02 22:10:05.903030 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:10:05.903020    2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-37c632-serving-cert: secret "maas-api-e2e-inf-b-37c632-serving-cert" not found
Jul 02 22:10:05.903216 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:10:05.903095    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-maas-api-tls podName:bb09dc9e-08ab-46ac-a203-13a6cb4be4fd nodeName:}" failed. No retries permitted until 2026-07-02 22:10:06.403074209 +0000 UTC m=+2339.440553495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-maas-api-tls") pod "maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2" (UID: "bb09dc9e-08ab-46ac-a203-13a6cb4be4fd") : secret "maas-api-e2e-inf-b-37c632-serving-cert" not found
Jul 02 22:10:05.903594 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:05.903573    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2\" (UID: \"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd\") " pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"
Jul 02 22:10:05.917690 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:05.917667    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2zpp\" (UniqueName: \"kubernetes.io/projected/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-kube-api-access-k2zpp\") pod \"maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2\" (UID: \"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd\") " pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"
Jul 02 22:10:06.110572 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:06.110539    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:06.209879 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:06.209857    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"
Jul 02 22:10:06.302712 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:06.302677    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:06.401064 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:06.400964    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:06.406926 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:06.406905    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-maas-api-tls\") pod \"maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2\" (UID: \"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd\") " pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"
Jul 02 22:10:06.409268 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:06.409249    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-maas-api-tls\") pod \"maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2\" (UID: \"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd\") " pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"
Jul 02 22:10:06.691498 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:06.691415    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"
Jul 02 22:10:06.820146 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:06.820119    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"]
Jul 02 22:10:06.822704 ip-10-0-139-110 kubenswrapper[2575]: W0702 22:10:06.822676    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb09dc9e_08ab_46ac_a203_13a6cb4be4fd.slice/crio-ba59b9db91ca4468b583b09984c00697943a72eb358abde990f9a376558b7eda WatchSource:0}: Error finding container ba59b9db91ca4468b583b09984c00697943a72eb358abde990f9a376558b7eda: Status 404 returned error can't find the container with id ba59b9db91ca4468b583b09984c00697943a72eb358abde990f9a376558b7eda
Jul 02 22:10:07.234325 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:07.234288    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2" event={"ID":"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd","Type":"ContainerStarted","Data":"76bb96769d19c894ff2071b07b055850b1fd6c3be3dd82a28de1b3eec6023cf7"}
Jul 02 22:10:07.234439 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:07.234351    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2" event={"ID":"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd","Type":"ContainerStarted","Data":"ba59b9db91ca4468b583b09984c00697943a72eb358abde990f9a376558b7eda"}
Jul 02 22:10:07.234439 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:07.234402    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"
Jul 02 22:10:07.252795 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:07.252751    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2" podStartSLOduration=1.927583202 podStartE2EDuration="2.252735485s" totalImagesPullingTime="325.152283ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:10:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:10:07.251357247 +0000 UTC m=+2340.288836557" watchObservedRunningTime="2026-07-02 22:10:07.252735485 +0000 UTC m=+2340.290214793"
Jul 02 22:10:08.714952 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:08.714918    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:10.200133 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:10.200099    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:13.245499 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:13.245473    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"
Jul 02 22:10:18.935068 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:18.935022    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:19.036820 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:19.036786    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:19.662903 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:19.662864    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:27.169209 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:27.169173    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:27.270651 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:27.270622    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:51.354620 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:51.354590    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:10:53.376177 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:10:53.376141    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:11:13.237030 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:13.236967    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:11:13.798109 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:13.798078    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:11:14.722505 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:14.722470    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:11:14.880085 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:14.880052    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:11:15.269688 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:15.269648    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:11:15.369600 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:15.369569    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:11:15.470360 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:15.470319    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:11:15.513354 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:15.513329    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"]
Jul 02 22:11:15.513562 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:15.513539    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9" podUID="02568bf6-866e-4da3-a881-668505fa73e5" containerName="maas-api" containerID="cri-o://df690860f174c088a3153768905ff62bc714664557ba86d8b2e7429f30b679ee" gracePeriod=30
Jul 02 22:11:15.570852 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:15.570772    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:11:15.966599 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:15.966575    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"
Jul 02 22:11:16.113676 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.113653    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttclq\" (UniqueName: \"kubernetes.io/projected/02568bf6-866e-4da3-a881-668505fa73e5-kube-api-access-ttclq\") pod \"02568bf6-866e-4da3-a881-668505fa73e5\" (UID: \"02568bf6-866e-4da3-a881-668505fa73e5\") "
Jul 02 22:11:16.113830 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.113710    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02568bf6-866e-4da3-a881-668505fa73e5-maas-api-tls\") pod \"02568bf6-866e-4da3-a881-668505fa73e5\" (UID: \"02568bf6-866e-4da3-a881-668505fa73e5\") "
Jul 02 22:11:16.113830 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.113797    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02568bf6-866e-4da3-a881-668505fa73e5-openshift-service-ca\") pod \"02568bf6-866e-4da3-a881-668505fa73e5\" (UID: \"02568bf6-866e-4da3-a881-668505fa73e5\") "
Jul 02 22:11:16.114148 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.114127    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02568bf6-866e-4da3-a881-668505fa73e5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "02568bf6-866e-4da3-a881-668505fa73e5" (UID: "02568bf6-866e-4da3-a881-668505fa73e5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 22:11:16.115698 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.115676    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02568bf6-866e-4da3-a881-668505fa73e5-kube-api-access-ttclq" (OuterVolumeSpecName: "kube-api-access-ttclq") pod "02568bf6-866e-4da3-a881-668505fa73e5" (UID: "02568bf6-866e-4da3-a881-668505fa73e5"). InnerVolumeSpecName "kube-api-access-ttclq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:11:16.115698 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.115685    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02568bf6-866e-4da3-a881-668505fa73e5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "02568bf6-866e-4da3-a881-668505fa73e5" (UID: "02568bf6-866e-4da3-a881-668505fa73e5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:11:16.215363 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.215338    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02568bf6-866e-4da3-a881-668505fa73e5-openshift-service-ca\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:11:16.215363 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.215359    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttclq\" (UniqueName: \"kubernetes.io/projected/02568bf6-866e-4da3-a881-668505fa73e5-kube-api-access-ttclq\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:11:16.215363 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.215370    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02568bf6-866e-4da3-a881-668505fa73e5-maas-api-tls\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:11:16.545186 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.545101    2575 generic.go:356] "Generic (PLEG): container finished" podID="02568bf6-866e-4da3-a881-668505fa73e5" containerID="df690860f174c088a3153768905ff62bc714664557ba86d8b2e7429f30b679ee" exitCode=0
Jul 02 22:11:16.545186 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.545145    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"
Jul 02 22:11:16.545186 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.545170    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9" event={"ID":"02568bf6-866e-4da3-a881-668505fa73e5","Type":"ContainerDied","Data":"df690860f174c088a3153768905ff62bc714664557ba86d8b2e7429f30b679ee"}
Jul 02 22:11:16.545390 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.545208    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9" event={"ID":"02568bf6-866e-4da3-a881-668505fa73e5","Type":"ContainerDied","Data":"57f5bcd2fcfa2d035ee33a84b0cfe14869b6e7da8c7391311f38c2b5dc20107a"}
Jul 02 22:11:16.545390 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.545230    2575 scope.go:117] "RemoveContainer" containerID="df690860f174c088a3153768905ff62bc714664557ba86d8b2e7429f30b679ee"
Jul 02 22:11:16.553973 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.553957    2575 scope.go:117] "RemoveContainer" containerID="df690860f174c088a3153768905ff62bc714664557ba86d8b2e7429f30b679ee"
Jul 02 22:11:16.554232 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:11:16.554214    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df690860f174c088a3153768905ff62bc714664557ba86d8b2e7429f30b679ee\": container with ID starting with df690860f174c088a3153768905ff62bc714664557ba86d8b2e7429f30b679ee not found: ID does not exist" containerID="df690860f174c088a3153768905ff62bc714664557ba86d8b2e7429f30b679ee"
Jul 02 22:11:16.554307 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.554238    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df690860f174c088a3153768905ff62bc714664557ba86d8b2e7429f30b679ee"} err="failed to get container status \"df690860f174c088a3153768905ff62bc714664557ba86d8b2e7429f30b679ee\": rpc error: code = NotFound desc = could not find container \"df690860f174c088a3153768905ff62bc714664557ba86d8b2e7429f30b679ee\": container with ID starting with df690860f174c088a3153768905ff62bc714664557ba86d8b2e7429f30b679ee not found: ID does not exist"
Jul 02 22:11:16.568823 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.568775    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"]
Jul 02 22:11:16.570877 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:16.570857    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-f4f68d-6867fb8f48-7jfv9"]
Jul 02 22:11:17.525562 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:17.525526    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02568bf6-866e-4da3-a881-668505fa73e5" path="/var/lib/kubelet/pods/02568bf6-866e-4da3-a881-668505fa73e5/volumes"
Jul 02 22:11:20.451585 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:20.451540    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:11:57.203642 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:57.203595    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:11:57.497305 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:57.497210    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:11:57.728549 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:57.728510    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:11:58.026635 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:58.026595    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:11:58.464561 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:58.464523    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:11:58.561897 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:58.561859    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:11:58.684541 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:58.684508    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"]
Jul 02 22:11:58.684815 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:58.684783    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2" podUID="bb09dc9e-08ab-46ac-a203-13a6cb4be4fd" containerName="maas-api" containerID="cri-o://76bb96769d19c894ff2071b07b055850b1fd6c3be3dd82a28de1b3eec6023cf7" gracePeriod=30
Jul 02 22:11:58.728831 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:58.728772    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:11:58.931185 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:58.931160    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"
Jul 02 22:11:58.978108 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:58.978076    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-openshift-service-ca\") pod \"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd\" (UID: \"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd\") "
Jul 02 22:11:58.978266 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:58.978117    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2zpp\" (UniqueName: \"kubernetes.io/projected/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-kube-api-access-k2zpp\") pod \"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd\" (UID: \"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd\") "
Jul 02 22:11:58.978266 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:58.978154    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-maas-api-tls\") pod \"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd\" (UID: \"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd\") "
Jul 02 22:11:58.978468 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:58.978439    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bb09dc9e-08ab-46ac-a203-13a6cb4be4fd" (UID: "bb09dc9e-08ab-46ac-a203-13a6cb4be4fd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 22:11:58.980335 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:58.980275    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-kube-api-access-k2zpp" (OuterVolumeSpecName: "kube-api-access-k2zpp") pod "bb09dc9e-08ab-46ac-a203-13a6cb4be4fd" (UID: "bb09dc9e-08ab-46ac-a203-13a6cb4be4fd"). InnerVolumeSpecName "kube-api-access-k2zpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:11:58.980434 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:58.980388    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bb09dc9e-08ab-46ac-a203-13a6cb4be4fd" (UID: "bb09dc9e-08ab-46ac-a203-13a6cb4be4fd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:11:59.078900 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:59.078872    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-openshift-service-ca\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:11:59.078900 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:59.078899    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2zpp\" (UniqueName: \"kubernetes.io/projected/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-kube-api-access-k2zpp\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:11:59.079109 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:59.078913    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd-maas-api-tls\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:11:59.756531 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:59.756500    2575 generic.go:356] "Generic (PLEG): container finished" podID="bb09dc9e-08ab-46ac-a203-13a6cb4be4fd" containerID="76bb96769d19c894ff2071b07b055850b1fd6c3be3dd82a28de1b3eec6023cf7" exitCode=0
Jul 02 22:11:59.756892 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:59.756542    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"
Jul 02 22:11:59.756892 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:59.756542    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2" event={"ID":"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd","Type":"ContainerDied","Data":"76bb96769d19c894ff2071b07b055850b1fd6c3be3dd82a28de1b3eec6023cf7"}
Jul 02 22:11:59.756892 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:59.756671    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2" event={"ID":"bb09dc9e-08ab-46ac-a203-13a6cb4be4fd","Type":"ContainerDied","Data":"ba59b9db91ca4468b583b09984c00697943a72eb358abde990f9a376558b7eda"}
Jul 02 22:11:59.756892 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:59.756698    2575 scope.go:117] "RemoveContainer" containerID="76bb96769d19c894ff2071b07b055850b1fd6c3be3dd82a28de1b3eec6023cf7"
Jul 02 22:11:59.765071 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:59.765053    2575 scope.go:117] "RemoveContainer" containerID="76bb96769d19c894ff2071b07b055850b1fd6c3be3dd82a28de1b3eec6023cf7"
Jul 02 22:11:59.765330 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:11:59.765307    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76bb96769d19c894ff2071b07b055850b1fd6c3be3dd82a28de1b3eec6023cf7\": container with ID starting with 76bb96769d19c894ff2071b07b055850b1fd6c3be3dd82a28de1b3eec6023cf7 not found: ID does not exist" containerID="76bb96769d19c894ff2071b07b055850b1fd6c3be3dd82a28de1b3eec6023cf7"
Jul 02 22:11:59.765426 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:59.765335    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76bb96769d19c894ff2071b07b055850b1fd6c3be3dd82a28de1b3eec6023cf7"} err="failed to get container status \"76bb96769d19c894ff2071b07b055850b1fd6c3be3dd82a28de1b3eec6023cf7\": rpc error: code = NotFound desc = could not find container \"76bb96769d19c894ff2071b07b055850b1fd6c3be3dd82a28de1b3eec6023cf7\": container with ID starting with 76bb96769d19c894ff2071b07b055850b1fd6c3be3dd82a28de1b3eec6023cf7 not found: ID does not exist"
Jul 02 22:11:59.772385 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:59.772365    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"]
Jul 02 22:11:59.776344 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:11:59.776322    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-37c632-6444d678b5-jtkl2"]
Jul 02 22:12:01.524547 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:01.524516    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bb09dc9e-08ab-46ac-a203-13a6cb4be4fd" path="/var/lib/kubelet/pods/bb09dc9e-08ab-46ac-a203-13a6cb4be4fd/volumes"
Jul 02 22:12:04.049930 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:04.049895    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:04.149925 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:04.149897    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:04.303734 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:04.303656    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:04.526992 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:04.526949    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:04.880156 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:04.880121    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:05.188258 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:05.188171    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:05.522017 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:05.521896    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:08.469548 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.469502    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:08.543209 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.543175    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"]
Jul 02 22:12:08.543735 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.543718    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb09dc9e-08ab-46ac-a203-13a6cb4be4fd" containerName="maas-api"
Jul 02 22:12:08.543811 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.543737    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb09dc9e-08ab-46ac-a203-13a6cb4be4fd" containerName="maas-api"
Jul 02 22:12:08.543811 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.543768    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02568bf6-866e-4da3-a881-668505fa73e5" containerName="maas-api"
Jul 02 22:12:08.543811 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.543777    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="02568bf6-866e-4da3-a881-668505fa73e5" containerName="maas-api"
Jul 02 22:12:08.543975 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.543884    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="02568bf6-866e-4da3-a881-668505fa73e5" containerName="maas-api"
Jul 02 22:12:08.543975 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.543896    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb09dc9e-08ab-46ac-a203-13a6cb4be4fd" containerName="maas-api"
Jul 02 22:12:08.548682 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.548662    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"
Jul 02 22:12:08.551252 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.551234    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-002aff-serving-cert\""
Jul 02 22:12:08.554938 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.554727    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:08.555658 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.555625    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"]
Jul 02 22:12:08.615493 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.615460    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:08.667265 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.667228    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86941834-7af0-44db-a49c-e80c0ee2a694-maas-api-tls\") pod \"maas-api-e2e-api-a-002aff-5d955797cd-wd5fr\" (UID: \"86941834-7af0-44db-a49c-e80c0ee2a694\") " pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"
Jul 02 22:12:08.667492 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.667316    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z82gz\" (UniqueName: \"kubernetes.io/projected/86941834-7af0-44db-a49c-e80c0ee2a694-kube-api-access-z82gz\") pod \"maas-api-e2e-api-a-002aff-5d955797cd-wd5fr\" (UID: \"86941834-7af0-44db-a49c-e80c0ee2a694\") " pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"
Jul 02 22:12:08.667492 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.667347    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86941834-7af0-44db-a49c-e80c0ee2a694-openshift-service-ca\") pod \"maas-api-e2e-api-a-002aff-5d955797cd-wd5fr\" (UID: \"86941834-7af0-44db-a49c-e80c0ee2a694\") " pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"
Jul 02 22:12:08.768553 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.768450    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z82gz\" (UniqueName: \"kubernetes.io/projected/86941834-7af0-44db-a49c-e80c0ee2a694-kube-api-access-z82gz\") pod \"maas-api-e2e-api-a-002aff-5d955797cd-wd5fr\" (UID: \"86941834-7af0-44db-a49c-e80c0ee2a694\") " pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"
Jul 02 22:12:08.768553 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.768501    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86941834-7af0-44db-a49c-e80c0ee2a694-openshift-service-ca\") pod \"maas-api-e2e-api-a-002aff-5d955797cd-wd5fr\" (UID: \"86941834-7af0-44db-a49c-e80c0ee2a694\") " pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"
Jul 02 22:12:08.768788 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.768620    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86941834-7af0-44db-a49c-e80c0ee2a694-maas-api-tls\") pod \"maas-api-e2e-api-a-002aff-5d955797cd-wd5fr\" (UID: \"86941834-7af0-44db-a49c-e80c0ee2a694\") " pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"
Jul 02 22:12:08.768788 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:12:08.768735    2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-002aff-serving-cert: secret "maas-api-e2e-api-a-002aff-serving-cert" not found
Jul 02 22:12:08.768903 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:12:08.768797    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86941834-7af0-44db-a49c-e80c0ee2a694-maas-api-tls podName:86941834-7af0-44db-a49c-e80c0ee2a694 nodeName:}" failed. No retries permitted until 2026-07-02 22:12:09.268778155 +0000 UTC m=+2462.306257445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/86941834-7af0-44db-a49c-e80c0ee2a694-maas-api-tls") pod "maas-api-e2e-api-a-002aff-5d955797cd-wd5fr" (UID: "86941834-7af0-44db-a49c-e80c0ee2a694") : secret "maas-api-e2e-api-a-002aff-serving-cert" not found
Jul 02 22:12:08.769185 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.769165    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86941834-7af0-44db-a49c-e80c0ee2a694-openshift-service-ca\") pod \"maas-api-e2e-api-a-002aff-5d955797cd-wd5fr\" (UID: \"86941834-7af0-44db-a49c-e80c0ee2a694\") " pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"
Jul 02 22:12:08.779876 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.779846    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z82gz\" (UniqueName: \"kubernetes.io/projected/86941834-7af0-44db-a49c-e80c0ee2a694-kube-api-access-z82gz\") pod \"maas-api-e2e-api-a-002aff-5d955797cd-wd5fr\" (UID: \"86941834-7af0-44db-a49c-e80c0ee2a694\") " pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"
Jul 02 22:12:08.878040 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:08.877984    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:09.191644 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:09.191580    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:09.273302 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:09.273269    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86941834-7af0-44db-a49c-e80c0ee2a694-maas-api-tls\") pod \"maas-api-e2e-api-a-002aff-5d955797cd-wd5fr\" (UID: \"86941834-7af0-44db-a49c-e80c0ee2a694\") " pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"
Jul 02 22:12:09.275617 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:09.275590    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86941834-7af0-44db-a49c-e80c0ee2a694-maas-api-tls\") pod \"maas-api-e2e-api-a-002aff-5d955797cd-wd5fr\" (UID: \"86941834-7af0-44db-a49c-e80c0ee2a694\") " pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"
Jul 02 22:12:09.292854 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:09.292825    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:09.461686 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:09.461602    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"
Jul 02 22:12:09.597107 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:09.597081    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"]
Jul 02 22:12:09.599690 ip-10-0-139-110 kubenswrapper[2575]: W0702 22:12:09.599661    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86941834_7af0_44db_a49c_e80c0ee2a694.slice/crio-a9c7bd749348b9c7c85c99b52547fa6d657707dce999794ffb62c04544cdd64d WatchSource:0}: Error finding container a9c7bd749348b9c7c85c99b52547fa6d657707dce999794ffb62c04544cdd64d: Status 404 returned error can't find the container with id a9c7bd749348b9c7c85c99b52547fa6d657707dce999794ffb62c04544cdd64d
Jul 02 22:12:09.810571 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:09.810484    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr" event={"ID":"86941834-7af0-44db-a49c-e80c0ee2a694","Type":"ContainerStarted","Data":"a9c7bd749348b9c7c85c99b52547fa6d657707dce999794ffb62c04544cdd64d"}
Jul 02 22:12:10.816716 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:10.816685    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr" event={"ID":"86941834-7af0-44db-a49c-e80c0ee2a694","Type":"ContainerStarted","Data":"6d9f4a3c262080962989c7206bcf26bbac0c0a05ee306d5023188270b0c58f92"}
Jul 02 22:12:10.817156 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:10.816798    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"
Jul 02 22:12:10.836216 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:10.836168    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr" podStartSLOduration=2.447192787 podStartE2EDuration="2.836155737s" totalImagesPullingTime="388.96295ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:12:10.834510167 +0000 UTC m=+2463.871989476" watchObservedRunningTime="2026-07-02 22:12:10.836155737 +0000 UTC m=+2463.873635044"
Jul 02 22:12:12.987672 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:12.987641    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:13.447427 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:13.447395    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:13.763103 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:13.763028    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:13.862633 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:13.862603    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:16.581874 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.581831    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:16.668986 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.668952    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"]
Jul 02 22:12:16.672569 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.672547    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"
Jul 02 22:12:16.676020 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.675984    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-6f0ab8-serving-cert\""
Jul 02 22:12:16.681358 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.681334    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:16.682954 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.682929    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"]
Jul 02 22:12:16.794283 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.794242    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:16.827729 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.827705    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"
Jul 02 22:12:16.838035 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.837965    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbb19a91-27ea-4def-b2df-84474ed7459f-maas-api-tls\") pod \"maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667\" (UID: \"fbb19a91-27ea-4def-b2df-84474ed7459f\") " pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"
Jul 02 22:12:16.838035 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.837992    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbb19a91-27ea-4def-b2df-84474ed7459f-openshift-service-ca\") pod \"maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667\" (UID: \"fbb19a91-27ea-4def-b2df-84474ed7459f\") " pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"
Jul 02 22:12:16.838190 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.838086    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jq56\" (UniqueName: \"kubernetes.io/projected/fbb19a91-27ea-4def-b2df-84474ed7459f-kube-api-access-5jq56\") pod \"maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667\" (UID: \"fbb19a91-27ea-4def-b2df-84474ed7459f\") " pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"
Jul 02 22:12:16.938905 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.938879    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jq56\" (UniqueName: \"kubernetes.io/projected/fbb19a91-27ea-4def-b2df-84474ed7459f-kube-api-access-5jq56\") pod \"maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667\" (UID: \"fbb19a91-27ea-4def-b2df-84474ed7459f\") " pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"
Jul 02 22:12:16.939081 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.938966    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbb19a91-27ea-4def-b2df-84474ed7459f-maas-api-tls\") pod \"maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667\" (UID: \"fbb19a91-27ea-4def-b2df-84474ed7459f\") " pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"
Jul 02 22:12:16.939081 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.938994    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbb19a91-27ea-4def-b2df-84474ed7459f-openshift-service-ca\") pod \"maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667\" (UID: \"fbb19a91-27ea-4def-b2df-84474ed7459f\") " pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"
Jul 02 22:12:16.939727 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.939704    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbb19a91-27ea-4def-b2df-84474ed7459f-openshift-service-ca\") pod \"maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667\" (UID: \"fbb19a91-27ea-4def-b2df-84474ed7459f\") " pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"
Jul 02 22:12:16.941364 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.941344    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbb19a91-27ea-4def-b2df-84474ed7459f-maas-api-tls\") pod \"maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667\" (UID: \"fbb19a91-27ea-4def-b2df-84474ed7459f\") " pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"
Jul 02 22:12:16.945985 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.945956    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:16.949311 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.949290    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jq56\" (UniqueName: \"kubernetes.io/projected/fbb19a91-27ea-4def-b2df-84474ed7459f-kube-api-access-5jq56\") pod \"maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667\" (UID: \"fbb19a91-27ea-4def-b2df-84474ed7459f\") " pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"
Jul 02 22:12:16.984245 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:16.984228    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"
Jul 02 22:12:17.136897 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:17.136865    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"]
Jul 02 22:12:17.141406 ip-10-0-139-110 kubenswrapper[2575]: W0702 22:12:17.141375    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbb19a91_27ea_4def_b2df_84474ed7459f.slice/crio-97bbb21666d48d78949ccdcefb0b07e0f58d1fb645bebc247ff83e2dc0fe1b8e WatchSource:0}: Error finding container 97bbb21666d48d78949ccdcefb0b07e0f58d1fb645bebc247ff83e2dc0fe1b8e: Status 404 returned error can't find the container with id 97bbb21666d48d78949ccdcefb0b07e0f58d1fb645bebc247ff83e2dc0fe1b8e
Jul 02 22:12:17.380946 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:17.380909    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:17.481369 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:17.481342    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:17.854203 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:17.854171    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667" event={"ID":"fbb19a91-27ea-4def-b2df-84474ed7459f","Type":"ContainerStarted","Data":"a1f9c3a290d973af81d8eb8b207ab3f693c8b227b705a34b89fcd2fb25982853"}
Jul 02 22:12:17.854572 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:17.854218    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667" event={"ID":"fbb19a91-27ea-4def-b2df-84474ed7459f","Type":"ContainerStarted","Data":"97bbb21666d48d78949ccdcefb0b07e0f58d1fb645bebc247ff83e2dc0fe1b8e"}
Jul 02 22:12:17.854572 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:17.854274    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"
Jul 02 22:12:17.872028 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:17.871954    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667" podStartSLOduration=1.556399434 podStartE2EDuration="1.871935429s" totalImagesPullingTime="315.535995ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:12:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:12:17.871255567 +0000 UTC m=+2470.908734875" watchObservedRunningTime="2026-07-02 22:12:17.871935429 +0000 UTC m=+2470.909414740"
Jul 02 22:12:21.065274 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:21.065238    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:22.938352 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:22.938309    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:23.038328 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:23.038291    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:23.863893 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:23.863866    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"
Jul 02 22:12:29.085433 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:29.085392    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:29.476873 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:29.476835    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:29.578101 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:29.578067    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:29.669982 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:29.669944    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:29.768575 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:29.768494    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"]
Jul 02 22:12:29.768747 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:29.768703    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr" podUID="86941834-7af0-44db-a49c-e80c0ee2a694" containerName="maas-api" containerID="cri-o://6d9f4a3c262080962989c7206bcf26bbac0c0a05ee306d5023188270b0c58f92" gracePeriod=30
Jul 02 22:12:29.799827 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:29.799791    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:29.909839 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:29.909805    2575 generic.go:356] "Generic (PLEG): container finished" podID="86941834-7af0-44db-a49c-e80c0ee2a694" containerID="6d9f4a3c262080962989c7206bcf26bbac0c0a05ee306d5023188270b0c58f92" exitCode=0
Jul 02 22:12:29.909982 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:29.909879    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr" event={"ID":"86941834-7af0-44db-a49c-e80c0ee2a694","Type":"ContainerDied","Data":"6d9f4a3c262080962989c7206bcf26bbac0c0a05ee306d5023188270b0c58f92"}
Jul 02 22:12:30.015172 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:30.015144    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"
Jul 02 22:12:30.051395 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:30.051313    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86941834-7af0-44db-a49c-e80c0ee2a694-maas-api-tls\") pod \"86941834-7af0-44db-a49c-e80c0ee2a694\" (UID: \"86941834-7af0-44db-a49c-e80c0ee2a694\") "
Jul 02 22:12:30.051395 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:30.051347    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86941834-7af0-44db-a49c-e80c0ee2a694-openshift-service-ca\") pod \"86941834-7af0-44db-a49c-e80c0ee2a694\" (UID: \"86941834-7af0-44db-a49c-e80c0ee2a694\") "
Jul 02 22:12:30.051395 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:30.051380    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z82gz\" (UniqueName: \"kubernetes.io/projected/86941834-7af0-44db-a49c-e80c0ee2a694-kube-api-access-z82gz\") pod \"86941834-7af0-44db-a49c-e80c0ee2a694\" (UID: \"86941834-7af0-44db-a49c-e80c0ee2a694\") "
Jul 02 22:12:30.051771 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:30.051744    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86941834-7af0-44db-a49c-e80c0ee2a694-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "86941834-7af0-44db-a49c-e80c0ee2a694" (UID: "86941834-7af0-44db-a49c-e80c0ee2a694"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 22:12:30.053467 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:30.053437    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86941834-7af0-44db-a49c-e80c0ee2a694-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "86941834-7af0-44db-a49c-e80c0ee2a694" (UID: "86941834-7af0-44db-a49c-e80c0ee2a694"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:12:30.053467 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:30.053452    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86941834-7af0-44db-a49c-e80c0ee2a694-kube-api-access-z82gz" (OuterVolumeSpecName: "kube-api-access-z82gz") pod "86941834-7af0-44db-a49c-e80c0ee2a694" (UID: "86941834-7af0-44db-a49c-e80c0ee2a694"). InnerVolumeSpecName "kube-api-access-z82gz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:12:30.152417 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:30.152385    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86941834-7af0-44db-a49c-e80c0ee2a694-maas-api-tls\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:12:30.152417 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:30.152408    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86941834-7af0-44db-a49c-e80c0ee2a694-openshift-service-ca\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:12:30.152417 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:30.152419    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z82gz\" (UniqueName: \"kubernetes.io/projected/86941834-7af0-44db-a49c-e80c0ee2a694-kube-api-access-z82gz\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:12:30.916135 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:30.916102    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr" event={"ID":"86941834-7af0-44db-a49c-e80c0ee2a694","Type":"ContainerDied","Data":"a9c7bd749348b9c7c85c99b52547fa6d657707dce999794ffb62c04544cdd64d"}
Jul 02 22:12:30.916135 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:30.916124    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"
Jul 02 22:12:30.916355 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:30.916160    2575 scope.go:117] "RemoveContainer" containerID="6d9f4a3c262080962989c7206bcf26bbac0c0a05ee306d5023188270b0c58f92"
Jul 02 22:12:30.938931 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:30.938907    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"]
Jul 02 22:12:30.942956 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:30.942934    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-002aff-5d955797cd-wd5fr"]
Jul 02 22:12:31.525392 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:31.525359    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86941834-7af0-44db-a49c-e80c0ee2a694" path="/var/lib/kubelet/pods/86941834-7af0-44db-a49c-e80c0ee2a694/volumes"
Jul 02 22:12:35.248736 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:35.248698    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:35.317391 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:35.317362    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:35.498638 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:35.498599    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:35.716615 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:35.716580    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:36.028678 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:36.028599    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:36.380208 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:36.380168    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:36.480392 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:36.480361    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:36.582128 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:36.582093    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:36.671983 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:36.671906    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"]
Jul 02 22:12:36.672189 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:36.672135    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667" podUID="fbb19a91-27ea-4def-b2df-84474ed7459f" containerName="maas-api" containerID="cri-o://a1f9c3a290d973af81d8eb8b207ab3f693c8b227b705a34b89fcd2fb25982853" gracePeriod=30
Jul 02 22:12:36.697419 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:36.697392    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:36.914941 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:36.914919    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"
Jul 02 22:12:36.946860 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:36.946785    2575 generic.go:356] "Generic (PLEG): container finished" podID="fbb19a91-27ea-4def-b2df-84474ed7459f" containerID="a1f9c3a290d973af81d8eb8b207ab3f693c8b227b705a34b89fcd2fb25982853" exitCode=0
Jul 02 22:12:36.946860 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:36.946834    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"
Jul 02 22:12:36.947043 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:36.946870    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667" event={"ID":"fbb19a91-27ea-4def-b2df-84474ed7459f","Type":"ContainerDied","Data":"a1f9c3a290d973af81d8eb8b207ab3f693c8b227b705a34b89fcd2fb25982853"}
Jul 02 22:12:36.947043 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:36.946909    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667" event={"ID":"fbb19a91-27ea-4def-b2df-84474ed7459f","Type":"ContainerDied","Data":"97bbb21666d48d78949ccdcefb0b07e0f58d1fb645bebc247ff83e2dc0fe1b8e"}
Jul 02 22:12:36.947043 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:36.946933    2575 scope.go:117] "RemoveContainer" containerID="a1f9c3a290d973af81d8eb8b207ab3f693c8b227b705a34b89fcd2fb25982853"
Jul 02 22:12:36.955316 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:36.955303    2575 scope.go:117] "RemoveContainer" containerID="a1f9c3a290d973af81d8eb8b207ab3f693c8b227b705a34b89fcd2fb25982853"
Jul 02 22:12:36.955543 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:12:36.955522    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1f9c3a290d973af81d8eb8b207ab3f693c8b227b705a34b89fcd2fb25982853\": container with ID starting with a1f9c3a290d973af81d8eb8b207ab3f693c8b227b705a34b89fcd2fb25982853 not found: ID does not exist" containerID="a1f9c3a290d973af81d8eb8b207ab3f693c8b227b705a34b89fcd2fb25982853"
Jul 02 22:12:36.955625 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:36.955548    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1f9c3a290d973af81d8eb8b207ab3f693c8b227b705a34b89fcd2fb25982853"} err="failed to get container status \"a1f9c3a290d973af81d8eb8b207ab3f693c8b227b705a34b89fcd2fb25982853\": rpc error: code = NotFound desc = could not find container \"a1f9c3a290d973af81d8eb8b207ab3f693c8b227b705a34b89fcd2fb25982853\": container with ID starting with a1f9c3a290d973af81d8eb8b207ab3f693c8b227b705a34b89fcd2fb25982853 not found: ID does not exist"
Jul 02 22:12:37.015173 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:37.015149    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jq56\" (UniqueName: \"kubernetes.io/projected/fbb19a91-27ea-4def-b2df-84474ed7459f-kube-api-access-5jq56\") pod \"fbb19a91-27ea-4def-b2df-84474ed7459f\" (UID: \"fbb19a91-27ea-4def-b2df-84474ed7459f\") "
Jul 02 22:12:37.015288 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:37.015212    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbb19a91-27ea-4def-b2df-84474ed7459f-maas-api-tls\") pod \"fbb19a91-27ea-4def-b2df-84474ed7459f\" (UID: \"fbb19a91-27ea-4def-b2df-84474ed7459f\") "
Jul 02 22:12:37.015329 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:37.015287    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbb19a91-27ea-4def-b2df-84474ed7459f-openshift-service-ca\") pod \"fbb19a91-27ea-4def-b2df-84474ed7459f\" (UID: \"fbb19a91-27ea-4def-b2df-84474ed7459f\") "
Jul 02 22:12:37.015633 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:37.015613    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbb19a91-27ea-4def-b2df-84474ed7459f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fbb19a91-27ea-4def-b2df-84474ed7459f" (UID: "fbb19a91-27ea-4def-b2df-84474ed7459f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 22:12:37.017333 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:37.017314    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbb19a91-27ea-4def-b2df-84474ed7459f-kube-api-access-5jq56" (OuterVolumeSpecName: "kube-api-access-5jq56") pod "fbb19a91-27ea-4def-b2df-84474ed7459f" (UID: "fbb19a91-27ea-4def-b2df-84474ed7459f"). InnerVolumeSpecName "kube-api-access-5jq56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:12:37.017403 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:37.017358    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fbb19a91-27ea-4def-b2df-84474ed7459f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fbb19a91-27ea-4def-b2df-84474ed7459f" (UID: "fbb19a91-27ea-4def-b2df-84474ed7459f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:12:37.116924 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:37.116899    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fbb19a91-27ea-4def-b2df-84474ed7459f-openshift-service-ca\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:12:37.116924 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:37.116923    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jq56\" (UniqueName: \"kubernetes.io/projected/fbb19a91-27ea-4def-b2df-84474ed7459f-kube-api-access-5jq56\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:12:37.117086 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:37.116933    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fbb19a91-27ea-4def-b2df-84474ed7459f-maas-api-tls\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:12:37.268823 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:37.268784    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"]
Jul 02 22:12:37.272321 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:37.272296    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-6f0ab8-6ff54f46f9-4j667"]
Jul 02 22:12:37.525576 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:37.525504    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbb19a91-27ea-4def-b2df-84474ed7459f" path="/var/lib/kubelet/pods/fbb19a91-27ea-4def-b2df-84474ed7459f/volumes"
Jul 02 22:12:42.226429 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:42.226397    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:42.330939 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:42.330905    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:42.499755 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:42.499673    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:42.716769 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:42.716735    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:43.054496 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:43.054448    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:43.366709 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:43.366677    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:43.586350 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:43.586311    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:46.746118 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:46.746084    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:46.815248 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:46.815217    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"]
Jul 02 22:12:46.815667 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:46.815638    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86941834-7af0-44db-a49c-e80c0ee2a694" containerName="maas-api"
Jul 02 22:12:46.815667 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:46.815666    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="86941834-7af0-44db-a49c-e80c0ee2a694" containerName="maas-api"
Jul 02 22:12:46.815828 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:46.815680    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbb19a91-27ea-4def-b2df-84474ed7459f" containerName="maas-api"
Jul 02 22:12:46.815828 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:46.815687    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbb19a91-27ea-4def-b2df-84474ed7459f" containerName="maas-api"
Jul 02 22:12:46.815828 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:46.815768    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbb19a91-27ea-4def-b2df-84474ed7459f" containerName="maas-api"
Jul 02 22:12:46.815828 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:46.815783    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="86941834-7af0-44db-a49c-e80c0ee2a694" containerName="maas-api"
Jul 02 22:12:46.818610 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:46.818584    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:46.818843 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:46.818827    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"
Jul 02 22:12:46.821918 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:46.821897    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-77374e-serving-cert\""
Jul 02 22:12:46.830478 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:46.830456    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"]
Jul 02 22:12:46.893822 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:46.893787    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:46.905827 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:46.905805    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm\" (UID: \"c4a5f02d-505a-4f34-89e6-a5c533e50c4d\") " pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"
Jul 02 22:12:46.905919 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:46.905856    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-maas-api-tls\") pod \"maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm\" (UID: \"c4a5f02d-505a-4f34-89e6-a5c533e50c4d\") " pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"
Jul 02 22:12:46.905962 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:46.905914    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnmkp\" (UniqueName: \"kubernetes.io/projected/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-kube-api-access-tnmkp\") pod \"maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm\" (UID: \"c4a5f02d-505a-4f34-89e6-a5c533e50c4d\") " pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"
Jul 02 22:12:46.996817 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:46.996733    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:47.006849 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:47.006820    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm\" (UID: \"c4a5f02d-505a-4f34-89e6-a5c533e50c4d\") " pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"
Jul 02 22:12:47.006990 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:47.006883    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-maas-api-tls\") pod \"maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm\" (UID: \"c4a5f02d-505a-4f34-89e6-a5c533e50c4d\") " pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"
Jul 02 22:12:47.006990 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:47.006903    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnmkp\" (UniqueName: \"kubernetes.io/projected/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-kube-api-access-tnmkp\") pod \"maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm\" (UID: \"c4a5f02d-505a-4f34-89e6-a5c533e50c4d\") " pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"
Jul 02 22:12:47.007518 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:47.007492    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm\" (UID: \"c4a5f02d-505a-4f34-89e6-a5c533e50c4d\") " pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"
Jul 02 22:12:47.009318 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:47.009297    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-maas-api-tls\") pod \"maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm\" (UID: \"c4a5f02d-505a-4f34-89e6-a5c533e50c4d\") " pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"
Jul 02 22:12:47.018985 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:47.018965    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnmkp\" (UniqueName: \"kubernetes.io/projected/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-kube-api-access-tnmkp\") pod \"maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm\" (UID: \"c4a5f02d-505a-4f34-89e6-a5c533e50c4d\") " pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"
Jul 02 22:12:47.129086 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:47.129058    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"
Jul 02 22:12:47.274584 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:47.274555    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"]
Jul 02 22:12:47.277163 ip-10-0-139-110 kubenswrapper[2575]: W0702 22:12:47.277129    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4a5f02d_505a_4f34_89e6_a5c533e50c4d.slice/crio-6e3e6266ffe50bf4f4298324fd186de9b9d944364510e9931f6b914d039b6d41 WatchSource:0}: Error finding container 6e3e6266ffe50bf4f4298324fd186de9b9d944364510e9931f6b914d039b6d41: Status 404 returned error can't find the container with id 6e3e6266ffe50bf4f4298324fd186de9b9d944364510e9931f6b914d039b6d41
Jul 02 22:12:47.422430 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:47.422395    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:47.523788 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:47.523754    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:47.999825 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:47.999792    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm" event={"ID":"c4a5f02d-505a-4f34-89e6-a5c533e50c4d","Type":"ContainerStarted","Data":"f3d4be593d3cc03fd71f7b17e8db3977daf3d2b77690deff7e1a7023d3251f5a"}
Jul 02 22:12:48.000195 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:47.999848    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm" event={"ID":"c4a5f02d-505a-4f34-89e6-a5c533e50c4d","Type":"ContainerStarted","Data":"6e3e6266ffe50bf4f4298324fd186de9b9d944364510e9931f6b914d039b6d41"}
Jul 02 22:12:48.000195 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:47.999921    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"
Jul 02 22:12:48.020120 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:48.019997    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm" podStartSLOduration=1.541625411 podStartE2EDuration="2.019978247s" totalImagesPullingTime="478.352836ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:12:48.018145821 +0000 UTC m=+2501.055625131" watchObservedRunningTime="2026-07-02 22:12:48.019978247 +0000 UTC m=+2501.057457557"
Jul 02 22:12:51.221532 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:51.221499    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:51.543517 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:51.543423    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:51.897660 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:51.897552    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:52.136355 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:52.136317    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:54.010165 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:54.010134    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"
Jul 02 22:12:54.783677 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:54.783639    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:54.882257 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:54.882210    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:55.040324 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:55.040250    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"]
Jul 02 22:12:55.044255 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:55.044235    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"
Jul 02 22:12:55.046585 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:55.046565    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-a51408-serving-cert\""
Jul 02 22:12:55.052035 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:55.051954    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"]
Jul 02 22:12:55.099148 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:55.099117    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:55.180069 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:55.180041    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/084d4955-e251-4748-a205-59fba22e9167-maas-api-tls\") pod \"maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r\" (UID: \"084d4955-e251-4748-a205-59fba22e9167\") " pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"
Jul 02 22:12:55.180236 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:55.180088    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlnt9\" (UniqueName: \"kubernetes.io/projected/084d4955-e251-4748-a205-59fba22e9167-kube-api-access-nlnt9\") pod \"maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r\" (UID: \"084d4955-e251-4748-a205-59fba22e9167\") " pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"
Jul 02 22:12:55.180236 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:55.180155    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/084d4955-e251-4748-a205-59fba22e9167-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r\" (UID: \"084d4955-e251-4748-a205-59fba22e9167\") " pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"
Jul 02 22:12:55.281266 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:55.281237    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/084d4955-e251-4748-a205-59fba22e9167-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r\" (UID: \"084d4955-e251-4748-a205-59fba22e9167\") " pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"
Jul 02 22:12:55.281444 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:55.281340    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/084d4955-e251-4748-a205-59fba22e9167-maas-api-tls\") pod \"maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r\" (UID: \"084d4955-e251-4748-a205-59fba22e9167\") " pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"
Jul 02 22:12:55.281444 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:55.281371    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlnt9\" (UniqueName: \"kubernetes.io/projected/084d4955-e251-4748-a205-59fba22e9167-kube-api-access-nlnt9\") pod \"maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r\" (UID: \"084d4955-e251-4748-a205-59fba22e9167\") " pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"
Jul 02 22:12:55.281559 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:12:55.281487    2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-a51408-serving-cert: secret "maas-api-e2e-shared-b-a51408-serving-cert" not found
Jul 02 22:12:55.281619 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:12:55.281561    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084d4955-e251-4748-a205-59fba22e9167-maas-api-tls podName:084d4955-e251-4748-a205-59fba22e9167 nodeName:}" failed. No retries permitted until 2026-07-02 22:12:55.781541847 +0000 UTC m=+2508.819021148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/084d4955-e251-4748-a205-59fba22e9167-maas-api-tls") pod "maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r" (UID: "084d4955-e251-4748-a205-59fba22e9167") : secret "maas-api-e2e-shared-b-a51408-serving-cert" not found
Jul 02 22:12:55.281893 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:55.281875    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/084d4955-e251-4748-a205-59fba22e9167-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r\" (UID: \"084d4955-e251-4748-a205-59fba22e9167\") " pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"
Jul 02 22:12:55.290021 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:55.289991    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlnt9\" (UniqueName: \"kubernetes.io/projected/084d4955-e251-4748-a205-59fba22e9167-kube-api-access-nlnt9\") pod \"maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r\" (UID: \"084d4955-e251-4748-a205-59fba22e9167\") " pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"
Jul 02 22:12:55.556352 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:55.556317    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:55.657142 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:55.657107    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:55.785698 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:55.785661    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/084d4955-e251-4748-a205-59fba22e9167-maas-api-tls\") pod \"maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r\" (UID: \"084d4955-e251-4748-a205-59fba22e9167\") " pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"
Jul 02 22:12:55.785862 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:12:55.785833    2575 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-a51408-serving-cert: secret "maas-api-e2e-shared-b-a51408-serving-cert" not found
Jul 02 22:12:55.785931 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:12:55.785920    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084d4955-e251-4748-a205-59fba22e9167-maas-api-tls podName:084d4955-e251-4748-a205-59fba22e9167 nodeName:}" failed. No retries permitted until 2026-07-02 22:12:56.785901166 +0000 UTC m=+2509.823380458 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/084d4955-e251-4748-a205-59fba22e9167-maas-api-tls") pod "maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r" (UID: "084d4955-e251-4748-a205-59fba22e9167") : secret "maas-api-e2e-shared-b-a51408-serving-cert" not found
Jul 02 22:12:56.580985 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:56.580948    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:12:56.793632 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:56.793605    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/084d4955-e251-4748-a205-59fba22e9167-maas-api-tls\") pod \"maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r\" (UID: \"084d4955-e251-4748-a205-59fba22e9167\") " pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"
Jul 02 22:12:56.795830 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:56.795804    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/084d4955-e251-4748-a205-59fba22e9167-maas-api-tls\") pod \"maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r\" (UID: \"084d4955-e251-4748-a205-59fba22e9167\") " pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"
Jul 02 22:12:56.857283 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:56.857261    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"
Jul 02 22:12:56.987919 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:56.987893    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"]
Jul 02 22:12:56.989466 ip-10-0-139-110 kubenswrapper[2575]: W0702 22:12:56.989438    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod084d4955_e251_4748_a205_59fba22e9167.slice/crio-42d0d849adae80c18a2ab7aaea3941d4ef0904cf6e0da8517afaf39e86a3aab5 WatchSource:0}: Error finding container 42d0d849adae80c18a2ab7aaea3941d4ef0904cf6e0da8517afaf39e86a3aab5: Status 404 returned error can't find the container with id 42d0d849adae80c18a2ab7aaea3941d4ef0904cf6e0da8517afaf39e86a3aab5
Jul 02 22:12:57.044458 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:57.044432    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r" event={"ID":"084d4955-e251-4748-a205-59fba22e9167","Type":"ContainerStarted","Data":"42d0d849adae80c18a2ab7aaea3941d4ef0904cf6e0da8517afaf39e86a3aab5"}
Jul 02 22:12:58.049690 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:58.049651    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r" event={"ID":"084d4955-e251-4748-a205-59fba22e9167","Type":"ContainerStarted","Data":"60d1922b703c04e24ecbd2c9615bb47e26b29b9b9474c97ff19e2e6e98590591"}
Jul 02 22:12:58.050133 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:58.049723    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"
Jul 02 22:12:58.067377 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:58.067329    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r" podStartSLOduration=2.775569808 podStartE2EDuration="3.067315139s" totalImagesPullingTime="291.745331ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 22:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:12:58.064988085 +0000 UTC m=+2511.102467422" watchObservedRunningTime="2026-07-02 22:12:58.067315139 +0000 UTC m=+2511.104794459"
Jul 02 22:12:59.277048 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:12:59.276932    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:13:04.061813 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:13:04.061782    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"
Jul 02 22:13:08.133329 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:13:08.133297    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:13:08.231436 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:13:08.231391    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:13:12.671248 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:13:12.671211    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:13:16.247767 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:13:16.247727    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:13:16.348215 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:13:16.348184    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:13:37.241557 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:13:37.241521    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:13:50.904576 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:13:50.904544    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:15:31.017350 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:15:31.017319    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:15:31.106830 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:15:31.106798    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:15:35.328494 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:15:35.328450    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:15:36.153268 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:15:36.153229    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:15:40.347747 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:15:40.347717    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:16:14.681837 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:16:14.681750    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:16:20.675716 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:16:20.675673    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:16:20.776746 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:16:20.776712    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:16:58.093354 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:16:58.093318    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:16:58.951123 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:16:58.951087    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:17:23.619396 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:17:23.619362    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:17:23.720838 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:17:23.720804    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:17:28.560860 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:17:28.560817    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:17:54.658970 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:17:54.658938    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:18:08.872224 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:08.872190    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:18:08.972174 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:08.972140    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:18:17.066065 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:17.066032    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:18:17.168307 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:17.168270    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:18:33.630296 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:33.630269    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:18:34.466946 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:34.466911    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:18:35.500963 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:35.500925    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:18:35.870065 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:35.870023    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:18:35.978892 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:35.978858    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:18:36.081710 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.081677    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:18:36.185028 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.184554    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"]
Jul 02 22:18:36.185028 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.184787    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm" podUID="c4a5f02d-505a-4f34-89e6-a5c533e50c4d" containerName="maas-api" containerID="cri-o://f3d4be593d3cc03fd71f7b17e8db3977daf3d2b77690deff7e1a7023d3251f5a" gracePeriod=30
Jul 02 22:18:36.215691 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.215655    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:18:36.437325 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.437269    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"
Jul 02 22:18:36.583229 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.583203    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-openshift-service-ca\") pod \"c4a5f02d-505a-4f34-89e6-a5c533e50c4d\" (UID: \"c4a5f02d-505a-4f34-89e6-a5c533e50c4d\") "
Jul 02 22:18:36.583662 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.583285    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-maas-api-tls\") pod \"c4a5f02d-505a-4f34-89e6-a5c533e50c4d\" (UID: \"c4a5f02d-505a-4f34-89e6-a5c533e50c4d\") "
Jul 02 22:18:36.583662 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.583323    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnmkp\" (UniqueName: \"kubernetes.io/projected/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-kube-api-access-tnmkp\") pod \"c4a5f02d-505a-4f34-89e6-a5c533e50c4d\" (UID: \"c4a5f02d-505a-4f34-89e6-a5c533e50c4d\") "
Jul 02 22:18:36.583662 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.583597    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c4a5f02d-505a-4f34-89e6-a5c533e50c4d" (UID: "c4a5f02d-505a-4f34-89e6-a5c533e50c4d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 22:18:36.585291 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.585262    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c4a5f02d-505a-4f34-89e6-a5c533e50c4d" (UID: "c4a5f02d-505a-4f34-89e6-a5c533e50c4d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:18:36.585409 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.585387    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-kube-api-access-tnmkp" (OuterVolumeSpecName: "kube-api-access-tnmkp") pod "c4a5f02d-505a-4f34-89e6-a5c533e50c4d" (UID: "c4a5f02d-505a-4f34-89e6-a5c533e50c4d"). InnerVolumeSpecName "kube-api-access-tnmkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:18:36.605430 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.605403    2575 generic.go:356] "Generic (PLEG): container finished" podID="c4a5f02d-505a-4f34-89e6-a5c533e50c4d" containerID="f3d4be593d3cc03fd71f7b17e8db3977daf3d2b77690deff7e1a7023d3251f5a" exitCode=0
Jul 02 22:18:36.605558 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.605452    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"
Jul 02 22:18:36.605558 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.605483    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm" event={"ID":"c4a5f02d-505a-4f34-89e6-a5c533e50c4d","Type":"ContainerDied","Data":"f3d4be593d3cc03fd71f7b17e8db3977daf3d2b77690deff7e1a7023d3251f5a"}
Jul 02 22:18:36.605558 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.605534    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm" event={"ID":"c4a5f02d-505a-4f34-89e6-a5c533e50c4d","Type":"ContainerDied","Data":"6e3e6266ffe50bf4f4298324fd186de9b9d944364510e9931f6b914d039b6d41"}
Jul 02 22:18:36.605558 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.605556    2575 scope.go:117] "RemoveContainer" containerID="f3d4be593d3cc03fd71f7b17e8db3977daf3d2b77690deff7e1a7023d3251f5a"
Jul 02 22:18:36.614473 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.614458    2575 scope.go:117] "RemoveContainer" containerID="f3d4be593d3cc03fd71f7b17e8db3977daf3d2b77690deff7e1a7023d3251f5a"
Jul 02 22:18:36.614752 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:18:36.614731    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3d4be593d3cc03fd71f7b17e8db3977daf3d2b77690deff7e1a7023d3251f5a\": container with ID starting with f3d4be593d3cc03fd71f7b17e8db3977daf3d2b77690deff7e1a7023d3251f5a not found: ID does not exist" containerID="f3d4be593d3cc03fd71f7b17e8db3977daf3d2b77690deff7e1a7023d3251f5a"
Jul 02 22:18:36.614801 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.614761    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3d4be593d3cc03fd71f7b17e8db3977daf3d2b77690deff7e1a7023d3251f5a"} err="failed to get container status \"f3d4be593d3cc03fd71f7b17e8db3977daf3d2b77690deff7e1a7023d3251f5a\": rpc error: code = NotFound desc = could not find container \"f3d4be593d3cc03fd71f7b17e8db3977daf3d2b77690deff7e1a7023d3251f5a\": container with ID starting with f3d4be593d3cc03fd71f7b17e8db3977daf3d2b77690deff7e1a7023d3251f5a not found: ID does not exist"
Jul 02 22:18:36.627630 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.627598    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"]
Jul 02 22:18:36.632109 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.632088    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-77374e-6cd75975d9-swgfm"]
Jul 02 22:18:36.684123 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.684103    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-openshift-service-ca\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:18:36.684123 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.684124    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-maas-api-tls\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:18:36.684289 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:36.684133    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnmkp\" (UniqueName: \"kubernetes.io/projected/c4a5f02d-505a-4f34-89e6-a5c533e50c4d-kube-api-access-tnmkp\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:18:37.525143 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:37.525112    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4a5f02d-505a-4f34-89e6-a5c533e50c4d" path="/var/lib/kubelet/pods/c4a5f02d-505a-4f34-89e6-a5c533e50c4d/volumes"
Jul 02 22:18:40.947523 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:18:40.947478    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:19:04.809879 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:04.809793    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:19:17.704458 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:17.704427    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:19:17.968789 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:17.968712    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:19:18.191975 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:18.191940    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:19:18.371059 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:18.371029    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:19:18.771873 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:18.771776    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:19:18.875536 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:18.875506    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:19:18.989894 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:18.989863    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"]
Jul 02 22:19:18.990125 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:18.990094    2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r" podUID="084d4955-e251-4748-a205-59fba22e9167" containerName="maas-api" containerID="cri-o://60d1922b703c04e24ecbd2c9615bb47e26b29b9b9474c97ff19e2e6e98590591" gracePeriod=30
Jul 02 22:19:19.015315 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.015292    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:19:19.056593 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.056533    2575 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r" podUID="084d4955-e251-4748-a205-59fba22e9167" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.41:8443/health\": dial tcp 10.133.0.41:8443: connect: connection refused"
Jul 02 22:19:19.242333 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.242308    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"
Jul 02 22:19:19.356253 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.356230    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlnt9\" (UniqueName: \"kubernetes.io/projected/084d4955-e251-4748-a205-59fba22e9167-kube-api-access-nlnt9\") pod \"084d4955-e251-4748-a205-59fba22e9167\" (UID: \"084d4955-e251-4748-a205-59fba22e9167\") "
Jul 02 22:19:19.356406 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.356279    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/084d4955-e251-4748-a205-59fba22e9167-maas-api-tls\") pod \"084d4955-e251-4748-a205-59fba22e9167\" (UID: \"084d4955-e251-4748-a205-59fba22e9167\") "
Jul 02 22:19:19.356406 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.356307    2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/084d4955-e251-4748-a205-59fba22e9167-openshift-service-ca\") pod \"084d4955-e251-4748-a205-59fba22e9167\" (UID: \"084d4955-e251-4748-a205-59fba22e9167\") "
Jul 02 22:19:19.356732 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.356708    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/084d4955-e251-4748-a205-59fba22e9167-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "084d4955-e251-4748-a205-59fba22e9167" (UID: "084d4955-e251-4748-a205-59fba22e9167"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 22:19:19.358296 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.358269    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/084d4955-e251-4748-a205-59fba22e9167-kube-api-access-nlnt9" (OuterVolumeSpecName: "kube-api-access-nlnt9") pod "084d4955-e251-4748-a205-59fba22e9167" (UID: "084d4955-e251-4748-a205-59fba22e9167"). InnerVolumeSpecName "kube-api-access-nlnt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 22:19:19.358372 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.358307    2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/084d4955-e251-4748-a205-59fba22e9167-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "084d4955-e251-4748-a205-59fba22e9167" (UID: "084d4955-e251-4748-a205-59fba22e9167"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 22:19:19.457563 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.457535    2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlnt9\" (UniqueName: \"kubernetes.io/projected/084d4955-e251-4748-a205-59fba22e9167-kube-api-access-nlnt9\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:19:19.457563 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.457561    2575 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/084d4955-e251-4748-a205-59fba22e9167-maas-api-tls\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:19:19.457713 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.457570    2575 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/084d4955-e251-4748-a205-59fba22e9167-openshift-service-ca\") on node \"ip-10-0-139-110.ec2.internal\" DevicePath \"\""
Jul 02 22:19:19.801945 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.801853    2575 generic.go:356] "Generic (PLEG): container finished" podID="084d4955-e251-4748-a205-59fba22e9167" containerID="60d1922b703c04e24ecbd2c9615bb47e26b29b9b9474c97ff19e2e6e98590591" exitCode=0
Jul 02 22:19:19.801945 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.801908    2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"
Jul 02 22:19:19.802459 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.801942    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r" event={"ID":"084d4955-e251-4748-a205-59fba22e9167","Type":"ContainerDied","Data":"60d1922b703c04e24ecbd2c9615bb47e26b29b9b9474c97ff19e2e6e98590591"}
Jul 02 22:19:19.802459 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.802039    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r" event={"ID":"084d4955-e251-4748-a205-59fba22e9167","Type":"ContainerDied","Data":"42d0d849adae80c18a2ab7aaea3941d4ef0904cf6e0da8517afaf39e86a3aab5"}
Jul 02 22:19:19.802459 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.802064    2575 scope.go:117] "RemoveContainer" containerID="60d1922b703c04e24ecbd2c9615bb47e26b29b9b9474c97ff19e2e6e98590591"
Jul 02 22:19:19.810407 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.810389    2575 scope.go:117] "RemoveContainer" containerID="60d1922b703c04e24ecbd2c9615bb47e26b29b9b9474c97ff19e2e6e98590591"
Jul 02 22:19:19.810649 ip-10-0-139-110 kubenswrapper[2575]: E0702 22:19:19.810629    2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60d1922b703c04e24ecbd2c9615bb47e26b29b9b9474c97ff19e2e6e98590591\": container with ID starting with 60d1922b703c04e24ecbd2c9615bb47e26b29b9b9474c97ff19e2e6e98590591 not found: ID does not exist" containerID="60d1922b703c04e24ecbd2c9615bb47e26b29b9b9474c97ff19e2e6e98590591"
Jul 02 22:19:19.810714 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.810659    2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60d1922b703c04e24ecbd2c9615bb47e26b29b9b9474c97ff19e2e6e98590591"} err="failed to get container status \"60d1922b703c04e24ecbd2c9615bb47e26b29b9b9474c97ff19e2e6e98590591\": rpc error: code = NotFound desc = could not find container \"60d1922b703c04e24ecbd2c9615bb47e26b29b9b9474c97ff19e2e6e98590591\": container with ID starting with 60d1922b703c04e24ecbd2c9615bb47e26b29b9b9474c97ff19e2e6e98590591 not found: ID does not exist"
Jul 02 22:19:19.821268 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.821244    2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"]
Jul 02 22:19:19.828430 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:19.828407    2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-a51408-7dcfbb5fb8-4jt2r"]
Jul 02 22:19:21.524987 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:21.524958    2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="084d4955-e251-4748-a205-59fba22e9167" path="/var/lib/kubelet/pods/084d4955-e251-4748-a205-59fba22e9167/volumes"
Jul 02 22:19:24.716273 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:24.716240    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:19:24.817451 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:24.817415    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:19:25.048728 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:25.048627    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:19:25.217379 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:25.217328    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:19:30.450302 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:30.450265    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-789554f86d-pct74_af49ec9e-5422-405b-a4e0-2ef80d793939/maas-api/0.log"
Jul 02 22:19:31.386907 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:31.386879    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c4697655-snvmv_86d57bf6-71e6-41d2-bfa9-3690f0ed4277/copy-manifests/0.log"
Jul 02 22:19:31.393748 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:31.393714    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c4697655-snvmv_86d57bf6-71e6-41d2-bfa9-3690f0ed4277/manager/0.log"
Jul 02 22:19:33.367922 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:33.367881    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dhfkm_a1c5c10f-b8e4-4433-8b6e-116ca2e2cdd6/manager/0.log"
Jul 02 22:19:34.079397 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:34.079363    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-j7hhc_d766c99e-1d37-43f1-93ac-ac7dd597e106/discovery/0.log"
Jul 02 22:19:35.254124 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:35.254096    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-pmfht_adf7985b-2c93-4661-8a86-880d3a51be4e/main/0.log"
Jul 02 22:19:35.371967 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:35.371940    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-sp6l4_054f3c37-e658-4840-9cde-da8cedda43ca/main/0.log"
Jul 02 22:19:40.146067 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:40.146033    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:19:40.244342 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:40.244304    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:19:42.963626 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:42.963599    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rc2fm_6f667a42-f21d-49d0-8e40-4828f12e36db/global-pull-secret-syncer/0.log"
Jul 02 22:19:43.017398 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:43.017368    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log"
Jul 02 22:19:43.171751 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:43.171723    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-110.ec2.internal_e8b1f7912e9b285e8ec484595c325fef/haproxy/0.log"
Jul 02 22:19:48.260682 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:48.260646    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dhfkm_a1c5c10f-b8e4-4433-8b6e-116ca2e2cdd6/manager/0.log"
Jul 02 22:19:49.914176 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:49.914144    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45f7eea0-cf70-4d1d-b89a-875b1f14583e/alertmanager/0.log"
Jul 02 22:19:49.935787 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:49.935762    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45f7eea0-cf70-4d1d-b89a-875b1f14583e/config-reloader/0.log"
Jul 02 22:19:49.955676 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:49.955653    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45f7eea0-cf70-4d1d-b89a-875b1f14583e/kube-rbac-proxy-web/0.log"
Jul 02 22:19:49.977157 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:49.977136    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45f7eea0-cf70-4d1d-b89a-875b1f14583e/kube-rbac-proxy/0.log"
Jul 02 22:19:49.999309 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:49.999290    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45f7eea0-cf70-4d1d-b89a-875b1f14583e/kube-rbac-proxy-metric/0.log"
Jul 02 22:19:50.026639 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:50.026615    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45f7eea0-cf70-4d1d-b89a-875b1f14583e/prom-label-proxy/0.log"
Jul 02 22:19:50.046593 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:50.046573    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_45f7eea0-cf70-4d1d-b89a-875b1f14583e/init-config-reloader/0.log"
Jul 02 22:19:50.218516 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:50.218490    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5867c5989b-kd45z_0d04206a-a21a-4340-a523-b57ffafedcb2/metrics-server/0.log"
Jul 02 22:19:50.279349 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:50.279328    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2jlrp_77c26077-8bce-47b7-9093-4f02dd2140c6/node-exporter/0.log"
Jul 02 22:19:50.302388 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:50.302362    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2jlrp_77c26077-8bce-47b7-9093-4f02dd2140c6/kube-rbac-proxy/0.log"
Jul 02 22:19:50.335290 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:50.335268    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2jlrp_77c26077-8bce-47b7-9093-4f02dd2140c6/init-textfile/0.log"
Jul 02 22:19:50.652808 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:50.652766    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_add7f5b8-2492-493c-b6bb-c052c594dc74/prometheus/0.log"
Jul 02 22:19:50.673594 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:50.673566    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_add7f5b8-2492-493c-b6bb-c052c594dc74/config-reloader/0.log"
Jul 02 22:19:50.697954 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:50.697926    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_add7f5b8-2492-493c-b6bb-c052c594dc74/thanos-sidecar/0.log"
Jul 02 22:19:50.722820 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:50.722793    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_add7f5b8-2492-493c-b6bb-c052c594dc74/kube-rbac-proxy-web/0.log"
Jul 02 22:19:50.744625 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:50.744603    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_add7f5b8-2492-493c-b6bb-c052c594dc74/kube-rbac-proxy/0.log"
Jul 02 22:19:50.766495 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:50.766471    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_add7f5b8-2492-493c-b6bb-c052c594dc74/kube-rbac-proxy-thanos/0.log"
Jul 02 22:19:50.790130 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:50.790111    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_add7f5b8-2492-493c-b6bb-c052c594dc74/init-config-reloader/0.log"
Jul 02 22:19:52.226675 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:52.226635    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:19:52.288474 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:52.288445    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2n62r_50903ab1-7af9-4033-a0c1-42c65587127d/konnectivity-agent/0.log" limit=1024
Jul 02 22:19:53.617501 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.617470    2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"]
Jul 02 22:19:53.617852 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.617798    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4a5f02d-505a-4f34-89e6-a5c533e50c4d" containerName="maas-api"
Jul 02 22:19:53.617852 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.617809    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4a5f02d-505a-4f34-89e6-a5c533e50c4d" containerName="maas-api"
Jul 02 22:19:53.617852 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.617818    2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="084d4955-e251-4748-a205-59fba22e9167" containerName="maas-api"
Jul 02 22:19:53.617852 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.617824    2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="084d4955-e251-4748-a205-59fba22e9167" containerName="maas-api"
Jul 02 22:19:53.618095 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.617874    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4a5f02d-505a-4f34-89e6-a5c533e50c4d" containerName="maas-api"
Jul 02 22:19:53.618095 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.617882    2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="084d4955-e251-4748-a205-59fba22e9167" containerName="maas-api"
Jul 02 22:19:53.620724 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.620702    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:53.623068 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.623048    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-92hjf\"/\"openshift-service-ca.crt\""
Jul 02 22:19:53.623189 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.623173    2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-92hjf\"/\"kube-root-ca.crt\""
Jul 02 22:19:53.624171 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.624153    2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-92hjf\"/\"default-dockercfg-m762d\""
Jul 02 22:19:53.631233 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.631213    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"]
Jul 02 22:19:53.654412 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.654389    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5-lib-modules\") pod \"perf-node-gather-daemonset-r8btc\" (UID: \"e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:53.654513 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.654422    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5-sys\") pod \"perf-node-gather-daemonset-r8btc\" (UID: \"e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:53.654513 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.654438    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5-podres\") pod \"perf-node-gather-daemonset-r8btc\" (UID: \"e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:53.654629 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.654576    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llj6s\" (UniqueName: \"kubernetes.io/projected/e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5-kube-api-access-llj6s\") pod \"perf-node-gather-daemonset-r8btc\" (UID: \"e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:53.654629 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.654615    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5-proc\") pod \"perf-node-gather-daemonset-r8btc\" (UID: \"e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:53.755873 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.755847    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5-lib-modules\") pod \"perf-node-gather-daemonset-r8btc\" (UID: \"e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:53.755983 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.755883    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5-sys\") pod \"perf-node-gather-daemonset-r8btc\" (UID: \"e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:53.755983 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.755907    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5-podres\") pod \"perf-node-gather-daemonset-r8btc\" (UID: \"e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:53.755983 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.755971    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5-sys\") pod \"perf-node-gather-daemonset-r8btc\" (UID: \"e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:53.756213 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.755988    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llj6s\" (UniqueName: \"kubernetes.io/projected/e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5-kube-api-access-llj6s\") pod \"perf-node-gather-daemonset-r8btc\" (UID: \"e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:53.756213 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.756044    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5-proc\") pod \"perf-node-gather-daemonset-r8btc\" (UID: \"e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:53.756213 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.756057    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5-lib-modules\") pod \"perf-node-gather-daemonset-r8btc\" (UID: \"e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:53.756213 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.756109    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5-podres\") pod \"perf-node-gather-daemonset-r8btc\" (UID: \"e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:53.756213 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.756133    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5-proc\") pod \"perf-node-gather-daemonset-r8btc\" (UID: \"e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:53.764365 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.764343    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llj6s\" (UniqueName: \"kubernetes.io/projected/e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5-kube-api-access-llj6s\") pod \"perf-node-gather-daemonset-r8btc\" (UID: \"e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5\") " pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:53.930913 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:53.930836    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:54.058478 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:54.058452    2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"]
Jul 02 22:19:54.060947 ip-10-0-139-110 kubenswrapper[2575]: W0702 22:19:54.060923    2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode6be5f4e_c93a_4b75_9d5c_f48b1662d0e5.slice/crio-1c5f6f6168193a6500d4e19025568ef1d226dbe58ba45ec45698436974195773 WatchSource:0}: Error finding container 1c5f6f6168193a6500d4e19025568ef1d226dbe58ba45ec45698436974195773: Status 404 returned error can't find the container with id 1c5f6f6168193a6500d4e19025568ef1d226dbe58ba45ec45698436974195773
Jul 02 22:19:54.956445 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:54.956412    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc" event={"ID":"e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5","Type":"ContainerStarted","Data":"0e19ec678976ace3bb4196f0575c20a46538030cca1dc9d1cc6c87ac74133114"}
Jul 02 22:19:54.956826 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:54.956465    2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc" event={"ID":"e6be5f4e-c93a-4b75-9d5c-f48b1662d0e5","Type":"ContainerStarted","Data":"1c5f6f6168193a6500d4e19025568ef1d226dbe58ba45ec45698436974195773"}
Jul 02 22:19:54.956826 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:54.956493    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:19:54.972807 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:54.972760    2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc" podStartSLOduration=1.9727465400000002 podStartE2EDuration="1.97274654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 22:19:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 22:19:54.971955966 +0000 UTC m=+2928.009435274" watchObservedRunningTime="2026-07-02 22:19:54.97274654 +0000 UTC m=+2928.010225848"
Jul 02 22:19:55.295069 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:55.294978    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmsc8_4e8eaa68-900f-4a98-8499-111bd1451076/dns/0.log"
Jul 02 22:19:55.314827 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:55.314797    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hmsc8_4e8eaa68-900f-4a98-8499-111bd1451076/kube-rbac-proxy/0.log"
Jul 02 22:19:55.472754 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:55.472722    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tc79l_8a0c06cc-1a9c-4c17-86dd-b6cfad9dbeef/dns-node-resolver/0.log"
Jul 02 22:19:56.004549 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:56.004517    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-79c7886d7b-qks2t_7323c660-49e7-4690-9457-8ff1780fd89e/registry/0.log"
Jul 02 22:19:56.027460 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:56.027433    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-26tvv_55c68fb2-3894-4e91-b536-b47a9ec3900c/node-ca/0.log"
Jul 02 22:19:57.163044 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:57.162994    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-j7hhc_d766c99e-1d37-43f1-93ac-ac7dd597e106/discovery/0.log"
Jul 02 22:19:58.151546 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:58.151509    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hlcjm_b58149aa-a11a-4b62-b8d2-54492d81dda2/serve-healthcheck-canary/0.log"
Jul 02 22:19:58.672000 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:58.671964    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-jmfq6_2105cd7b-38da-4788-8094-fd92efcff9bc/insights-operator/0.log"
Jul 02 22:19:58.672632 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:58.672611    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-jmfq6_2105cd7b-38da-4788-8094-fd92efcff9bc/insights-operator/1.log"
Jul 02 22:19:58.844479 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:58.844451    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zxb2n_0e2efd29-a663-4ef7-88ef-f153628344dd/kube-rbac-proxy/0.log"
Jul 02 22:19:58.865410 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:58.865386    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zxb2n_0e2efd29-a663-4ef7-88ef-f153628344dd/exporter/0.log"
Jul 02 22:19:58.886047 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:19:58.886022    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zxb2n_0e2efd29-a663-4ef7-88ef-f153628344dd/extractor/0.log"
Jul 02 22:20:00.971930 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:00.971904    2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-92hjf/perf-node-gather-daemonset-r8btc"
Jul 02 22:20:01.351824 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:01.351795    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-789554f86d-pct74_af49ec9e-5422-405b-a4e0-2ef80d793939/maas-api/0.log"
Jul 02 22:20:01.933666 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:01.933619    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c4697655-snvmv_86d57bf6-71e6-41d2-bfa9-3690f0ed4277/manager/0.log"
Jul 02 22:20:01.956676 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:01.956651    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c4697655-snvmv_86d57bf6-71e6-41d2-bfa9-3690f0ed4277/copy-manifests/0.log"
Jul 02 22:20:03.507534 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:03.507458    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-bb99d9bb4-2qsnn_55c95344-82d4-4a57-8d16-626635c0abe9/manager/0.log"
Jul 02 22:20:03.847813 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:03.847720    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-j7hhc_d766c99e-1d37-43f1-93ac-ac7dd597e106/discovery/0.log"
Jul 02 22:20:05.513609 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:05.513527    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-j7hhc_d766c99e-1d37-43f1-93ac-ac7dd597e106/discovery/0.log"
Jul 02 22:20:08.650866 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:08.650839    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-q7z9m_3c8b1429-a4ab-48db-8be6-42f82333abfc/migrator/0.log"
Jul 02 22:20:08.670697 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:08.670654    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-q7z9m_3c8b1429-a4ab-48db-8be6-42f82333abfc/graceful-termination/0.log"
Jul 02 22:20:09.021380 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:09.021276    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-x7dqn_008eabf7-ce57-4467-8eb0-dd94a34f2147/kube-storage-version-migrator-operator/1.log"
Jul 02 22:20:09.023200 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:09.023150    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-x7dqn_008eabf7-ce57-4467-8eb0-dd94a34f2147/kube-storage-version-migrator-operator/0.log"
Jul 02 22:20:10.167694 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:10.167664    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9cb65_c022474e-db77-4cf8-940c-07c74e1568d2/kube-multus-additional-cni-plugins/0.log"
Jul 02 22:20:10.188488 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:10.188468    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9cb65_c022474e-db77-4cf8-940c-07c74e1568d2/egress-router-binary-copy/0.log"
Jul 02 22:20:10.208702 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:10.208683    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9cb65_c022474e-db77-4cf8-940c-07c74e1568d2/cni-plugins/0.log"
Jul 02 22:20:10.227799 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:10.227781    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9cb65_c022474e-db77-4cf8-940c-07c74e1568d2/bond-cni-plugin/0.log"
Jul 02 22:20:10.246990 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:10.246957    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9cb65_c022474e-db77-4cf8-940c-07c74e1568d2/routeoverride-cni/0.log"
Jul 02 22:20:10.265078 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:10.265050    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9cb65_c022474e-db77-4cf8-940c-07c74e1568d2/whereabouts-cni-bincopy/0.log"
Jul 02 22:20:10.285128 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:10.285111    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9cb65_c022474e-db77-4cf8-940c-07c74e1568d2/whereabouts-cni/0.log"
Jul 02 22:20:10.468589 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:10.468519    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-httz2_1168801f-a056-4f31-93d4-e2d3750c0035/kube-multus/0.log"
Jul 02 22:20:10.649069 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:10.649036    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d8wzk_ad9a4f7b-552f-469a-be1b-7ab6b4bd3740/network-metrics-daemon/0.log"
Jul 02 22:20:10.665913 ip-10-0-139-110 kubenswrapper[2575]: I0702 22:20:10.665888    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-d8wzk_ad9a4f7b-552f-469a-be1b-7ab6b4bd3740/kube-rbac-proxy/0.log"