Jul 02 23:07:15.898947 ip-10-0-141-220 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 23:07:16.288922 ip-10-0-141-220 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:07:16.288922 ip-10-0-141-220 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 23:07:16.288922 ip-10-0-141-220 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:07:16.288922 ip-10-0-141-220 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 23:07:16.288922 ip-10-0-141-220 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 23:07:16.289725 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.288943    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 23:07:16.293517 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293495    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:07:16.293517 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293515    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:07:16.293517 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293520    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:07:16.293517 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293524    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293529    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293533    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293537    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293541    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293545    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293548    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293553    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293556    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293560    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293563    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293584    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293587    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293591    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293594    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293598    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293602    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293605    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293609    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293612    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:07:16.293787 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293621    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293625    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293629    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293633    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293637    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293641    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293644    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293649    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293653    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293657    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293661    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293666    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293670    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293674    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293679    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293683    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293688    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293692    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293696    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293700    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:07:16.294595 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293704    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293708    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293717    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293722    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293729    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293735    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293740    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293745    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293749    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293755    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293759    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293764    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293768    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293772    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293776    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293781    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293785    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293789    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:07:16.295417 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293793    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293797    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293801    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293806    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293810    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293816    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293820    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293826    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293831    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293835    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293839    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293843    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293847    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293851    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293856    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293860    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293864    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293871    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293877    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293881    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:07:16.296233 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293885    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293890    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293894    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293898    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293902    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293906    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293910    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293914    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293919    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293923    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293926    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293931    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293935    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293940    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293944    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293948    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293953    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.293957    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295132    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295142    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:07:16.297113 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295147    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295151    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295155    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295159    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295163    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295168    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295172    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295176    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295180    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295184    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295188    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295194    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295198    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295205    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295211    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295216    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295220    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295227    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295233    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:07:16.297976 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295237    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295242    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295246    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295251    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295255    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295260    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295265    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295270    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295274    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295279    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295284    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295289    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295296    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295300    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295305    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295310    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295314    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295318    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295323    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:07:16.298630 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295327    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295331    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295335    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295340    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295344    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295348    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295353    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295357    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295362    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295366    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295370    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295374    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295378    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295382    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295386    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295392    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295397    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295402    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295406    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:07:16.299178 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295411    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295415    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295419    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295423    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295427    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295431    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295435    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295441    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295445    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295450    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295454    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295459    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295463    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295467    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295474    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295478    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295482    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295486    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295490    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295494    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:07:16.299859 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295499    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295504    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295508    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295512    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295516    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295520    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295524    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295528    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295532    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295537    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295541    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295546    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295550    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295554    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295558    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295562    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295587    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295591    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295596    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.295600    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:07:16.300377 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296197    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296206    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296211    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296215    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296219    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296223    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296228    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296232    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296236    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296240    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296244    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296248    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296253    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296257    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296261    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296265    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296270    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296274    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296278    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:07:16.300984 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296285    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296291    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296296    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296302    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296308    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296313    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296317    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296322    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296327    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296331    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296336    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296339    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296344    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296348    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296352    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296356    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296360    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296364    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296369    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:07:16.301453 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296373    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296377    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296381    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296385    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296389    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296393    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296398    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296403    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296407    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296411    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296415    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296420    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296424    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296428    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296432    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296436    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296440    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296444    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296449    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:07:16.301951 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296453    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296457    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296461    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296465    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296469    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296473    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296478    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296482    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296489    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296494    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296499    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296504    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296508    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296512    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296517    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296520    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296524    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296529    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296533    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296537    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:07:16.302458 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296541    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296546    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296550    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296554    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296558    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296562    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296585    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296590    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296594    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296598    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296602    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296606    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296613    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296617    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296620    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296625    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296629    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296633    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296641    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296645    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:07:16.302975 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296650    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.296654    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296768    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296780    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296790    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296797    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296803    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296808    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296814    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296821    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296827    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296832    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296837    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296843    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296848    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296853    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296858    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296863    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296867    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296872    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296878    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296882    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296887    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296892    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 23:07:16.303452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296897    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296903    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296908    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296912    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296918    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296923    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296930    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296935    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296940    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296945    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296951    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296956    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296961    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296965    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296970    2581 flags.go:64] FLAG: --enable-server="true"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296974    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296982    2581 flags.go:64] FLAG: --event-burst="100"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296987    2581 flags.go:64] FLAG: --event-qps="50"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296991    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.296996    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297000    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297007    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297011    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297019    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297024    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 02 23:07:16.304118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297028    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297033    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297037    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297042    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297046    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297051    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297056    2581 flags.go:64] FLAG: --feature-gates=""
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297064    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297068    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297073    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297078    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297083    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297088    2581 flags.go:64] FLAG: --help="false"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297094    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-141-220.ec2.internal"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297099    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297104    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297109    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297114    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297119    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297123    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297128    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297132    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297136    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 23:07:16.304746 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297141    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297146    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297151    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297155    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297160    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297165    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297169    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297173    2581 flags.go:64] FLAG: --lock-file=""
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297178    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297183    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297188    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297197    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297201    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297206    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297210    2581 flags.go:64] FLAG: --logging-format="text"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297215    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297222    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297227    2581 flags.go:64] FLAG: --manifest-url=""
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297232    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297239    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297244    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297251    2581 flags.go:64] FLAG: --max-pods="110"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297255    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297260    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297264    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 23:07:16.305328 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297270    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297274    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297279    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297284    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297295    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297300    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297305    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297310    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297314    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297323    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297328    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297333    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297337    2581 flags.go:64] FLAG: --port="10250"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297342    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297347    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f40ec2c99e18e7ae"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297353    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297358    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297363    2581 flags.go:64] FLAG: --register-node="true"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297368    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297373    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297378    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297382    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297386    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297392    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297400    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 23:07:16.305984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297405    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297411    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297416    2581 flags.go:64] FLAG: --runonce="false"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297420    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297425    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297431    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297435    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297440    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297444    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297449    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297454    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297459    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297463    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297468    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297472    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297477    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297482    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297487    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297495    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297500    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297504    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297511    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297515    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297520    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297525    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 23:07:16.306611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297530    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297535    2581 flags.go:64] FLAG: --v="2"
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297547    2581 flags.go:64] FLAG: --version="false"
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297553    2581 flags.go:64] FLAG: --vmodule=""
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297559    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.297584    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297835    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297843    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297849    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297854    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297858    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297862    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297867    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297871    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297875    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297880    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297884    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297888    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297892    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297896    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297900    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:07:16.307314 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297904    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297909    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297913    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297917    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297921    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297925    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297929    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297933    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297937    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297942    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297946    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297951    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297956    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297960    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297964    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297968    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297972    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297978    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297981    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297985    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:07:16.307940 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297989    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297993    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.297998    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298002    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298006    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298010    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298014    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298019    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298023    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298027    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298031    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298035    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298039    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298043    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298047    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298052    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298056    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298060    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298064    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298069    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:07:16.308425 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298073    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298077    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298081    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298085    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298089    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298093    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298098    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298102    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298106    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298112    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298116    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298120    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298124    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298128    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298136    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298142    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298147    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298151    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298155    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298159    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:07:16.308943 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298164    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298168    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298172    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298177    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298181    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298186    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298190    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298194    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298198    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298203    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298209    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298215    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298219    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298224    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298229    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298233    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298238    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298243    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298248    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:07:16.309431 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298254    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:07:16.309911 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298259    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:07:16.309911 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298267    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:07:16.309911 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298272    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:07:16.309911 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.298276    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:07:16.309911 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.298793    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:07:16.309911 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.305396    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 23:07:16.309911 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.305411    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 23:07:16.309911 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.305431    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 23:07:16.309911 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.305437    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 23:07:16.309911 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305489    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:07:16.309911 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305494    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:07:16.309911 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305497    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:07:16.309911 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305501    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:07:16.309911 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305504    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:07:16.309911 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305507    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305509    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305512    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305514    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305516    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305519    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305521    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305525    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305529    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305533    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305535    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305538    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305541    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305543    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305546    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305550    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305553    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305556    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305559    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:07:16.310296 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305562    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305582    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305585    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305588    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305590    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305595    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305598    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305601    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305603    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305605    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305608    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305610    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305613    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305615    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305618    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305620    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305623    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305625    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305628    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305630    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:07:16.310801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305633    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305635    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305638    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305640    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305643    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305645    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305648    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305650    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305653    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305655    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305658    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305660    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305663    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305665    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305667    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305670    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305672    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305675    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305679    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305682    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:07:16.311290 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305684    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305687    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305690    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305692    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305695    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305697    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305701    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305704    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305707    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305709    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305712    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305715    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305717    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305719    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305722    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305724    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305727    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305729    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305732    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:07:16.311835 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305734    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:07:16.312292 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305737    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:07:16.312292 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305739    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:07:16.312292 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305741    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:07:16.312292 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305744    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:07:16.312292 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305746    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:07:16.312292 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305749    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:07:16.312292 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305751    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:07:16.312292 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305754    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:07:16.312292 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305756    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:07:16.312292 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305759    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:07:16.312292 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305762    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:07:16.312292 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305765    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:07:16.312292 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305767    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:07:16.312292 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305770    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:07:16.312292 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305772    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:07:16.312818 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.305777    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:07:16.312818 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305895    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 23:07:16.312818 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305900    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 23:07:16.312818 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305903    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 23:07:16.312818 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305906    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 23:07:16.312818 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305909    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 23:07:16.312818 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305911    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 23:07:16.312818 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305914    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 23:07:16.312818 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305917    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 23:07:16.312818 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305921    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 23:07:16.312818 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305924    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 23:07:16.312818 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305927    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 23:07:16.312818 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305930    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 23:07:16.312818 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305932    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305935    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305937    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305940    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305942    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305945    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305948    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305950    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305952    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305955    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305957    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305960    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305963    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305965    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305968    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305970    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305973    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305976    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305978    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305981    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 23:07:16.313397 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305983    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305986    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305988    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305991    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305993    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305996    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.305998    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306001    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306004    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306006    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306009    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306011    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306013    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306016    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306018    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306021    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306023    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306026    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306028    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306031    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 23:07:16.314164 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306033    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306036    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306038    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306042    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306045    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306048    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306052    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306054    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306057    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306060    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306063    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306065    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306068    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306070    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306073    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306075    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306078    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306080    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306083    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 23:07:16.314814 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306085    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306087    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306090    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306092    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306094    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306097    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306099    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306101    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306104    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306106    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306109    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306111    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306114    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306116    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306119    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306121    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306124    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306126    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306129    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306131    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 23:07:16.315286 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306133    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 23:07:16.315877 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306136    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 23:07:16.315877 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306139    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 23:07:16.315877 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306141    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 23:07:16.315877 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306144    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 23:07:16.315877 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306146    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 23:07:16.315877 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306149    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 23:07:16.315877 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:16.306152    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 23:07:16.315877 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.306157    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 23:07:16.315877 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.306258    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 23:07:16.315877 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.308076    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 23:07:16.315877 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.309450    2581 server.go:1019] "Starting client certificate rotation"
Jul 02 23:07:16.315877 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.309549    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 23:07:16.315877 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.309598    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 23:07:16.315877 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.315178    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 23:07:16.316607 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.316591    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 23:07:16.328464 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.328445    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 02 23:07:16.330263 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.330248    2581 log.go:25] "Validated CRI v1 image API"
Jul 02 23:07:16.331096 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.331080    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 23:07:16.336061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.336039    2581 fs.go:135] Filesystem UUIDs: map[15e39c49-0d8c-4f67-af89-998fa04d1c5c:/dev/nvme0n1p3 37b10924-60a3-4fba-9024-641839bf790d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 02 23:07:16.336130 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.336059    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 23:07:16.338895 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.338877    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 23:07:16.342222 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.342113    2581 manager.go:216] Machine: {Timestamp:2026-07-02 23:07:16.340597296 +0000 UTC m=+0.325336033 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099724 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29ecf7604fa0340043db4dac160485 SystemUUID:ec29ecf7-604f-a034-0043-db4dac160485 BootID:f73ce94b-45f9-4363-b10f-a746def6c985 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:76:0a:b2:1e:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:76:0a:b2:1e:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:ff:cc:c7:af:16 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 23:07:16.342222 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.342216    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 23:07:16.342359 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.342320    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 23:07:16.345245 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.345216    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 23:07:16.345408 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.345247    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-220.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 23:07:16.345906 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.345894    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 23:07:16.345968 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.345910    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 23:07:16.345968 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.345921    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 23:07:16.346659 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.346647    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 23:07:16.347712 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.347699    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 23:07:16.350284 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.350270    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 23:07:16.350601 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.350589    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 23:07:16.350673 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.350628    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 23:07:16.350673 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.350643    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 23:07:16.350673 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.350662    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 23:07:16.350789 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.350680    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 02 23:07:16.350789 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.350706    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 23:07:16.351078 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.351064    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 23:07:16.351144 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.351086    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 23:07:16.355396 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.355378    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 23:07:16.357019 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.357006    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 23:07:16.357080 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.357038    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 23:07:16.358257 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.358246    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 23:07:16.358312 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.358262    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 23:07:16.358312 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.358269    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 23:07:16.358312 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.358275    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 23:07:16.358312 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.358283    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 23:07:16.358312 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.358288    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 23:07:16.358312 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.358298    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 23:07:16.358312 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.358306    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 23:07:16.358312 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.358313    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 23:07:16.358524 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.358318    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 23:07:16.358524 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.358327    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 23:07:16.358524 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.358332    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 23:07:16.359102 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.359092    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 23:07:16.359102 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.359102    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 23:07:16.362252 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.362227    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-220.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 23:07:16.362355 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.362250    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 23:07:16.362355 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.362345    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 23:07:16.362772 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.362760    2581 server.go:1268] "Started kubelet"
Jul 02 23:07:16.362858 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.362833    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 23:07:16.363249 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.363198    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 23:07:16.363352 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.363268    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 23:07:16.363760 ip-10-0-141-220 systemd[1]: Started Kubernetes Kubelet.
Jul 02 23:07:16.364852 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.364843    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 23:07:16.365231 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.365204    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 23:07:16.368338 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.367508    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-220.ec2.internal.18be9ba535f94bba  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-220.ec2.internal,UID:ip-10-0-141-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-220.ec2.internal,},FirstTimestamp:2026-07-02 23:07:16.362734522 +0000 UTC m=+0.347473259,LastTimestamp:2026-07-02 23:07:16.362734522 +0000 UTC m=+0.347473259,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-220.ec2.internal,}"
Jul 02 23:07:16.369800 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.369766    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 23:07:16.371126 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.371113    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 23:07:16.371220 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.371203    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 02 23:07:16.371220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.371114    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 23:07:16.371612 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.371596    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 23:07:16.371612 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.371601    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 23:07:16.371773 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.371618    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 23:07:16.371773 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.371694    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 23:07:16.371773 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.371703    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 23:07:16.371978 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.371961    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 23:07:16.372015 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.371980    2581 factory.go:55] Registering systemd factory
Jul 02 23:07:16.372015 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.371987    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 02 23:07:16.372183 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.372168    2581 factory.go:153] Registering CRI-O factory
Jul 02 23:07:16.372227 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.372188    2581 factory.go:223] Registration of the crio container factory successfully
Jul 02 23:07:16.372227 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.372212    2581 factory.go:103] Registering Raw factory
Jul 02 23:07:16.372227 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.372226    2581 manager.go:1196] Started watching for new ooms in manager
Jul 02 23:07:16.372610 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.372559    2581 manager.go:349] Starting recovery of all containers
Jul 02 23:07:16.380917 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.380748    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 23:07:16.381232 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.381203    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 23:07:16.382059 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.382038    2581 manager.go:354] Recovery completed
Jul 02 23:07:16.386421 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.386404    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-67xnz"
Jul 02 23:07:16.387147 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.387135    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:07:16.388997 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.388983    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:07:16.389042 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.389009    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:07:16.389042 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.389019    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:07:16.389616 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.389597    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:07:16.389697 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.389629    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 23:07:16.389697 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.389641    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 23:07:16.389697 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.389659    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 23:07:16.390243 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.390227    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:07:16.390293 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.390254    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:07:16.390293 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.390264    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:07:16.390823 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.390812    2581 policy_none.go:49] "None policy: Start"
Jul 02 23:07:16.390857 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.390827    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 23:07:16.390857 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.390838    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 23:07:16.391733 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.391723    2581 policy_none.go:47] "Start"
Jul 02 23:07:16.393917 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.393902    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-67xnz"
Jul 02 23:07:16.397722 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.397638    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-220.ec2.internal.18be9ba5378a0935  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-220.ec2.internal,UID:ip-10-0-141-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-220.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-220.ec2.internal,},FirstTimestamp:2026-07-02 23:07:16.388997429 +0000 UTC m=+0.373736165,LastTimestamp:2026-07-02 23:07:16.388997429 +0000 UTC m=+0.373736165,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-220.ec2.internal,}"
Jul 02 23:07:16.430155 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.430140    2581 manager.go:337] "Starting Device Plugin manager"
Jul 02 23:07:16.430245 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.430183    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 23:07:16.430245 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.430192    2581 server.go:87] "Starting device plugin registration server"
Jul 02 23:07:16.430493 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.430473    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 23:07:16.430605 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.430490    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 23:07:16.430605 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.430587    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 23:07:16.430712 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.430673    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 23:07:16.430712 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.430682    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 23:07:16.431362 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.431340    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 23:07:16.431427 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.431398    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 02 23:07:16.531007 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.530976    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:07:16.533077 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.532282    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:07:16.533077 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.532317    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:07:16.533077 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.532327    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:07:16.533077 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.532353    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-220.ec2.internal"
Jul 02 23:07:16.542500 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.542438    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 23:07:16.543108 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.543089    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-220.ec2.internal"
Jul 02 23:07:16.543173 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.543120    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-220.ec2.internal\": node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 02 23:07:16.543851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.543836    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 23:07:16.543948 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.543877    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 23:07:16.543948 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.543900    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 23:07:16.543948 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.543933    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 23:07:16.547018 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.546997    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:07:16.598560 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.598516    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 02 23:07:16.644257 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.644220    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"]
Jul 02 23:07:16.644409 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.644299    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:07:16.645317 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.645299    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:07:16.645389 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.645329    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:07:16.645389 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.645339    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:07:16.647559 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.647546    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:07:16.647678 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.647660    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 02 23:07:16.647729 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.647707    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:07:16.648360 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.648342    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:07:16.648455 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.648370    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:07:16.648455 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.648383    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:07:16.649046 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.649029    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:07:16.649113 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.649060    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:07:16.649113 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.649078    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:07:16.650496 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.650477    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Jul 02 23:07:16.650606 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.650505    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:07:16.651171 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.651148    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:07:16.651171 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.651171    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:07:16.651269 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.651180    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:07:16.683449 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.683414    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-220.ec2.internal\" not found" node="ip-10-0-141-220.ec2.internal"
Jul 02 23:07:16.687876 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.687860    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-220.ec2.internal\" not found" node="ip-10-0-141-220.ec2.internal"
Jul 02 23:07:16.698936 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.698917    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 02 23:07:16.772946 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.772908    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c289d765ebaf73084c7d6f9e7be86f96-config\") pod \"kube-apiserver-proxy-ip-10-0-141-220.ec2.internal\" (UID: \"c289d765ebaf73084c7d6f9e7be86f96\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Jul 02 23:07:16.772946 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.772943    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5e0da935ef858da2c612dd00c085dac0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"5e0da935ef858da2c612dd00c085dac0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 02 23:07:16.773138 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.772958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e0da935ef858da2c612dd00c085dac0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"5e0da935ef858da2c612dd00c085dac0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 02 23:07:16.799536 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.799452    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 02 23:07:16.874043 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.874007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e0da935ef858da2c612dd00c085dac0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"5e0da935ef858da2c612dd00c085dac0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 02 23:07:16.874188 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.874058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c289d765ebaf73084c7d6f9e7be86f96-config\") pod \"kube-apiserver-proxy-ip-10-0-141-220.ec2.internal\" (UID: \"c289d765ebaf73084c7d6f9e7be86f96\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Jul 02 23:07:16.874188 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.874074    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5e0da935ef858da2c612dd00c085dac0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"5e0da935ef858da2c612dd00c085dac0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 02 23:07:16.874188 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.874105    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5e0da935ef858da2c612dd00c085dac0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"5e0da935ef858da2c612dd00c085dac0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 02 23:07:16.874188 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.874127    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e0da935ef858da2c612dd00c085dac0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal\" (UID: \"5e0da935ef858da2c612dd00c085dac0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 02 23:07:16.874188 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.874124    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c289d765ebaf73084c7d6f9e7be86f96-config\") pod \"kube-apiserver-proxy-ip-10-0-141-220.ec2.internal\" (UID: \"c289d765ebaf73084c7d6f9e7be86f96\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Jul 02 23:07:16.900138 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:16.900106    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 02 23:07:16.985661 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.985618    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 02 23:07:16.991101 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:16.990322    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Jul 02 23:07:17.000422 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:17.000404    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 02 23:07:17.101070 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:17.100970    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 02 23:07:18.222810 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:18.222779    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 02 23:07:18.252772 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.252750    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:07:18.317523 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.317490    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:07:18.323623 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:18.323600    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 02 23:07:18.329717 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.329701    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 23:07:18.329838 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.329820    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 23:07:18.329901 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.329828    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 23:07:18.329901 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.329835    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 23:07:18.418455 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.418375    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 23:02:17 +0000 UTC" deadline="2028-04-07 10:35:36.221147512 +0000 UTC"
Jul 02 23:07:18.418455 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.418412    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15467h28m17.802741348s"
Jul 02 23:07:18.424515 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:18.424495    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 02 23:07:18.525254 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:18.525212    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 02 23:07:18.547191 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:18.547159    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc289d765ebaf73084c7d6f9e7be86f96.slice/crio-d4167513687fde98f7a515d97bc7d41faf58b3e825332e737a688d50014546ef WatchSource:0}: Error finding container d4167513687fde98f7a515d97bc7d41faf58b3e825332e737a688d50014546ef: Status 404 returned error can't find the container with id d4167513687fde98f7a515d97bc7d41faf58b3e825332e737a688d50014546ef
Jul 02 23:07:18.547362 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:18.547346    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e0da935ef858da2c612dd00c085dac0.slice/crio-2a15de767752bb0435025afcfcaf573aed3cd15e21902f0f5e9f29315b7f9810 WatchSource:0}: Error finding container 2a15de767752bb0435025afcfcaf573aed3cd15e21902f0f5e9f29315b7f9810: Status 404 returned error can't find the container with id 2a15de767752bb0435025afcfcaf573aed3cd15e21902f0f5e9f29315b7f9810
Jul 02 23:07:18.553292 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.553279    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:07:18.569785 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.569740    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" event={"ID":"5e0da935ef858da2c612dd00c085dac0","Type":"ContainerStarted","Data":"2a15de767752bb0435025afcfcaf573aed3cd15e21902f0f5e9f29315b7f9810"}
Jul 02 23:07:18.570784 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.570753    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" event={"ID":"c289d765ebaf73084c7d6f9e7be86f96","Type":"ContainerStarted","Data":"d4167513687fde98f7a515d97bc7d41faf58b3e825332e737a688d50014546ef"}
Jul 02 23:07:18.601206 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.601170    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 23:07:18.602371 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.602357    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 23:07:18.602444 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.602385    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 23:07:18.602444 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.602395    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeHasSufficientPID"
Jul 02 23:07:18.626189 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:18.626158    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-220.ec2.internal\" not found"
Jul 02 23:07:18.636344 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.636324    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:07:18.693090 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.692999    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal"
Jul 02 23:07:18.703400 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.703378    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 23:07:18.704298 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.704285    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal"
Jul 02 23:07:18.711673 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:18.711657    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 23:07:19.373535 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.373477    2581 apiserver.go:52] "Watching apiserver"
Jul 02 23:07:19.380301 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.380271    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 23:07:19.380691 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.380665    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl","openshift-image-registry/node-ca-jxk2s","openshift-multus/network-metrics-daemon-27zv5","openshift-network-diagnostics/network-check-target-7k6dt","openshift-network-operator/iptables-alerter-8lxpz","openshift-ovn-kubernetes/ovnkube-node-pq45t","kube-system/global-pull-secret-syncer-4rpk9","kube-system/konnectivity-agent-bjnvr","openshift-cluster-node-tuning-operator/tuned-pfw6k","openshift-dns/node-resolver-fdp9l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal","openshift-multus/multus-additional-cni-plugins-hdhkd","openshift-multus/multus-k9m8v"]
Jul 02 23:07:19.383224 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.383203    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.385534 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.385510    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 23:07:19.385687 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.385482    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.385939 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.385921    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m9kq9\""
Jul 02 23:07:19.386259 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.386232    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 23:07:19.386259 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.386242    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 23:07:19.386515 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.386475    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 23:07:19.386609 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.386599    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 23:07:19.386762 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.386745    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 23:07:19.387778 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.387756    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jxk2s"
Jul 02 23:07:19.388227 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.388199    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 23:07:19.388314 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.388298    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8b927\""
Jul 02 23:07:19.388432 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.388417    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 23:07:19.388564 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.388546    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 23:07:19.388628 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.388603    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 23:07:19.388687 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.388649    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 23:07:19.389864 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.389847    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 23:07:19.389997 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.389980    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 23:07:19.390140 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.390069    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:19.390200 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:19.390146    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27zv5" podUID="9b58b91e-ef2e-4ecd-bfbe-619ba380493f"
Jul 02 23:07:19.390365 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.390271    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qqxds\""
Jul 02 23:07:19.390365 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.390271    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 23:07:19.392192 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.392174    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:19.392282 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:19.392242    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k6dt" podUID="83a17801-1225-46d6-9b58-4a1c7e0c0534"
Jul 02 23:07:19.393527 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.393508    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 23:07:19.394520 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.394504    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8lxpz"
Jul 02 23:07:19.397151 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.397017    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 23:07:19.397248 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.397224    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 23:07:19.397425 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.397410    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:07:19.397662 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.397647    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h85zb\""
Jul 02 23:07:19.398016 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.397996    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bjnvr"
Jul 02 23:07:19.399071 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.399050    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.400095 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.400077    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 23:07:19.400217 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.400198    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 23:07:19.400440 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.400423    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cdxff\""
Jul 02 23:07:19.401138 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.401119    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 23:07:19.401248 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.401121    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vlvr2\""
Jul 02 23:07:19.401520 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.401502    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.402370 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.402349    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 23:07:19.404319 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.403861    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.404319 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.403868    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 23:07:19.404319 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404233    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-68nph\""
Jul 02 23:07:19.404319 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404266    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 23:07:19.404556 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404547    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkvw4\" (UniqueName: \"kubernetes.io/projected/b99491c3-0d67-483e-91e4-0022e54bbb90-kube-api-access-pkvw4\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.404590 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404565    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35593682-d5e7-4cc6-a1dc-357ba50f2eb0-host-slash\") pod \"iptables-alerter-8lxpz\" (UID: \"35593682-d5e7-4cc6-a1dc-357ba50f2eb0\") " pod="openshift-network-operator/iptables-alerter-8lxpz"
Jul 02 23:07:19.404590 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404581    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-run-netns\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.404590 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404582    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 23:07:19.404673 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-run-openvswitch\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.404673 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404614    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-run-ovn\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.404673 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b99491c3-0d67-483e-91e4-0022e54bbb90-ovnkube-script-lib\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.404673 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0451a6f-879b-490d-a413-df7e1e20a6b4-system-cni-dir\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.404673 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0451a6f-879b-490d-a413-df7e1e20a6b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.404821 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404677    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-log-socket\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.404821 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404691    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.404821 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404708    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0451a6f-879b-490d-a413-df7e1e20a6b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.404821 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25ecfdbf-2d20-4557-831c-365fac161de9-host\") pod \"node-ca-jxk2s\" (UID: \"25ecfdbf-2d20-4557-831c-365fac161de9\") " pod="openshift-image-registry/node-ca-jxk2s"
Jul 02 23:07:19.404821 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-systemd-units\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.404821 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404770    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-etc-openvswitch\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.404821 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404796    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-node-log\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.405220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404830    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbkf6\" (UniqueName: \"kubernetes.io/projected/25ecfdbf-2d20-4557-831c-365fac161de9-kube-api-access-cbkf6\") pod \"node-ca-jxk2s\" (UID: \"25ecfdbf-2d20-4557-831c-365fac161de9\") " pod="openshift-image-registry/node-ca-jxk2s"
Jul 02 23:07:19.405220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404899    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-cni-bin\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.405220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0451a6f-879b-490d-a413-df7e1e20a6b4-os-release\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.405220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404941    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0451a6f-879b-490d-a413-df7e1e20a6b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.405220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404960    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7pt6\" (UniqueName: \"kubernetes.io/projected/e0451a6f-879b-490d-a413-df7e1e20a6b4-kube-api-access-f7pt6\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.405220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404977    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/35593682-d5e7-4cc6-a1dc-357ba50f2eb0-iptables-alerter-script\") pod \"iptables-alerter-8lxpz\" (UID: \"35593682-d5e7-4cc6-a1dc-357ba50f2eb0\") " pod="openshift-network-operator/iptables-alerter-8lxpz"
Jul 02 23:07:19.405220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.404991    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-slash\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.405220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.405005    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-var-lib-openvswitch\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.405220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.405030    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b99491c3-0d67-483e-91e4-0022e54bbb90-ovn-node-metrics-cert\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.405220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.405055    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0451a6f-879b-490d-a413-df7e1e20a6b4-cnibin\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.405220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.405069    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25ecfdbf-2d20-4557-831c-365fac161de9-serviceca\") pod \"node-ca-jxk2s\" (UID: \"25ecfdbf-2d20-4557-831c-365fac161de9\") " pod="openshift-image-registry/node-ca-jxk2s"
Jul 02 23:07:19.405220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.405084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxm7g\" (UniqueName: \"kubernetes.io/projected/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-kube-api-access-dxm7g\") pod \"network-metrics-daemon-27zv5\" (UID: \"9b58b91e-ef2e-4ecd-bfbe-619ba380493f\") " pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:19.405220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.405098    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srx68\" (UniqueName: \"kubernetes.io/projected/35593682-d5e7-4cc6-a1dc-357ba50f2eb0-kube-api-access-srx68\") pod \"iptables-alerter-8lxpz\" (UID: \"35593682-d5e7-4cc6-a1dc-357ba50f2eb0\") " pod="openshift-network-operator/iptables-alerter-8lxpz"
Jul 02 23:07:19.405220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.405112    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-kubelet\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.405220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.405125    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-run-systemd\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.405220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.405141    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-run-ovn-kubernetes\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.406003 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.405186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b99491c3-0d67-483e-91e4-0022e54bbb90-env-overrides\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.406003 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.405209    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0451a6f-879b-490d-a413-df7e1e20a6b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.406003 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.405226    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs\") pod \"network-metrics-daemon-27zv5\" (UID: \"9b58b91e-ef2e-4ecd-bfbe-619ba380493f\") " pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:19.406003 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.405247    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzqg4\" (UniqueName: \"kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4\") pod \"network-check-target-7k6dt\" (UID: \"83a17801-1225-46d6-9b58-4a1c7e0c0534\") " pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:19.406003 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.405262    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-cni-netd\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.406003 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.405291    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b99491c3-0d67-483e-91e4-0022e54bbb90-ovnkube-config\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.406003 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.405743    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:07:19.406335 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.406212    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 23:07:19.406335 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.406234    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dkdwc\""
Jul 02 23:07:19.406335 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.406324    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fdp9l"
Jul 02 23:07:19.409016 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.408990    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:19.409106 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.409084    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nld5w\""
Jul 02 23:07:19.409106 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:19.409094    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rpk9" podUID="dee8ea60-68c5-4775-adbe-0f7a82fca7a3"
Jul 02 23:07:19.409502 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.409483    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 23:07:19.409502 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.409497    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 23:07:19.428704 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.428678    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c7s96"
Jul 02 23:07:19.434243 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.434224    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c7s96"
Jul 02 23:07:19.493719 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.493690    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 23:07:19.505465 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505440    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-run-netns\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.505631 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-sys-fs\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.505631 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2r27\" (UniqueName: \"kubernetes.io/projected/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-kube-api-access-f2r27\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.505631 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505516    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.505631 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505535    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-socket-dir\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.505631 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505560    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-systemd-units\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.505631 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-etc-openvswitch\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.505631 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505605    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbkf6\" (UniqueName: \"kubernetes.io/projected/25ecfdbf-2d20-4557-831c-365fac161de9-kube-api-access-cbkf6\") pod \"node-ca-jxk2s\" (UID: \"25ecfdbf-2d20-4557-831c-365fac161de9\") " pod="openshift-image-registry/node-ca-jxk2s"
Jul 02 23:07:19.505631 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505627    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3438e6dd-0c4b-4a90-8cb0-53a76863f603-agent-certs\") pod \"konnectivity-agent-bjnvr\" (UID: \"3438e6dd-0c4b-4a90-8cb0-53a76863f603\") " pod="kube-system/konnectivity-agent-bjnvr"
Jul 02 23:07:19.506061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505655    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-systemd-units\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.506061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505649    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-cni-bin\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.506061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505680    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-etc-openvswitch\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.506061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505704    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d909661b-ea6e-417b-8b1c-a0260bf28058-hosts-file\") pod \"node-resolver-fdp9l\" (UID: \"d909661b-ea6e-417b-8b1c-a0260bf28058\") " pod="openshift-dns/node-resolver-fdp9l"
Jul 02 23:07:19.506061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505734    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-sysctl-conf\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.506061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505707    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-cni-bin\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.506061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505757    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-systemd\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.506061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505782    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stjnc\" (UniqueName: \"kubernetes.io/projected/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-kube-api-access-stjnc\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.506061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7pt6\" (UniqueName: \"kubernetes.io/projected/e0451a6f-879b-490d-a413-df7e1e20a6b4-kube-api-access-f7pt6\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.506061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505839    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-registration-dir\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.506061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505862    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-etc-selinux\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.506061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505899    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-sysconfig\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.506061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505920    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-var-lib-kubelet\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.506061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505945    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/35593682-d5e7-4cc6-a1dc-357ba50f2eb0-iptables-alerter-script\") pod \"iptables-alerter-8lxpz\" (UID: \"35593682-d5e7-4cc6-a1dc-357ba50f2eb0\") " pod="openshift-network-operator/iptables-alerter-8lxpz"
Jul 02 23:07:19.506061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.505994    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-var-lib-openvswitch\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.506061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506019    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b99491c3-0d67-483e-91e4-0022e54bbb90-ovn-node-metrics-cert\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.506061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506043    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25ecfdbf-2d20-4557-831c-365fac161de9-serviceca\") pod \"node-ca-jxk2s\" (UID: \"25ecfdbf-2d20-4557-831c-365fac161de9\") " pod="openshift-image-registry/node-ca-jxk2s"
Jul 02 23:07:19.506825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvmcp\" (UniqueName: \"kubernetes.io/projected/d909661b-ea6e-417b-8b1c-a0260bf28058-kube-api-access-zvmcp\") pod \"node-resolver-fdp9l\" (UID: \"d909661b-ea6e-417b-8b1c-a0260bf28058\") " pod="openshift-dns/node-resolver-fdp9l"
Jul 02 23:07:19.506825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506104    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-var-lib-openvswitch\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.506825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506116    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-kubelet\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.506825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506167    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-run-systemd\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.506825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506179    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-kubelet\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.506825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqg4\" (UniqueName: \"kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4\") pod \"network-check-target-7k6dt\" (UID: \"83a17801-1225-46d6-9b58-4a1c7e0c0534\") " pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:19.506825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506202    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-run-systemd\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.506825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506245    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-cni-netd\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.506825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b99491c3-0d67-483e-91e4-0022e54bbb90-ovnkube-config\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.506825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkvw4\" (UniqueName: \"kubernetes.io/projected/b99491c3-0d67-483e-91e4-0022e54bbb90-kube-api-access-pkvw4\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.506825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506321    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-cni-netd\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.506825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506327    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret\") pod \"global-pull-secret-syncer-4rpk9\" (UID: \"dee8ea60-68c5-4775-adbe-0f7a82fca7a3\") " pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:19.506825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506352    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-multus-daemon-config\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.506825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506376    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-run-openvswitch\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.506825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506379    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 23:07:19.506825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506400    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-run-ovn\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.506825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506422    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b99491c3-0d67-483e-91e4-0022e54bbb90-ovnkube-script-lib\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.507548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506444    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-cnibin\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.507548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506467    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-var-lib-cni-multus\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.507548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506494    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-run-openvswitch\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.507548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506495    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-run-multus-certs\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.507548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506495    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25ecfdbf-2d20-4557-831c-365fac161de9-serviceca\") pod \"node-ca-jxk2s\" (UID: \"25ecfdbf-2d20-4557-831c-365fac161de9\") " pod="openshift-image-registry/node-ca-jxk2s"
Jul 02 23:07:19.507548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-log-socket\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.507548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506611    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.507548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506632    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-run-ovn\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.507548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506659    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-log-socket\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.507548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0451a6f-879b-490d-a413-df7e1e20a6b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.507548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506720    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.507548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506781    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25ecfdbf-2d20-4557-831c-365fac161de9-host\") pod \"node-ca-jxk2s\" (UID: \"25ecfdbf-2d20-4557-831c-365fac161de9\") " pod="openshift-image-registry/node-ca-jxk2s"
Jul 02 23:07:19.507548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506824    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-multus-cni-dir\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.507548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506845    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-hostroot\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.507548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506851    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b99491c3-0d67-483e-91e4-0022e54bbb90-ovnkube-config\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.507548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506900    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25ecfdbf-2d20-4557-831c-365fac161de9-host\") pod \"node-ca-jxk2s\" (UID: \"25ecfdbf-2d20-4557-831c-365fac161de9\") " pod="openshift-image-registry/node-ca-jxk2s"
Jul 02 23:07:19.507548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506920    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-etc-kubernetes\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.508290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506954    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-node-log\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.508290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506954    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b99491c3-0d67-483e-91e4-0022e54bbb90-ovnkube-script-lib\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.508290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506986    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-sys\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.508290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.506995    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-node-log\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.508290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507011    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8313031-435c-431f-8f7e-81d7ab30feab-tmp\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.508290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507034    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-sysctl-d\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.508290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507056    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-run\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.508290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507083    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-var-lib-cni-bin\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.508290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0451a6f-879b-490d-a413-df7e1e20a6b4-os-release\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.508290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0451a6f-879b-490d-a413-df7e1e20a6b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.508290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507181    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d909661b-ea6e-417b-8b1c-a0260bf28058-tmp-dir\") pod \"node-resolver-fdp9l\" (UID: \"d909661b-ea6e-417b-8b1c-a0260bf28058\") " pod="openshift-dns/node-resolver-fdp9l"
Jul 02 23:07:19.508290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507200    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/35593682-d5e7-4cc6-a1dc-357ba50f2eb0-iptables-alerter-script\") pod \"iptables-alerter-8lxpz\" (UID: \"35593682-d5e7-4cc6-a1dc-357ba50f2eb0\") " pod="openshift-network-operator/iptables-alerter-8lxpz"
Jul 02 23:07:19.508290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507204    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8313031-435c-431f-8f7e-81d7ab30feab-etc-tuned\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.508290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507240    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e0451a6f-879b-490d-a413-df7e1e20a6b4-os-release\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.508290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507243    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spdbz\" (UniqueName: \"kubernetes.io/projected/c8313031-435c-431f-8f7e-81d7ab30feab-kube-api-access-spdbz\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.508290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507281    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-cni-binary-copy\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.508290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507347    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-modprobe-d\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.508834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-slash\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.508834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507428    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-slash\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.508834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0451a6f-879b-490d-a413-df7e1e20a6b4-cnibin\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.508834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507523    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e0451a6f-879b-490d-a413-df7e1e20a6b4-cnibin\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.508834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507538    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxm7g\" (UniqueName: \"kubernetes.io/projected/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-kube-api-access-dxm7g\") pod \"network-metrics-daemon-27zv5\" (UID: \"9b58b91e-ef2e-4ecd-bfbe-619ba380493f\") " pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:19.508834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507574    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3438e6dd-0c4b-4a90-8cb0-53a76863f603-konnectivity-ca\") pod \"konnectivity-agent-bjnvr\" (UID: \"3438e6dd-0c4b-4a90-8cb0-53a76863f603\") " pod="kube-system/konnectivity-agent-bjnvr"
Jul 02 23:07:19.508834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-os-release\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.508834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507576    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e0451a6f-879b-490d-a413-df7e1e20a6b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.508834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507621    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-run-k8s-cni-cncf-io\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.508834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-device-dir\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.508834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-kubernetes\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.508834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507688    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-lib-modules\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.508834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507716    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srx68\" (UniqueName: \"kubernetes.io/projected/35593682-d5e7-4cc6-a1dc-357ba50f2eb0-kube-api-access-srx68\") pod \"iptables-alerter-8lxpz\" (UID: \"35593682-d5e7-4cc6-a1dc-357ba50f2eb0\") " pod="openshift-network-operator/iptables-alerter-8lxpz"
Jul 02 23:07:19.508834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-run-ovn-kubernetes\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.508834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507861    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e0451a6f-879b-490d-a413-df7e1e20a6b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.508834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b99491c3-0d67-483e-91e4-0022e54bbb90-env-overrides\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.508834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507901    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-run-ovn-kubernetes\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.509579 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0451a6f-879b-490d-a413-df7e1e20a6b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.509579 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507949    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs\") pod \"network-metrics-daemon-27zv5\" (UID: \"9b58b91e-ef2e-4ecd-bfbe-619ba380493f\") " pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:19.509579 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.507976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-kubelet-config\") pod \"global-pull-secret-syncer-4rpk9\" (UID: \"dee8ea60-68c5-4775-adbe-0f7a82fca7a3\") " pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:19.509579 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.508001    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-host\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.509579 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.508024    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-system-cni-dir\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.509579 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.508047    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-var-lib-kubelet\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.509579 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.508070    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-multus-conf-dir\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.509579 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:19.508085    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:07:19.509579 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.508103    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35593682-d5e7-4cc6-a1dc-357ba50f2eb0-host-slash\") pod \"iptables-alerter-8lxpz\" (UID: \"35593682-d5e7-4cc6-a1dc-357ba50f2eb0\") " pod="openshift-network-operator/iptables-alerter-8lxpz"
Jul 02 23:07:19.509579 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.508127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-run-netns\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.509579 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.508153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0451a6f-879b-490d-a413-df7e1e20a6b4-system-cni-dir\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.509579 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.508184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0451a6f-879b-490d-a413-df7e1e20a6b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.509579 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.508207    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-dbus\") pod \"global-pull-secret-syncer-4rpk9\" (UID: \"dee8ea60-68c5-4775-adbe-0f7a82fca7a3\") " pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:19.509579 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.508215    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b99491c3-0d67-483e-91e4-0022e54bbb90-host-run-netns\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.509579 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.508231    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-multus-socket-dir-parent\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.509579 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.508248    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35593682-d5e7-4cc6-a1dc-357ba50f2eb0-host-slash\") pod \"iptables-alerter-8lxpz\" (UID: \"35593682-d5e7-4cc6-a1dc-357ba50f2eb0\") " pod="openshift-network-operator/iptables-alerter-8lxpz"
Jul 02 23:07:19.509579 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.508215    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e0451a6f-879b-490d-a413-df7e1e20a6b4-system-cni-dir\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.510151 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.508301    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b99491c3-0d67-483e-91e4-0022e54bbb90-env-overrides\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.510151 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.508421    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e0451a6f-879b-490d-a413-df7e1e20a6b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.510151 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:19.508428    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs podName:9b58b91e-ef2e-4ecd-bfbe-619ba380493f nodeName:}" failed. No retries permitted until 2026-07-02 23:07:20.008390672 +0000 UTC m=+2.971824000 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs") pod "network-metrics-daemon-27zv5" (UID: "9b58b91e-ef2e-4ecd-bfbe-619ba380493f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:07:19.510151 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.508438    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e0451a6f-879b-490d-a413-df7e1e20a6b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.510356 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.510172    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b99491c3-0d67-483e-91e4-0022e54bbb90-ovn-node-metrics-cert\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.512073 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:19.511597    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:07:19.512073 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:19.511621    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:07:19.512073 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:19.511635    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xzqg4 for pod openshift-network-diagnostics/network-check-target-7k6dt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:07:19.512073 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:19.511717    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4 podName:83a17801-1225-46d6-9b58-4a1c7e0c0534 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:20.011687259 +0000 UTC m=+2.975120571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xzqg4" (UniqueName: "kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4") pod "network-check-target-7k6dt" (UID: "83a17801-1225-46d6-9b58-4a1c7e0c0534") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:07:19.514937 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.514914    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkvw4\" (UniqueName: \"kubernetes.io/projected/b99491c3-0d67-483e-91e4-0022e54bbb90-kube-api-access-pkvw4\") pod \"ovnkube-node-pq45t\" (UID: \"b99491c3-0d67-483e-91e4-0022e54bbb90\") " pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.515130 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.515099    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxm7g\" (UniqueName: \"kubernetes.io/projected/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-kube-api-access-dxm7g\") pod \"network-metrics-daemon-27zv5\" (UID: \"9b58b91e-ef2e-4ecd-bfbe-619ba380493f\") " pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:19.515719 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.515698    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7pt6\" (UniqueName: \"kubernetes.io/projected/e0451a6f-879b-490d-a413-df7e1e20a6b4-kube-api-access-f7pt6\") pod \"multus-additional-cni-plugins-hdhkd\" (UID: \"e0451a6f-879b-490d-a413-df7e1e20a6b4\") " pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.515810 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.515702    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbkf6\" (UniqueName: \"kubernetes.io/projected/25ecfdbf-2d20-4557-831c-365fac161de9-kube-api-access-cbkf6\") pod \"node-ca-jxk2s\" (UID: \"25ecfdbf-2d20-4557-831c-365fac161de9\") " pod="openshift-image-registry/node-ca-jxk2s"
Jul 02 23:07:19.518088 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.518053    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srx68\" (UniqueName: \"kubernetes.io/projected/35593682-d5e7-4cc6-a1dc-357ba50f2eb0-kube-api-access-srx68\") pod \"iptables-alerter-8lxpz\" (UID: \"35593682-d5e7-4cc6-a1dc-357ba50f2eb0\") " pod="openshift-network-operator/iptables-alerter-8lxpz"
Jul 02 23:07:19.527689 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.527654    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:07:19.609425 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609383    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-kubelet-config\") pod \"global-pull-secret-syncer-4rpk9\" (UID: \"dee8ea60-68c5-4775-adbe-0f7a82fca7a3\") " pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:19.609613 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-host\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.609613 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-system-cni-dir\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.609613 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609478    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-var-lib-kubelet\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.609613 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609477    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-kubelet-config\") pod \"global-pull-secret-syncer-4rpk9\" (UID: \"dee8ea60-68c5-4775-adbe-0f7a82fca7a3\") " pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:19.609613 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-multus-conf-dir\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.609613 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609540    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-dbus\") pod \"global-pull-secret-syncer-4rpk9\" (UID: \"dee8ea60-68c5-4775-adbe-0f7a82fca7a3\") " pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:19.609613 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609563    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-multus-socket-dir-parent\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.609613 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609570    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-system-cni-dir\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.609613 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609580    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-run-netns\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.609613 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-sys-fs\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.609613 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609570    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-var-lib-kubelet\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.610191 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609563    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-host\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.610191 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609629    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-multus-socket-dir-parent\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.610191 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609628    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2r27\" (UniqueName: \"kubernetes.io/projected/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-kube-api-access-f2r27\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.610191 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609649    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-run-netns\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.610191 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609673    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.610191 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609685    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-dbus\") pod \"global-pull-secret-syncer-4rpk9\" (UID: \"dee8ea60-68c5-4775-adbe-0f7a82fca7a3\") " pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:19.610191 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609691    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-socket-dir\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.610191 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609739    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.610191 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3438e6dd-0c4b-4a90-8cb0-53a76863f603-agent-certs\") pod \"konnectivity-agent-bjnvr\" (UID: \"3438e6dd-0c4b-4a90-8cb0-53a76863f603\") " pod="kube-system/konnectivity-agent-bjnvr"
Jul 02 23:07:19.610191 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609685    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-sys-fs\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.610191 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609780    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d909661b-ea6e-417b-8b1c-a0260bf28058-hosts-file\") pod \"node-resolver-fdp9l\" (UID: \"d909661b-ea6e-417b-8b1c-a0260bf28058\") " pod="openshift-dns/node-resolver-fdp9l"
Jul 02 23:07:19.610191 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609784    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-socket-dir\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.610191 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609808    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-sysctl-conf\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.610191 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609832    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-systemd\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.610191 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609900    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-systemd\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.610191 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609902    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d909661b-ea6e-417b-8b1c-a0260bf28058-hosts-file\") pod \"node-resolver-fdp9l\" (UID: \"d909661b-ea6e-417b-8b1c-a0260bf28058\") " pod="openshift-dns/node-resolver-fdp9l"
Jul 02 23:07:19.610191 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609902    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stjnc\" (UniqueName: \"kubernetes.io/projected/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-kube-api-access-stjnc\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.611212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609948    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-registration-dir\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.611212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-etc-selinux\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.611212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609996    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-registration-dir\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.611212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609950    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-multus-conf-dir\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.611212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-sysconfig\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.611212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.609986    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-sysctl-conf\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.611212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610038    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-var-lib-kubelet\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.611212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvmcp\" (UniqueName: \"kubernetes.io/projected/d909661b-ea6e-417b-8b1c-a0260bf28058-kube-api-access-zvmcp\") pod \"node-resolver-fdp9l\" (UID: \"d909661b-ea6e-417b-8b1c-a0260bf28058\") " pod="openshift-dns/node-resolver-fdp9l"
Jul 02 23:07:19.611212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610079    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-sysconfig\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.611212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610091    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-etc-selinux\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.611212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610072    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-var-lib-kubelet\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.611212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret\") pod \"global-pull-secret-syncer-4rpk9\" (UID: \"dee8ea60-68c5-4775-adbe-0f7a82fca7a3\") " pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:19.611212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610190    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-multus-daemon-config\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.611212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610215    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-cnibin\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.611212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610239    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-var-lib-cni-multus\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.611212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610264    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-run-multus-certs\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.611212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610292    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-multus-cni-dir\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-hostroot\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-etc-kubernetes\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610341    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-var-lib-cni-multus\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610349    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-run-multus-certs\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-sys\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:19.610314    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8313031-435c-431f-8f7e-81d7ab30feab-tmp\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610398    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-cnibin\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610404    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-hostroot\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-sysctl-d\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:19.610440    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret podName:dee8ea60-68c5-4775-adbe-0f7a82fca7a3 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:20.110419415 +0000 UTC m=+3.073852737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret") pod "global-pull-secret-syncer-4rpk9" (UID: "dee8ea60-68c5-4775-adbe-0f7a82fca7a3") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610453    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-multus-cni-dir\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610456    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-sys\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610469    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-run\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610493    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-var-lib-cni-bin\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d909661b-ea6e-417b-8b1c-a0260bf28058-tmp-dir\") pod \"node-resolver-fdp9l\" (UID: \"d909661b-ea6e-417b-8b1c-a0260bf28058\") " pod="openshift-dns/node-resolver-fdp9l"
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610534    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8313031-435c-431f-8f7e-81d7ab30feab-etc-tuned\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.612056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610556    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spdbz\" (UniqueName: \"kubernetes.io/projected/c8313031-435c-431f-8f7e-81d7ab30feab-kube-api-access-spdbz\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610565    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-sysctl-d\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-cni-binary-copy\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610603    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-etc-kubernetes\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-modprobe-d\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3438e6dd-0c4b-4a90-8cb0-53a76863f603-konnectivity-ca\") pod \"konnectivity-agent-bjnvr\" (UID: \"3438e6dd-0c4b-4a90-8cb0-53a76863f603\") " pod="kube-system/konnectivity-agent-bjnvr"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610690    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-modprobe-d\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610713    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-os-release\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610738    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-run-k8s-cni-cncf-io\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610751    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-multus-daemon-config\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-device-dir\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610787    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-kubernetes\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610811    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-lib-modules\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610824    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-os-release\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610902    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-var-lib-cni-bin\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610940    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-host-run-k8s-cni-cncf-io\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.610946    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-run\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.611016    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-device-dir\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.612851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.611099    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-cni-binary-copy\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.613425 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.611114    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-etc-kubernetes\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.613425 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.611194    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8313031-435c-431f-8f7e-81d7ab30feab-lib-modules\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.613425 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.611313    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d909661b-ea6e-417b-8b1c-a0260bf28058-tmp-dir\") pod \"node-resolver-fdp9l\" (UID: \"d909661b-ea6e-417b-8b1c-a0260bf28058\") " pod="openshift-dns/node-resolver-fdp9l"
Jul 02 23:07:19.613425 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.611513    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3438e6dd-0c4b-4a90-8cb0-53a76863f603-konnectivity-ca\") pod \"konnectivity-agent-bjnvr\" (UID: \"3438e6dd-0c4b-4a90-8cb0-53a76863f603\") " pod="kube-system/konnectivity-agent-bjnvr"
Jul 02 23:07:19.613425 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.612689    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3438e6dd-0c4b-4a90-8cb0-53a76863f603-agent-certs\") pod \"konnectivity-agent-bjnvr\" (UID: \"3438e6dd-0c4b-4a90-8cb0-53a76863f603\") " pod="kube-system/konnectivity-agent-bjnvr"
Jul 02 23:07:19.613425 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.612984    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8313031-435c-431f-8f7e-81d7ab30feab-tmp\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.613425 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.613128    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c8313031-435c-431f-8f7e-81d7ab30feab-etc-tuned\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.618762 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.618739    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spdbz\" (UniqueName: \"kubernetes.io/projected/c8313031-435c-431f-8f7e-81d7ab30feab-kube-api-access-spdbz\") pod \"tuned-pfw6k\" (UID: \"c8313031-435c-431f-8f7e-81d7ab30feab\") " pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.619158 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.619134    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2r27\" (UniqueName: \"kubernetes.io/projected/4e5de9cc-16a7-40ce-b2f8-9ace191c44c9-kube-api-access-f2r27\") pod \"multus-k9m8v\" (UID: \"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9\") " pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.619233 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.619136    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvmcp\" (UniqueName: \"kubernetes.io/projected/d909661b-ea6e-417b-8b1c-a0260bf28058-kube-api-access-zvmcp\") pod \"node-resolver-fdp9l\" (UID: \"d909661b-ea6e-417b-8b1c-a0260bf28058\") " pod="openshift-dns/node-resolver-fdp9l"
Jul 02 23:07:19.619314 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.619298    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stjnc\" (UniqueName: \"kubernetes.io/projected/d678eb0f-28ce-4df0-9989-2c96ed3d2a67-kube-api-access-stjnc\") pod \"aws-ebs-csi-driver-node-fn9zl\" (UID: \"d678eb0f-28ce-4df0-9989-2c96ed3d2a67\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.700722 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.700637    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:19.708179 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.708155    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hdhkd"
Jul 02 23:07:19.720982 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.720954    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jxk2s"
Jul 02 23:07:19.726782 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.726759    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8lxpz"
Jul 02 23:07:19.733477 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.733441    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bjnvr"
Jul 02 23:07:19.741065 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.741046    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k9m8v"
Jul 02 23:07:19.747492 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.747472    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl"
Jul 02 23:07:19.753991 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.753974    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pfw6k"
Jul 02 23:07:19.759650 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:19.759633    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fdp9l"
Jul 02 23:07:20.013665 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:20.013586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs\") pod \"network-metrics-daemon-27zv5\" (UID: \"9b58b91e-ef2e-4ecd-bfbe-619ba380493f\") " pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:20.013665 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:20.013645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqg4\" (UniqueName: \"kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4\") pod \"network-check-target-7k6dt\" (UID: \"83a17801-1225-46d6-9b58-4a1c7e0c0534\") " pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:20.013854 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:20.013777    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:07:20.013919 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:20.013899    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:07:20.013919 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:20.013912    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs podName:9b58b91e-ef2e-4ecd-bfbe-619ba380493f nodeName:}" failed. No retries permitted until 2026-07-02 23:07:21.013891305 +0000 UTC m=+3.977324629 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs") pod "network-metrics-daemon-27zv5" (UID: "9b58b91e-ef2e-4ecd-bfbe-619ba380493f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:07:20.013919 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:20.013917    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:07:20.014058 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:20.013928    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xzqg4 for pod openshift-network-diagnostics/network-check-target-7k6dt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:07:20.014058 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:20.013985    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4 podName:83a17801-1225-46d6-9b58-4a1c7e0c0534 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:21.013969581 +0000 UTC m=+3.977402896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzqg4" (UniqueName: "kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4") pod "network-check-target-7k6dt" (UID: "83a17801-1225-46d6-9b58-4a1c7e0c0534") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:07:20.114544 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:20.114498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret\") pod \"global-pull-secret-syncer-4rpk9\" (UID: \"dee8ea60-68c5-4775-adbe-0f7a82fca7a3\") " pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:20.114718 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:20.114701    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:07:20.114798 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:20.114767    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret podName:dee8ea60-68c5-4775-adbe-0f7a82fca7a3 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:21.114750188 +0000 UTC m=+4.078183503 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret") pod "global-pull-secret-syncer-4rpk9" (UID: "dee8ea60-68c5-4775-adbe-0f7a82fca7a3") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:07:20.272445 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:20.272356    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:07:20.437097 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:20.437037    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 23:02:19 +0000 UTC" deadline="2028-03-14 13:40:07.131624118 +0000 UTC"
Jul 02 23:07:20.437097 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:20.437094    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14894h32m46.694534989s"
Jul 02 23:07:20.520817 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:20.520601    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35593682_d5e7_4cc6_a1dc_357ba50f2eb0.slice/crio-5ae47cb4af6b2b3b13ccc250a4abe2a5a1a8dd924eee28f2215208603bf436b7 WatchSource:0}: Error finding container 5ae47cb4af6b2b3b13ccc250a4abe2a5a1a8dd924eee28f2215208603bf436b7: Status 404 returned error can't find the container with id 5ae47cb4af6b2b3b13ccc250a4abe2a5a1a8dd924eee28f2215208603bf436b7
Jul 02 23:07:20.522129 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:20.522104    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd678eb0f_28ce_4df0_9989_2c96ed3d2a67.slice/crio-6ba75cc37ef68f16d8351bcd7e98131a170c838f79cd0675e9b9888c25cfc2e7 WatchSource:0}: Error finding container 6ba75cc37ef68f16d8351bcd7e98131a170c838f79cd0675e9b9888c25cfc2e7: Status 404 returned error can't find the container with id 6ba75cc37ef68f16d8351bcd7e98131a170c838f79cd0675e9b9888c25cfc2e7
Jul 02 23:07:20.530652 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:20.530623    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3438e6dd_0c4b_4a90_8cb0_53a76863f603.slice/crio-cb10d8b84c038542e0c9e070db75317daa6f32b1a16ff4b500fb8ad0f863f4bf WatchSource:0}: Error finding container cb10d8b84c038542e0c9e070db75317daa6f32b1a16ff4b500fb8ad0f863f4bf: Status 404 returned error can't find the container with id cb10d8b84c038542e0c9e070db75317daa6f32b1a16ff4b500fb8ad0f863f4bf
Jul 02 23:07:20.531723 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:20.531698    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb99491c3_0d67_483e_91e4_0022e54bbb90.slice/crio-e5f1c508e7744f8378a6b6e356a1d28ce0d58ae48b74fc9335157fa3de50b00d WatchSource:0}: Error finding container e5f1c508e7744f8378a6b6e356a1d28ce0d58ae48b74fc9335157fa3de50b00d: Status 404 returned error can't find the container with id e5f1c508e7744f8378a6b6e356a1d28ce0d58ae48b74fc9335157fa3de50b00d
Jul 02 23:07:20.577355 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:20.577138    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jxk2s" event={"ID":"25ecfdbf-2d20-4557-831c-365fac161de9","Type":"ContainerStarted","Data":"6672a6a71b0b037c380e114050140ee5e384c845400b443960ce902b13ac1c59"}
Jul 02 23:07:20.578259 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:20.578232    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k9m8v" event={"ID":"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9","Type":"ContainerStarted","Data":"26a2a3a81c5d8c1caaa8b90679ffee15485ef87a1bbde64d81fbc7949bc3ddad"}
Jul 02 23:07:20.579268 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:20.579245    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pfw6k" event={"ID":"c8313031-435c-431f-8f7e-81d7ab30feab","Type":"ContainerStarted","Data":"c578eb01cdc370bb902295fe3de7a521ce5990454f1f7ebefa3e791c34a70943"}
Jul 02 23:07:20.580491 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:20.580472    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t" event={"ID":"b99491c3-0d67-483e-91e4-0022e54bbb90","Type":"ContainerStarted","Data":"e5f1c508e7744f8378a6b6e356a1d28ce0d58ae48b74fc9335157fa3de50b00d"}
Jul 02 23:07:20.581591 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:20.581569    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl" event={"ID":"d678eb0f-28ce-4df0-9989-2c96ed3d2a67","Type":"ContainerStarted","Data":"6ba75cc37ef68f16d8351bcd7e98131a170c838f79cd0675e9b9888c25cfc2e7"}
Jul 02 23:07:20.582557 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:20.582533    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8lxpz" event={"ID":"35593682-d5e7-4cc6-a1dc-357ba50f2eb0","Type":"ContainerStarted","Data":"5ae47cb4af6b2b3b13ccc250a4abe2a5a1a8dd924eee28f2215208603bf436b7"}
Jul 02 23:07:20.583605 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:20.583581    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fdp9l" event={"ID":"d909661b-ea6e-417b-8b1c-a0260bf28058","Type":"ContainerStarted","Data":"78878c84de2184fea1907cdd7b33c02e99d78a6dcdf3c97e5cda03066cf9ed68"}
Jul 02 23:07:20.584692 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:20.584647    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdhkd" event={"ID":"e0451a6f-879b-490d-a413-df7e1e20a6b4","Type":"ContainerStarted","Data":"5f826c04473c26a82250dda11f2a723583ff17feaec398a63fb5100255ba20f7"}
Jul 02 23:07:20.585756 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:20.585737    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bjnvr" event={"ID":"3438e6dd-0c4b-4a90-8cb0-53a76863f603","Type":"ContainerStarted","Data":"cb10d8b84c038542e0c9e070db75317daa6f32b1a16ff4b500fb8ad0f863f4bf"}
Jul 02 23:07:21.021099 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:21.020970    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqg4\" (UniqueName: \"kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4\") pod \"network-check-target-7k6dt\" (UID: \"83a17801-1225-46d6-9b58-4a1c7e0c0534\") " pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:21.021099 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:21.021066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs\") pod \"network-metrics-daemon-27zv5\" (UID: \"9b58b91e-ef2e-4ecd-bfbe-619ba380493f\") " pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:21.021319 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:21.021197    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:07:21.021319 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:21.021262    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs podName:9b58b91e-ef2e-4ecd-bfbe-619ba380493f nodeName:}" failed. No retries permitted until 2026-07-02 23:07:23.021243264 +0000 UTC m=+5.984676577 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs") pod "network-metrics-daemon-27zv5" (UID: "9b58b91e-ef2e-4ecd-bfbe-619ba380493f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:07:21.021437 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:21.021356    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:07:21.021437 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:21.021374    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:07:21.021437 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:21.021387    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xzqg4 for pod openshift-network-diagnostics/network-check-target-7k6dt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:07:21.021437 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:21.021429    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4 podName:83a17801-1225-46d6-9b58-4a1c7e0c0534 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:23.021416003 +0000 UTC m=+5.984849337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzqg4" (UniqueName: "kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4") pod "network-check-target-7k6dt" (UID: "83a17801-1225-46d6-9b58-4a1c7e0c0534") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:07:21.122369 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:21.121682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret\") pod \"global-pull-secret-syncer-4rpk9\" (UID: \"dee8ea60-68c5-4775-adbe-0f7a82fca7a3\") " pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:21.122369 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:21.121916    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:07:21.122369 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:21.121995    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret podName:dee8ea60-68c5-4775-adbe-0f7a82fca7a3 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:23.121976499 +0000 UTC m=+6.085409813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret") pod "global-pull-secret-syncer-4rpk9" (UID: "dee8ea60-68c5-4775-adbe-0f7a82fca7a3") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:07:21.191385 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:21.191354    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 23:07:21.437523 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:21.437407    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 23:02:19 +0000 UTC" deadline="2028-01-15 16:41:30.607240588 +0000 UTC"
Jul 02 23:07:21.437523 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:21.437463    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13481h34m9.169782974s"
Jul 02 23:07:21.568143 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:21.568107    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:21.568324 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:21.568240    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rpk9" podUID="dee8ea60-68c5-4775-adbe-0f7a82fca7a3"
Jul 02 23:07:21.568385 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:21.568325    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:21.568438 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:21.568402    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27zv5" podUID="9b58b91e-ef2e-4ecd-bfbe-619ba380493f"
Jul 02 23:07:21.568489 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:21.568465    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:21.568546 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:21.568527    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k6dt" podUID="83a17801-1225-46d6-9b58-4a1c7e0c0534"
Jul 02 23:07:21.606072 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:21.606028    2581 generic.go:356] "Generic (PLEG): container finished" podID="5e0da935ef858da2c612dd00c085dac0" containerID="8bc05c10b3ed5f5fd7f42afa4cb67792e0782bdaa3c4541e9e287b66f66b71e6" exitCode=0
Jul 02 23:07:21.606231 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:21.606122    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" event={"ID":"5e0da935ef858da2c612dd00c085dac0","Type":"ContainerDied","Data":"8bc05c10b3ed5f5fd7f42afa4cb67792e0782bdaa3c4541e9e287b66f66b71e6"}
Jul 02 23:07:21.611884 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:21.611839    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" event={"ID":"c289d765ebaf73084c7d6f9e7be86f96","Type":"ContainerStarted","Data":"4f5c2e5264de3956383e4ba5fc835e2e81f3bdaed90ad287423b1c77e5ff3ee6"}
Jul 02 23:07:21.644410 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:21.644329    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-220.ec2.internal" podStartSLOduration=3.644306131 podStartE2EDuration="3.644306131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:21.643808793 +0000 UTC m=+4.607242126" watchObservedRunningTime="2026-07-02 23:07:21.644306131 +0000 UTC m=+4.607739467"
Jul 02 23:07:22.641995 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:22.641810    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" event={"ID":"5e0da935ef858da2c612dd00c085dac0","Type":"ContainerStarted","Data":"9f7d7b4e4c2a2f58673c8ab71a70fc67380d79480162adc8c52f0c9ea5384543"}
Jul 02 23:07:23.038662 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:23.038578    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs\") pod \"network-metrics-daemon-27zv5\" (UID: \"9b58b91e-ef2e-4ecd-bfbe-619ba380493f\") " pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:23.038662 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:23.038654    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqg4\" (UniqueName: \"kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4\") pod \"network-check-target-7k6dt\" (UID: \"83a17801-1225-46d6-9b58-4a1c7e0c0534\") " pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:23.038919 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:23.038795    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:07:23.038919 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:23.038811    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:07:23.038919 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:23.038822    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xzqg4 for pod openshift-network-diagnostics/network-check-target-7k6dt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:07:23.038919 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:23.038899    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4 podName:83a17801-1225-46d6-9b58-4a1c7e0c0534 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:27.038861626 +0000 UTC m=+10.002294953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzqg4" (UniqueName: "kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4") pod "network-check-target-7k6dt" (UID: "83a17801-1225-46d6-9b58-4a1c7e0c0534") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:07:23.039389 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:23.039369    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:07:23.039481 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:23.039424    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs podName:9b58b91e-ef2e-4ecd-bfbe-619ba380493f nodeName:}" failed. No retries permitted until 2026-07-02 23:07:27.039409305 +0000 UTC m=+10.002842620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs") pod "network-metrics-daemon-27zv5" (UID: "9b58b91e-ef2e-4ecd-bfbe-619ba380493f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:07:23.140210 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:23.139582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret\") pod \"global-pull-secret-syncer-4rpk9\" (UID: \"dee8ea60-68c5-4775-adbe-0f7a82fca7a3\") " pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:23.140210 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:23.139748    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:07:23.140210 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:23.139819    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret podName:dee8ea60-68c5-4775-adbe-0f7a82fca7a3 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:27.139800627 +0000 UTC m=+10.103233951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret") pod "global-pull-secret-syncer-4rpk9" (UID: "dee8ea60-68c5-4775-adbe-0f7a82fca7a3") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:07:23.566583 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:23.566099    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:23.566583 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:23.566099    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:23.566583 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:23.566243    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27zv5" podUID="9b58b91e-ef2e-4ecd-bfbe-619ba380493f"
Jul 02 23:07:23.566583 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:23.566255    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:23.566583 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:23.566347    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k6dt" podUID="83a17801-1225-46d6-9b58-4a1c7e0c0534"
Jul 02 23:07:23.566583 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:23.566428    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rpk9" podUID="dee8ea60-68c5-4775-adbe-0f7a82fca7a3"
Jul 02 23:07:25.565481 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:25.565446    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:25.565481 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:25.565481    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:25.566050 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:25.565447    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:25.566050 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:25.565621    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rpk9" podUID="dee8ea60-68c5-4775-adbe-0f7a82fca7a3"
Jul 02 23:07:25.566230 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:25.566162    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27zv5" podUID="9b58b91e-ef2e-4ecd-bfbe-619ba380493f"
Jul 02 23:07:25.566293 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:25.566230    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k6dt" podUID="83a17801-1225-46d6-9b58-4a1c7e0c0534"
Jul 02 23:07:27.073235 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:27.073187    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs\") pod \"network-metrics-daemon-27zv5\" (UID: \"9b58b91e-ef2e-4ecd-bfbe-619ba380493f\") " pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:27.073630 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:27.073259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqg4\" (UniqueName: \"kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4\") pod \"network-check-target-7k6dt\" (UID: \"83a17801-1225-46d6-9b58-4a1c7e0c0534\") " pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:27.073630 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:27.073365    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:07:27.073630 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:27.073393    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:07:27.073630 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:27.073409    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:07:27.073630 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:27.073422    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xzqg4 for pod openshift-network-diagnostics/network-check-target-7k6dt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:07:27.073630 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:27.073442    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs podName:9b58b91e-ef2e-4ecd-bfbe-619ba380493f nodeName:}" failed. No retries permitted until 2026-07-02 23:07:35.073419139 +0000 UTC m=+18.036852474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs") pod "network-metrics-daemon-27zv5" (UID: "9b58b91e-ef2e-4ecd-bfbe-619ba380493f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:07:27.073630 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:27.073468    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4 podName:83a17801-1225-46d6-9b58-4a1c7e0c0534 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:35.073453729 +0000 UTC m=+18.036887055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzqg4" (UniqueName: "kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4") pod "network-check-target-7k6dt" (UID: "83a17801-1225-46d6-9b58-4a1c7e0c0534") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:07:27.173989 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:27.173936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret\") pod \"global-pull-secret-syncer-4rpk9\" (UID: \"dee8ea60-68c5-4775-adbe-0f7a82fca7a3\") " pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:27.174162 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:27.174087    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:07:27.174162 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:27.174156    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret podName:dee8ea60-68c5-4775-adbe-0f7a82fca7a3 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:35.174137063 +0000 UTC m=+18.137570397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret") pod "global-pull-secret-syncer-4rpk9" (UID: "dee8ea60-68c5-4775-adbe-0f7a82fca7a3") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:07:27.567457 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:27.566954    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:27.567457 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:27.566980    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:27.567457 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:27.566987    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:27.567457 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:27.567078    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27zv5" podUID="9b58b91e-ef2e-4ecd-bfbe-619ba380493f"
Jul 02 23:07:27.567457 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:27.567231    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k6dt" podUID="83a17801-1225-46d6-9b58-4a1c7e0c0534"
Jul 02 23:07:27.567457 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:27.567310    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rpk9" podUID="dee8ea60-68c5-4775-adbe-0f7a82fca7a3"
Jul 02 23:07:29.568305 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:29.568269    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:29.568748 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:29.568399    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k6dt" podUID="83a17801-1225-46d6-9b58-4a1c7e0c0534"
Jul 02 23:07:29.568748 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:29.568730    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:29.568902 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:29.568800    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rpk9" podUID="dee8ea60-68c5-4775-adbe-0f7a82fca7a3"
Jul 02 23:07:29.568902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:29.568847    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:29.568997 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:29.568939    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27zv5" podUID="9b58b91e-ef2e-4ecd-bfbe-619ba380493f"
Jul 02 23:07:31.566271 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:31.566241    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:31.566673 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:31.566241    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:31.566673 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:31.566357    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k6dt" podUID="83a17801-1225-46d6-9b58-4a1c7e0c0534"
Jul 02 23:07:31.566673 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:31.566243    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:31.566673 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:31.566433    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27zv5" podUID="9b58b91e-ef2e-4ecd-bfbe-619ba380493f"
Jul 02 23:07:31.566673 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:31.566530    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rpk9" podUID="dee8ea60-68c5-4775-adbe-0f7a82fca7a3"
Jul 02 23:07:33.565888 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:33.565796    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:33.565888 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:33.565813    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:33.566438 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:33.565981    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:33.566438 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:33.565998    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rpk9" podUID="dee8ea60-68c5-4775-adbe-0f7a82fca7a3"
Jul 02 23:07:33.566438 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:33.566112    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k6dt" podUID="83a17801-1225-46d6-9b58-4a1c7e0c0534"
Jul 02 23:07:33.566438 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:33.566227    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27zv5" podUID="9b58b91e-ef2e-4ecd-bfbe-619ba380493f"
Jul 02 23:07:35.139748 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:35.139709    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs\") pod \"network-metrics-daemon-27zv5\" (UID: \"9b58b91e-ef2e-4ecd-bfbe-619ba380493f\") " pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:35.140219 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:35.139786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqg4\" (UniqueName: \"kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4\") pod \"network-check-target-7k6dt\" (UID: \"83a17801-1225-46d6-9b58-4a1c7e0c0534\") " pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:35.140219 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:35.139902    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:07:35.140219 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:35.139954    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:07:35.140219 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:35.139971    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:07:35.140219 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:35.139983    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xzqg4 for pod openshift-network-diagnostics/network-check-target-7k6dt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:07:35.140219 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:35.139989    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs podName:9b58b91e-ef2e-4ecd-bfbe-619ba380493f nodeName:}" failed. No retries permitted until 2026-07-02 23:07:51.139966922 +0000 UTC m=+34.103400246 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs") pod "network-metrics-daemon-27zv5" (UID: "9b58b91e-ef2e-4ecd-bfbe-619ba380493f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:07:35.140219 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:35.140034    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4 podName:83a17801-1225-46d6-9b58-4a1c7e0c0534 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:51.14001708 +0000 UTC m=+34.103450411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzqg4" (UniqueName: "kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4") pod "network-check-target-7k6dt" (UID: "83a17801-1225-46d6-9b58-4a1c7e0c0534") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:07:35.241154 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:35.241120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret\") pod \"global-pull-secret-syncer-4rpk9\" (UID: \"dee8ea60-68c5-4775-adbe-0f7a82fca7a3\") " pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:35.241329 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:35.241291    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:07:35.241386 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:35.241367    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret podName:dee8ea60-68c5-4775-adbe-0f7a82fca7a3 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:51.241349509 +0000 UTC m=+34.204782824 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret") pod "global-pull-secret-syncer-4rpk9" (UID: "dee8ea60-68c5-4775-adbe-0f7a82fca7a3") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:07:35.566060 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:35.565977    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:35.566060 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:35.566023    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:35.566262 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:35.565977    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:35.566262 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:35.566117    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rpk9" podUID="dee8ea60-68c5-4775-adbe-0f7a82fca7a3"
Jul 02 23:07:35.566262 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:35.566212    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k6dt" podUID="83a17801-1225-46d6-9b58-4a1c7e0c0534"
Jul 02 23:07:35.566456 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:35.566311    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27zv5" podUID="9b58b91e-ef2e-4ecd-bfbe-619ba380493f"
Jul 02 23:07:37.566688 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:37.566660    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:37.567182 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:37.566764    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rpk9" podUID="dee8ea60-68c5-4775-adbe-0f7a82fca7a3"
Jul 02 23:07:37.567182 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:37.566860    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:37.567182 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:37.567005    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27zv5" podUID="9b58b91e-ef2e-4ecd-bfbe-619ba380493f"
Jul 02 23:07:37.567182 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:37.567032    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:37.567182 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:37.567095    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k6dt" podUID="83a17801-1225-46d6-9b58-4a1c7e0c0534"
Jul 02 23:07:39.566243 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:39.566201    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:39.566936 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:39.566346    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rpk9" podUID="dee8ea60-68c5-4775-adbe-0f7a82fca7a3"
Jul 02 23:07:39.566936 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:39.566205    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:39.566936 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:39.566425    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k6dt" podUID="83a17801-1225-46d6-9b58-4a1c7e0c0534"
Jul 02 23:07:39.566936 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:39.566202    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:39.566936 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:39.566498    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27zv5" podUID="9b58b91e-ef2e-4ecd-bfbe-619ba380493f"
Jul 02 23:07:40.693621 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.693257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fdp9l" event={"ID":"d909661b-ea6e-417b-8b1c-a0260bf28058","Type":"ContainerStarted","Data":"03ad9c4b9ca3e1582651bf1cc77e6c7fe3db70dc2ef49c71f1eff20b0e9767e5"}
Jul 02 23:07:40.694918 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.694891    2581 generic.go:356] "Generic (PLEG): container finished" podID="e0451a6f-879b-490d-a413-df7e1e20a6b4" containerID="c30bc18cb12bc99cbaa42beb034409b9b3b2ff9be1bffd7669bace5ac2e1907d" exitCode=0
Jul 02 23:07:40.695038 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.694976    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdhkd" event={"ID":"e0451a6f-879b-490d-a413-df7e1e20a6b4","Type":"ContainerDied","Data":"c30bc18cb12bc99cbaa42beb034409b9b3b2ff9be1bffd7669bace5ac2e1907d"}
Jul 02 23:07:40.697392 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.697364    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bjnvr" event={"ID":"3438e6dd-0c4b-4a90-8cb0-53a76863f603","Type":"ContainerStarted","Data":"0cb479e44755d148ee7bc8266b72e5380d60d9286909ddadd22840a0a7a3b715"}
Jul 02 23:07:40.699343 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.699065    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jxk2s" event={"ID":"25ecfdbf-2d20-4557-831c-365fac161de9","Type":"ContainerStarted","Data":"2a8da2712ed4c8e440ffd87065f62f9bda24ad36ad89dd69a5c080d69d933f5b"}
Jul 02 23:07:40.700772 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.700737    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k9m8v" event={"ID":"4e5de9cc-16a7-40ce-b2f8-9ace191c44c9","Type":"ContainerStarted","Data":"cf40396603ce5cab3e95e7653bcdc6ec640c77af7336235058a89f4ab9568926"}
Jul 02 23:07:40.702282 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.702241    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pfw6k" event={"ID":"c8313031-435c-431f-8f7e-81d7ab30feab","Type":"ContainerStarted","Data":"c84248788770f25340e2b4c51fea9a22cf0ffe750a80d60d88f2caeac8feac02"}
Jul 02 23:07:40.705781 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.705758    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t" event={"ID":"b99491c3-0d67-483e-91e4-0022e54bbb90","Type":"ContainerStarted","Data":"e33456b06bee971b6356adf979ccd2d086597e741b5a5515bfa2ebccf36b713b"}
Jul 02 23:07:40.705915 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.705827    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t" event={"ID":"b99491c3-0d67-483e-91e4-0022e54bbb90","Type":"ContainerStarted","Data":"87e4f82a23514a4273ea9e9718ee83b735dcb13cfd31351c202677e3455e65c8"}
Jul 02 23:07:40.705915 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.705894    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t" event={"ID":"b99491c3-0d67-483e-91e4-0022e54bbb90","Type":"ContainerStarted","Data":"0d882b2091b841348e2f77434a9168d5e5230711ecf9cb05fe9a41023f7d3a19"}
Jul 02 23:07:40.706045 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.705938    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t" event={"ID":"b99491c3-0d67-483e-91e4-0022e54bbb90","Type":"ContainerStarted","Data":"c9175fb1ae5ca28df5937e9f75f1de5330dc3def469aa3734ac0bee3c281fac1"}
Jul 02 23:07:40.706045 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.705993    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t" event={"ID":"b99491c3-0d67-483e-91e4-0022e54bbb90","Type":"ContainerStarted","Data":"9228e4a45442407dbe0042ee254b74c96a75357644025430c654bfb01e198ff0"}
Jul 02 23:07:40.706045 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.706044    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t" event={"ID":"b99491c3-0d67-483e-91e4-0022e54bbb90","Type":"ContainerStarted","Data":"1e10729095a062ab31f389b40fb11a024c609b52809607331796c1952c08d678"}
Jul 02 23:07:40.707712 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.707201    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fdp9l" podStartSLOduration=4.602785104 podStartE2EDuration="23.707184174s" totalImagesPullingTime="19.10439907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:40.706618679 +0000 UTC m=+23.670052013" watchObservedRunningTime="2026-07-02 23:07:40.707184174 +0000 UTC m=+23.670617509"
Jul 02 23:07:40.707712 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.707294    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-220.ec2.internal" podStartSLOduration=22.707286047 podStartE2EDuration="22.707286047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:22.659071133 +0000 UTC m=+5.622504469" watchObservedRunningTime="2026-07-02 23:07:40.707286047 +0000 UTC m=+23.670719382"
Jul 02 23:07:40.707712 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.707610    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl" event={"ID":"d678eb0f-28ce-4df0-9989-2c96ed3d2a67","Type":"ContainerStarted","Data":"4afaaf25ebd4e9041a7a62c26fcee410a264b1c30a0e0b75ad4516e92b91ee86"}
Jul 02 23:07:40.752713 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.752623    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bjnvr" podStartSLOduration=8.332686621 podStartE2EDuration="23.752606579s" totalImagesPullingTime="15.419919958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:40.752552202 +0000 UTC m=+23.715985532" watchObservedRunningTime="2026-07-02 23:07:40.752606579 +0000 UTC m=+23.716039906"
Jul 02 23:07:40.768965 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.768915    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k9m8v" podStartSLOduration=4.593505952 podStartE2EDuration="23.768898043s" totalImagesPullingTime="19.175392091s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:40.767994771 +0000 UTC m=+23.731428104" watchObservedRunningTime="2026-07-02 23:07:40.768898043 +0000 UTC m=+23.732331370"
Jul 02 23:07:40.781563 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.781523    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jxk2s" podStartSLOduration=4.664088057 podStartE2EDuration="23.781507672s" totalImagesPullingTime="19.117419615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:40.780998995 +0000 UTC m=+23.744432328" watchObservedRunningTime="2026-07-02 23:07:40.781507672 +0000 UTC m=+23.744941004"
Jul 02 23:07:40.796517 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.796471    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pfw6k" podStartSLOduration=4.670456854 podStartE2EDuration="23.79645612s" totalImagesPullingTime="19.125999266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:40.796270931 +0000 UTC m=+23.759704265" watchObservedRunningTime="2026-07-02 23:07:40.79645612 +0000 UTC m=+23.759889474"
Jul 02 23:07:40.903490 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.903457    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:40.954378 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:40.954347    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:41.022262 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:41.022237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:41.110244 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:41.110215    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 23:07:41.407714 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:41.407519    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:41.474024 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:41.473895    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T23:07:41.11023785Z","UUID":"30856d9e-1a7f-4c35-8f54-240e9590bafa","Handler":null,"Name":"","Endpoint":""}
Jul 02 23:07:41.475567 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:41.475534    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 23:07:41.475683 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:41.475579    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 23:07:41.507209 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:41.507179    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:41.565655 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:41.565620    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:41.565896 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:41.565628    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:41.565980 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:41.565919    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k6dt" podUID="83a17801-1225-46d6-9b58-4a1c7e0c0534"
Jul 02 23:07:41.566293 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:41.565765    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:41.566293 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:41.565778    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27zv5" podUID="9b58b91e-ef2e-4ecd-bfbe-619ba380493f"
Jul 02 23:07:41.566564 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:41.566532    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rpk9" podUID="dee8ea60-68c5-4775-adbe-0f7a82fca7a3"
Jul 02 23:07:41.712007 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:41.711922    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl" event={"ID":"d678eb0f-28ce-4df0-9989-2c96ed3d2a67","Type":"ContainerStarted","Data":"121c6a44db0cc5c137417b200002793b733f67cea36567d06eaab516ac4519a1"}
Jul 02 23:07:41.713577 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:41.713540    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8lxpz" event={"ID":"35593682-d5e7-4cc6-a1dc-357ba50f2eb0","Type":"ContainerStarted","Data":"4f6772d69839549cd8cb6c4c8f4a02738dac82517baa97dedab621d93d90ed6a"}
Jul 02 23:07:41.728062 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:41.728005    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8lxpz" podStartSLOduration=5.606126165 podStartE2EDuration="24.72798684s" totalImagesPullingTime="19.121860675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:41.727607195 +0000 UTC m=+24.691040528" watchObservedRunningTime="2026-07-02 23:07:41.72798684 +0000 UTC m=+24.691420175"
Jul 02 23:07:42.205222 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:42.205195    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:42.570001 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:42.569700    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bjnvr"
Jul 02 23:07:42.570366 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:42.570346    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bjnvr"
Jul 02 23:07:42.594395 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:42.594353    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:42.647066 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:42.647028    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:42.719814 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:42.719733    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t" event={"ID":"b99491c3-0d67-483e-91e4-0022e54bbb90","Type":"ContainerStarted","Data":"ed5cf49ec2a3054ea8e786fc813c8774fc3b5209d134044a245c34de4e13d12a"}
Jul 02 23:07:42.722098 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:42.722068    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl" event={"ID":"d678eb0f-28ce-4df0-9989-2c96ed3d2a67","Type":"ContainerStarted","Data":"3b25dc77894ea908d1603cc76516a141059751d96535ab69bb67e036496ac3c6"}
Jul 02 23:07:42.722653 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:42.722633    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bjnvr"
Jul 02 23:07:42.722979 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:42.722959    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bjnvr"
Jul 02 23:07:42.738235 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:42.738188    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fn9zl" podStartSLOduration=4.44023353 podStartE2EDuration="25.738170928s" totalImagesPullingTime="21.297937398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:17 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:42.737865724 +0000 UTC m=+25.701299060" watchObservedRunningTime="2026-07-02 23:07:42.738170928 +0000 UTC m=+25.701604263"
Jul 02 23:07:42.802299 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:42.802268    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:43.566090 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:43.566059    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:43.566302 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:43.566184    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rpk9" podUID="dee8ea60-68c5-4775-adbe-0f7a82fca7a3"
Jul 02 23:07:43.566302 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:43.566059    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:43.566302 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:43.566282    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27zv5" podUID="9b58b91e-ef2e-4ecd-bfbe-619ba380493f"
Jul 02 23:07:43.566302 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:43.566059    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:43.566464 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:43.566356    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k6dt" podUID="83a17801-1225-46d6-9b58-4a1c7e0c0534"
Jul 02 23:07:43.926052 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:43.925979    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:43.976068 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:43.976039    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:45.566630 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:45.566402    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:45.566630 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:45.566401    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:45.566630 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:45.566621    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k6dt" podUID="83a17801-1225-46d6-9b58-4a1c7e0c0534"
Jul 02 23:07:45.567414 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:45.566705    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27zv5" podUID="9b58b91e-ef2e-4ecd-bfbe-619ba380493f"
Jul 02 23:07:45.567414 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:45.566450    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:45.567414 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:45.566779    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rpk9" podUID="dee8ea60-68c5-4775-adbe-0f7a82fca7a3"
Jul 02 23:07:45.732523 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:45.732498    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t" event={"ID":"b99491c3-0d67-483e-91e4-0022e54bbb90","Type":"ContainerStarted","Data":"b738d9d37f7c97ad7f896b4d43e6e4a4833eab088acaa429f0a45279d4b349fe"}
Jul 02 23:07:45.732849 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:45.732827    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:45.748336 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:45.748313    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:45.756762 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:45.756724    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t" podStartSLOduration=9.588012718 podStartE2EDuration="28.756709639s" totalImagesPullingTime="19.168696921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:45.756131374 +0000 UTC m=+28.719564732" watchObservedRunningTime="2026-07-02 23:07:45.756709639 +0000 UTC m=+28.720142953"
Jul 02 23:07:46.736556 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:46.736518    2581 generic.go:356] "Generic (PLEG): container finished" podID="e0451a6f-879b-490d-a413-df7e1e20a6b4" containerID="b0a99e95a7f0a18d5278abe7ba2e52529df208b3fb66f44f1721e3d37f1f6f4d" exitCode=0
Jul 02 23:07:46.737179 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:46.736597    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdhkd" event={"ID":"e0451a6f-879b-490d-a413-df7e1e20a6b4","Type":"ContainerDied","Data":"b0a99e95a7f0a18d5278abe7ba2e52529df208b3fb66f44f1721e3d37f1f6f4d"}
Jul 02 23:07:46.737179 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:46.737053    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:46.737179 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:46.737129    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:46.754294 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:46.754273    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:07:47.378035 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:47.377767    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4rpk9"]
Jul 02 23:07:47.378202 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:47.378150    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:47.378286 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:47.378263    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rpk9" podUID="dee8ea60-68c5-4775-adbe-0f7a82fca7a3"
Jul 02 23:07:47.380419 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:47.380391    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-27zv5"]
Jul 02 23:07:47.380534 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:47.380515    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:47.380651 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:47.380629    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27zv5" podUID="9b58b91e-ef2e-4ecd-bfbe-619ba380493f"
Jul 02 23:07:47.381602 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:47.381583    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7k6dt"]
Jul 02 23:07:47.381726 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:47.381665    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:47.381796 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:47.381740    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k6dt" podUID="83a17801-1225-46d6-9b58-4a1c7e0c0534"
Jul 02 23:07:48.565946 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:48.565914    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:48.566419 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:48.566040    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27zv5" podUID="9b58b91e-ef2e-4ecd-bfbe-619ba380493f"
Jul 02 23:07:48.743165 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:48.743129    2581 generic.go:356] "Generic (PLEG): container finished" podID="e0451a6f-879b-490d-a413-df7e1e20a6b4" containerID="06156c391debf8668772cf2c109b14e2bf0891b64dbbd06e69e8cc34fa36a083" exitCode=0
Jul 02 23:07:48.743338 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:48.743206    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdhkd" event={"ID":"e0451a6f-879b-490d-a413-df7e1e20a6b4","Type":"ContainerDied","Data":"06156c391debf8668772cf2c109b14e2bf0891b64dbbd06e69e8cc34fa36a083"}
Jul 02 23:07:49.319046 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:49.319016    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:49.568971 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:49.568949    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:49.569457 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:49.568952    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:49.569457 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:49.569046    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rpk9" podUID="dee8ea60-68c5-4775-adbe-0f7a82fca7a3"
Jul 02 23:07:49.569457 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:49.569121    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k6dt" podUID="83a17801-1225-46d6-9b58-4a1c7e0c0534"
Jul 02 23:07:49.748249 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:49.748159    2581 generic.go:356] "Generic (PLEG): container finished" podID="e0451a6f-879b-490d-a413-df7e1e20a6b4" containerID="0e7b86ad143e7e52a396c66b51048e06e2088e0dee12f12d453a19c717797e61" exitCode=0
Jul 02 23:07:49.748249 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:49.748223    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdhkd" event={"ID":"e0451a6f-879b-490d-a413-df7e1e20a6b4","Type":"ContainerDied","Data":"0e7b86ad143e7e52a396c66b51048e06e2088e0dee12f12d453a19c717797e61"}
Jul 02 23:07:50.370287 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:50.370253    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:50.519329 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:50.519291    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:50.566391 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:50.566362    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:50.566559 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:50.566502    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-27zv5" podUID="9b58b91e-ef2e-4ecd-bfbe-619ba380493f"
Jul 02 23:07:50.633749 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:50.633663    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:50.719192 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:50.719159    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:50.819486 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:50.819442    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:50.919747 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:50.919663    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:51.152811 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:51.152765    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs\") pod \"network-metrics-daemon-27zv5\" (UID: \"9b58b91e-ef2e-4ecd-bfbe-619ba380493f\") " pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:51.153011 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:51.152839    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqg4\" (UniqueName: \"kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4\") pod \"network-check-target-7k6dt\" (UID: \"83a17801-1225-46d6-9b58-4a1c7e0c0534\") " pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:51.153011 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:51.152959    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:07:51.153011 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:51.152986    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 23:07:51.153011 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:51.153005    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 23:07:51.153011 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:51.153016    2581 projected.go:196] Error preparing data for projected volume kube-api-access-xzqg4 for pod openshift-network-diagnostics/network-check-target-7k6dt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:07:51.153257 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:51.153034    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs podName:9b58b91e-ef2e-4ecd-bfbe-619ba380493f nodeName:}" failed. No retries permitted until 2026-07-02 23:08:23.153012727 +0000 UTC m=+66.116446041 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs") pod "network-metrics-daemon-27zv5" (UID: "9b58b91e-ef2e-4ecd-bfbe-619ba380493f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 23:07:51.153257 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:51.153060    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4 podName:83a17801-1225-46d6-9b58-4a1c7e0c0534 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:23.153046021 +0000 UTC m=+66.116479375 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzqg4" (UniqueName: "kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4") pod "network-check-target-7k6dt" (UID: "83a17801-1225-46d6-9b58-4a1c7e0c0534") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 23:07:51.254067 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:51.253974    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret\") pod \"global-pull-secret-syncer-4rpk9\" (UID: \"dee8ea60-68c5-4775-adbe-0f7a82fca7a3\") " pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:51.254251 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:51.254138    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 23:07:51.254251 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:51.254231    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret podName:dee8ea60-68c5-4775-adbe-0f7a82fca7a3 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:23.254209732 +0000 UTC m=+66.217643062 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret") pod "global-pull-secret-syncer-4rpk9" (UID: "dee8ea60-68c5-4775-adbe-0f7a82fca7a3") : object "kube-system"/"original-pull-secret" not registered
Jul 02 23:07:51.303684 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:51.303646    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:51.404355 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:51.404297    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:51.547710 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:51.547678    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fdp9l_d909661b-ea6e-417b-8b1c-a0260bf28058/dns-node-resolver/0.log"
Jul 02 23:07:51.554868 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:51.554823    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:51.569246 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:51.569226    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:51.569395 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:51.569225    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:51.569395 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:51.569335    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k6dt" podUID="83a17801-1225-46d6-9b58-4a1c7e0c0534"
Jul 02 23:07:51.569481 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:51.569396    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4rpk9" podUID="dee8ea60-68c5-4775-adbe-0f7a82fca7a3"
Jul 02 23:07:51.654835 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:51.654797    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:52.301786 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.301753    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-220.ec2.internal" event="NodeReady"
Jul 02 23:07:52.301988 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.301928    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 23:07:52.334630 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.334592    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7749c8cbb8-qrfgl"]
Jul 02 23:07:52.336756 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.336731    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.339004 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.338982    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 23:07:52.339004 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.339002    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mpx6s\""
Jul 02 23:07:52.339184 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.339166    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 23:07:52.339469 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.339452    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 23:07:52.343160 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.343120    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7r4br"]
Jul 02 23:07:52.344774 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.344746    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7r4br"
Jul 02 23:07:52.344894 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.344837    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 23:07:52.346901 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.346741    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rwcd4\""
Jul 02 23:07:52.346990 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.346973    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 23:07:52.346990 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.346985    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 23:07:52.347123 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.347010    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 23:07:52.349541 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.349500    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4gc2w"]
Jul 02 23:07:52.352759 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.352738    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7749c8cbb8-qrfgl"]
Jul 02 23:07:52.352865 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.352851    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:52.354628 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.354608    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7r4br"]
Jul 02 23:07:52.356517 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.354984    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 23:07:52.356517 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.355260    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 23:07:52.356517 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.355424    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 23:07:52.356517 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.355649    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 23:07:52.356517 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.356377    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xpm5t\""
Jul 02 23:07:52.364550 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.364527    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4gc2w"]
Jul 02 23:07:52.365109 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.365090    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zc557"]
Jul 02 23:07:52.366857 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.366836    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zc557"
Jul 02 23:07:52.369326 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.369079    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 23:07:52.369326 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.369090    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dl5xp\""
Jul 02 23:07:52.369326 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.369084    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 23:07:52.379472 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.379447    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zc557"]
Jul 02 23:07:52.464067 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.463982    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3320abb0-4218-4bcb-a023-1d267b06df39-data-volume\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:52.464067 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3320abb0-4218-4bcb-a023-1d267b06df39-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:52.464273 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464080    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a467ba7c-cf83-46e6-94fc-07bdd59d653e-cert\") pod \"ingress-canary-7r4br\" (UID: \"a467ba7c-cf83-46e6-94fc-07bdd59d653e\") " pod="openshift-ingress-canary/ingress-canary-7r4br"
Jul 02 23:07:52.464273 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464123    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.464273 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464157    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-ca-trust-extracted\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.464273 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464249    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nrcg\" (UniqueName: \"kubernetes.io/projected/a467ba7c-cf83-46e6-94fc-07bdd59d653e-kube-api-access-5nrcg\") pod \"ingress-canary-7r4br\" (UID: \"a467ba7c-cf83-46e6-94fc-07bdd59d653e\") " pod="openshift-ingress-canary/ingress-canary-7r4br"
Jul 02 23:07:52.464427 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464278    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-bound-sa-token\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.464427 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464314    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:52.464427 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-certificates\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.464427 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-trusted-ca\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.464555 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls\") pod \"dns-default-zc557\" (UID: \"634ade03-7ded-4891-87bf-e73daf8023b5\") " pod="openshift-dns/dns-default-zc557"
Jul 02 23:07:52.464555 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464460    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc8mf\" (UniqueName: \"kubernetes.io/projected/3320abb0-4218-4bcb-a023-1d267b06df39-kube-api-access-rc8mf\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:52.464555 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464505    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/634ade03-7ded-4891-87bf-e73daf8023b5-tmp-dir\") pod \"dns-default-zc557\" (UID: \"634ade03-7ded-4891-87bf-e73daf8023b5\") " pod="openshift-dns/dns-default-zc557"
Jul 02 23:07:52.464555 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464529    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctftf\" (UniqueName: \"kubernetes.io/projected/634ade03-7ded-4891-87bf-e73daf8023b5-kube-api-access-ctftf\") pod \"dns-default-zc557\" (UID: \"634ade03-7ded-4891-87bf-e73daf8023b5\") " pod="openshift-dns/dns-default-zc557"
Jul 02 23:07:52.464680 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464556    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3320abb0-4218-4bcb-a023-1d267b06df39-crio-socket\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:52.464680 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464580    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-installation-pull-secrets\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.464680 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464604    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsjs6\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-kube-api-access-tsjs6\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.464680 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464635    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/634ade03-7ded-4891-87bf-e73daf8023b5-config-volume\") pod \"dns-default-zc557\" (UID: \"634ade03-7ded-4891-87bf-e73daf8023b5\") " pod="openshift-dns/dns-default-zc557"
Jul 02 23:07:52.464816 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.464693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-image-registry-private-configuration\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.472005 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.471964    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:52.545769 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.545746    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jxk2s_25ecfdbf-2d20-4557-831c-365fac161de9/node-ca/0.log"
Jul 02 23:07:52.565041 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565012    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-ca-trust-extracted\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.565188 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565059    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nrcg\" (UniqueName: \"kubernetes.io/projected/a467ba7c-cf83-46e6-94fc-07bdd59d653e-kube-api-access-5nrcg\") pod \"ingress-canary-7r4br\" (UID: \"a467ba7c-cf83-46e6-94fc-07bdd59d653e\") " pod="openshift-ingress-canary/ingress-canary-7r4br"
Jul 02 23:07:52.565188 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-bound-sa-token\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.565311 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:52.565311 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-certificates\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.565311 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-trusted-ca\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.565311 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565284    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls\") pod \"dns-default-zc557\" (UID: \"634ade03-7ded-4891-87bf-e73daf8023b5\") " pod="openshift-dns/dns-default-zc557"
Jul 02 23:07:52.565491 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565312    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc8mf\" (UniqueName: \"kubernetes.io/projected/3320abb0-4218-4bcb-a023-1d267b06df39-kube-api-access-rc8mf\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:52.565491 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:52.565321    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:07:52.565491 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565352    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/634ade03-7ded-4891-87bf-e73daf8023b5-tmp-dir\") pod \"dns-default-zc557\" (UID: \"634ade03-7ded-4891-87bf-e73daf8023b5\") " pod="openshift-dns/dns-default-zc557"
Jul 02 23:07:52.565491 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565363    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:07:52.565491 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565376    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctftf\" (UniqueName: \"kubernetes.io/projected/634ade03-7ded-4891-87bf-e73daf8023b5-kube-api-access-ctftf\") pod \"dns-default-zc557\" (UID: \"634ade03-7ded-4891-87bf-e73daf8023b5\") " pod="openshift-dns/dns-default-zc557"
Jul 02 23:07:52.565491 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:52.565398    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls podName:3320abb0-4218-4bcb-a023-1d267b06df39 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:53.065377338 +0000 UTC m=+36.028810666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4gc2w" (UID: "3320abb0-4218-4bcb-a023-1d267b06df39") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:07:52.565491 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3320abb0-4218-4bcb-a023-1d267b06df39-crio-socket\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:52.565491 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565439    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-ca-trust-extracted\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.565491 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565458    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-installation-pull-secrets\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.565912 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsjs6\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-kube-api-access-tsjs6\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.565912 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565544    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/634ade03-7ded-4891-87bf-e73daf8023b5-config-volume\") pod \"dns-default-zc557\" (UID: \"634ade03-7ded-4891-87bf-e73daf8023b5\") " pod="openshift-dns/dns-default-zc557"
Jul 02 23:07:52.565912 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-image-registry-private-configuration\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.565912 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3320abb0-4218-4bcb-a023-1d267b06df39-data-volume\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:52.565912 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565633    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3320abb0-4218-4bcb-a023-1d267b06df39-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:52.565912 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a467ba7c-cf83-46e6-94fc-07bdd59d653e-cert\") pod \"ingress-canary-7r4br\" (UID: \"a467ba7c-cf83-46e6-94fc-07bdd59d653e\") " pod="openshift-ingress-canary/ingress-canary-7r4br"
Jul 02 23:07:52.565912 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565670    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.565912 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565748    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3320abb0-4218-4bcb-a023-1d267b06df39-crio-socket\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:52.565912 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:52.565766    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:07:52.565912 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.565768    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/634ade03-7ded-4891-87bf-e73daf8023b5-tmp-dir\") pod \"dns-default-zc557\" (UID: \"634ade03-7ded-4891-87bf-e73daf8023b5\") " pod="openshift-dns/dns-default-zc557"
Jul 02 23:07:52.565912 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:52.565778    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7749c8cbb8-qrfgl: secret "image-registry-tls" not found
Jul 02 23:07:52.565912 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:52.565819    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:07:52.565912 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:52.565825    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls podName:fda6ecf7-22ca-4a69-9bcd-6bcd7e497806 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:53.065814883 +0000 UTC m=+36.029248199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls") pod "image-registry-7749c8cbb8-qrfgl" (UID: "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806") : secret "image-registry-tls" not found
Jul 02 23:07:52.565912 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:52.565864    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3320abb0-4218-4bcb-a023-1d267b06df39-kube-rbac-proxy-cm podName:3320abb0-4218-4bcb-a023-1d267b06df39 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:53.06585007 +0000 UTC m=+36.029283402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3320abb0-4218-4bcb-a023-1d267b06df39-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4gc2w" (UID: "3320abb0-4218-4bcb-a023-1d267b06df39") : configmap "kube-rbac-proxy" not found
Jul 02 23:07:52.566539 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.566130    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3320abb0-4218-4bcb-a023-1d267b06df39-data-volume\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:52.566539 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:52.566156    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:07:52.566539 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:52.566211    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls podName:634ade03-7ded-4891-87bf-e73daf8023b5 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:53.066194752 +0000 UTC m=+36.029628080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls") pod "dns-default-zc557" (UID: "634ade03-7ded-4891-87bf-e73daf8023b5") : secret "dns-default-metrics-tls" not found
Jul 02 23:07:52.566539 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.566436    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/634ade03-7ded-4891-87bf-e73daf8023b5-config-volume\") pod \"dns-default-zc557\" (UID: \"634ade03-7ded-4891-87bf-e73daf8023b5\") " pod="openshift-dns/dns-default-zc557"
Jul 02 23:07:52.566539 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.566468    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-certificates\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.566758 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.566735    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-trusted-ca\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.567568 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.567544    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 23:07:52.567721 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.567634    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jkmkq\""
Jul 02 23:07:52.570262 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.570236    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-installation-pull-secrets\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.570360 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.570261    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-image-registry-private-configuration\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.570360 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.570295    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a467ba7c-cf83-46e6-94fc-07bdd59d653e-cert\") pod \"ingress-canary-7r4br\" (UID: \"a467ba7c-cf83-46e6-94fc-07bdd59d653e\") " pod="openshift-ingress-canary/ingress-canary-7r4br"
Jul 02 23:07:52.576268 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.575308    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:52.576268 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.576186    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc8mf\" (UniqueName: \"kubernetes.io/projected/3320abb0-4218-4bcb-a023-1d267b06df39-kube-api-access-rc8mf\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:52.576506 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.576471    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsjs6\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-kube-api-access-tsjs6\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.576561 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.576522    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-bound-sa-token\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:52.576956 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.576934    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctftf\" (UniqueName: \"kubernetes.io/projected/634ade03-7ded-4891-87bf-e73daf8023b5-kube-api-access-ctftf\") pod \"dns-default-zc557\" (UID: \"634ade03-7ded-4891-87bf-e73daf8023b5\") " pod="openshift-dns/dns-default-zc557"
Jul 02 23:07:52.577073 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.577059    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nrcg\" (UniqueName: \"kubernetes.io/projected/a467ba7c-cf83-46e6-94fc-07bdd59d653e-kube-api-access-5nrcg\") pod \"ingress-canary-7r4br\" (UID: \"a467ba7c-cf83-46e6-94fc-07bdd59d653e\") " pod="openshift-ingress-canary/ingress-canary-7r4br"
Jul 02 23:07:52.656429 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.656370    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7r4br"
Jul 02 23:07:52.825513 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.825484    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7r4br"]
Jul 02 23:07:52.830700 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:07:52.830668    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda467ba7c_cf83_46e6_94fc_07bdd59d653e.slice/crio-bb4262b1fd3d303fb33f4bde5c0a59c874ed15bdd334796e5e3f24a2b89014bd WatchSource:0}: Error finding container bb4262b1fd3d303fb33f4bde5c0a59c874ed15bdd334796e5e3f24a2b89014bd: Status 404 returned error can't find the container with id bb4262b1fd3d303fb33f4bde5c0a59c874ed15bdd334796e5e3f24a2b89014bd
Jul 02 23:07:52.901931 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.901898    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:52.961076 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:52.961040    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:53.069747 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:53.069711    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:53.069747 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:53.069759    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls\") pod \"dns-default-zc557\" (UID: \"634ade03-7ded-4891-87bf-e73daf8023b5\") " pod="openshift-dns/dns-default-zc557"
Jul 02 23:07:53.070074 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:53.069842    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3320abb0-4218-4bcb-a023-1d267b06df39-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:53.070074 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:53.069897    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:07:53.070074 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:53.069937    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:07:53.070074 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:53.069942    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:07:53.070074 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:53.069979    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls podName:3320abb0-4218-4bcb-a023-1d267b06df39 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:54.069949509 +0000 UTC m=+37.033382838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4gc2w" (UID: "3320abb0-4218-4bcb-a023-1d267b06df39") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:07:53.070074 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:53.070003    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3320abb0-4218-4bcb-a023-1d267b06df39-kube-rbac-proxy-cm podName:3320abb0-4218-4bcb-a023-1d267b06df39 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:54.069986916 +0000 UTC m=+37.033420269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3320abb0-4218-4bcb-a023-1d267b06df39-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4gc2w" (UID: "3320abb0-4218-4bcb-a023-1d267b06df39") : configmap "kube-rbac-proxy" not found
Jul 02 23:07:53.070074 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:53.070020    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls podName:634ade03-7ded-4891-87bf-e73daf8023b5 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:54.070010975 +0000 UTC m=+37.033444289 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls") pod "dns-default-zc557" (UID: "634ade03-7ded-4891-87bf-e73daf8023b5") : secret "dns-default-metrics-tls" not found
Jul 02 23:07:53.070074 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:53.070038    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:53.070388 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:53.070143    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:07:53.070388 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:53.070154    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7749c8cbb8-qrfgl: secret "image-registry-tls" not found
Jul 02 23:07:53.070388 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:53.070193    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls podName:fda6ecf7-22ca-4a69-9bcd-6bcd7e497806 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:54.070182456 +0000 UTC m=+37.033615771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls") pod "image-registry-7749c8cbb8-qrfgl" (UID: "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806") : secret "image-registry-tls" not found
Jul 02 23:07:53.188935 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:53.188866    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:53.246811 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:53.246774    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:53.348351 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:53.348266    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:53.570721 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:53.570052    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:07:53.570721 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:53.570277    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:07:53.573472 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:53.573037    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 23:07:53.573472 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:53.573085    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 23:07:53.573801 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:53.573779    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dptv4\""
Jul 02 23:07:53.573801 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:53.573796    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 23:07:53.760201 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:53.760104    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7r4br" event={"ID":"a467ba7c-cf83-46e6-94fc-07bdd59d653e","Type":"ContainerStarted","Data":"bb4262b1fd3d303fb33f4bde5c0a59c874ed15bdd334796e5e3f24a2b89014bd"}
Jul 02 23:07:54.029851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:54.029813    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:54.077987 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:54.077944    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3320abb0-4218-4bcb-a023-1d267b06df39-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:54.078163 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:54.077996    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:54.078163 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:54.078065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:54.078163 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:54.078095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls\") pod \"dns-default-zc557\" (UID: \"634ade03-7ded-4891-87bf-e73daf8023b5\") " pod="openshift-dns/dns-default-zc557"
Jul 02 23:07:54.078163 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:54.078069    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 23:07:54.078332 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:54.078187    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:07:54.078332 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:54.078191    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:07:54.078332 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:54.078207    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7749c8cbb8-qrfgl: secret "image-registry-tls" not found
Jul 02 23:07:54.078332 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:54.078227    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3320abb0-4218-4bcb-a023-1d267b06df39-kube-rbac-proxy-cm podName:3320abb0-4218-4bcb-a023-1d267b06df39 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:56.078206728 +0000 UTC m=+39.041640049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3320abb0-4218-4bcb-a023-1d267b06df39-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4gc2w" (UID: "3320abb0-4218-4bcb-a023-1d267b06df39") : configmap "kube-rbac-proxy" not found
Jul 02 23:07:54.078332 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:54.078145    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:07:54.078332 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:54.078246    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls podName:634ade03-7ded-4891-87bf-e73daf8023b5 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:56.078235877 +0000 UTC m=+39.041669210 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls") pod "dns-default-zc557" (UID: "634ade03-7ded-4891-87bf-e73daf8023b5") : secret "dns-default-metrics-tls" not found
Jul 02 23:07:54.078332 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:54.078264    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls podName:fda6ecf7-22ca-4a69-9bcd-6bcd7e497806 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:56.078256746 +0000 UTC m=+39.041690057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls") pod "image-registry-7749c8cbb8-qrfgl" (UID: "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806") : secret "image-registry-tls" not found
Jul 02 23:07:54.078332 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:54.078292    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls podName:3320abb0-4218-4bcb-a023-1d267b06df39 nodeName:}" failed. No retries permitted until 2026-07-02 23:07:56.078276202 +0000 UTC m=+39.041709528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4gc2w" (UID: "3320abb0-4218-4bcb-a023-1d267b06df39") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:07:54.129713 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:54.129673    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:54.233991 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:54.233953    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:54.677129 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:54.677092    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:54.765990 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:54.765908    2581 generic.go:356] "Generic (PLEG): container finished" podID="e0451a6f-879b-490d-a413-df7e1e20a6b4" containerID="9279aee30ce1e107fc32e7f28553c779ce92c0beb60bdb577947dc20431ec10f" exitCode=0
Jul 02 23:07:54.765990 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:54.765972    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdhkd" event={"ID":"e0451a6f-879b-490d-a413-df7e1e20a6b4","Type":"ContainerDied","Data":"9279aee30ce1e107fc32e7f28553c779ce92c0beb60bdb577947dc20431ec10f"}
Jul 02 23:07:55.772197 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:55.771945    2581 generic.go:356] "Generic (PLEG): container finished" podID="e0451a6f-879b-490d-a413-df7e1e20a6b4" containerID="169d66004c1f1538834d8927fde1e916226b0851b186cd5854be0700aff210cf" exitCode=0
Jul 02 23:07:55.772629 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:55.772038    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdhkd" event={"ID":"e0451a6f-879b-490d-a413-df7e1e20a6b4","Type":"ContainerDied","Data":"169d66004c1f1538834d8927fde1e916226b0851b186cd5854be0700aff210cf"}
Jul 02 23:07:56.096399 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:56.096319    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3320abb0-4218-4bcb-a023-1d267b06df39-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:56.096399 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:56.096360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:07:56.096606 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:56.096427    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:56.096606 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:56.096454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls\") pod \"dns-default-zc557\" (UID: \"634ade03-7ded-4891-87bf-e73daf8023b5\") " pod="openshift-dns/dns-default-zc557"
Jul 02 23:07:56.096706 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:56.096611    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:07:56.096706 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:56.096639    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:07:56.096706 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:56.096651    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:07:56.096706 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:56.096659    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7749c8cbb8-qrfgl: secret "image-registry-tls" not found
Jul 02 23:07:56.096706 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:56.096678    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls podName:634ade03-7ded-4891-87bf-e73daf8023b5 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:00.096659524 +0000 UTC m=+43.060092835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls") pod "dns-default-zc557" (UID: "634ade03-7ded-4891-87bf-e73daf8023b5") : secret "dns-default-metrics-tls" not found
Jul 02 23:07:56.096706 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:56.096705    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls podName:fda6ecf7-22ca-4a69-9bcd-6bcd7e497806 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:00.096692441 +0000 UTC m=+43.060125757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls") pod "image-registry-7749c8cbb8-qrfgl" (UID: "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806") : secret "image-registry-tls" not found
Jul 02 23:07:56.096935 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:07:56.096723    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls podName:3320abb0-4218-4bcb-a023-1d267b06df39 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:00.09671332 +0000 UTC m=+43.060146634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4gc2w" (UID: "3320abb0-4218-4bcb-a023-1d267b06df39") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:07:56.096981 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:56.096934    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3320abb0-4218-4bcb-a023-1d267b06df39-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:07:56.175270 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:56.175231    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:56.483632 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:56.483592    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:56.776048 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:56.776020    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7r4br" event={"ID":"a467ba7c-cf83-46e6-94fc-07bdd59d653e","Type":"ContainerStarted","Data":"7c38371f4f53d349386681649b6f28b08eceb2ac4f187ceb000acfb8fa4a596d"}
Jul 02 23:07:56.779497 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:56.779462    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hdhkd" event={"ID":"e0451a6f-879b-490d-a413-df7e1e20a6b4","Type":"ContainerStarted","Data":"efdc048d2a5ca812993ed01e4efe6483ce7dfac97503d9c1efb8f62afe2c0ccc"}
Jul 02 23:07:56.791113 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:56.791064    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7r4br" podStartSLOduration=1.129898636 podStartE2EDuration="4.791051329s" totalImagesPullingTime="3.661152693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:56.790450139 +0000 UTC m=+39.753883472" watchObservedRunningTime="2026-07-02 23:07:56.791051329 +0000 UTC m=+39.754484662"
Jul 02 23:07:56.809600 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:56.809550    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hdhkd" podStartSLOduration=9.388485855 podStartE2EDuration="39.809535446s" totalImagesPullingTime="30.421049591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:17 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:07:56.808842643 +0000 UTC m=+39.772275977" watchObservedRunningTime="2026-07-02 23:07:56.809535446 +0000 UTC m=+39.772968778"
Jul 02 23:07:56.940646 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:56.940607    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:56.996015 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:56.995977    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:59.111799 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:59.111768    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:59.267890 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:59.267841    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:59.368211 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:59.368118    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:59.468350 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:59.468316    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:59.653991 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:59.653900    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:59.754679 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:59.754642    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:07:59.854921 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:07:59.854889    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:00.133402 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:00.133359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:08:00.133778 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:00.133421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:08:00.133778 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:00.133442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls\") pod \"dns-default-zc557\" (UID: \"634ade03-7ded-4891-87bf-e73daf8023b5\") " pod="openshift-dns/dns-default-zc557"
Jul 02 23:08:00.133778 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:08:00.133507    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 23:08:00.133778 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:08:00.133528    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7749c8cbb8-qrfgl: secret "image-registry-tls" not found
Jul 02 23:08:00.133778 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:08:00.133536    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 23:08:00.133778 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:08:00.133567    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 23:08:00.133778 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:08:00.133580    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls podName:634ade03-7ded-4891-87bf-e73daf8023b5 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:08.133567819 +0000 UTC m=+51.097001130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls") pod "dns-default-zc557" (UID: "634ade03-7ded-4891-87bf-e73daf8023b5") : secret "dns-default-metrics-tls" not found
Jul 02 23:08:00.133778 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:08:00.133594    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls podName:fda6ecf7-22ca-4a69-9bcd-6bcd7e497806 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:08.13358817 +0000 UTC m=+51.097021481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls") pod "image-registry-7749c8cbb8-qrfgl" (UID: "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806") : secret "image-registry-tls" not found
Jul 02 23:08:00.133778 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:08:00.133615    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls podName:3320abb0-4218-4bcb-a023-1d267b06df39 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:08.133601277 +0000 UTC m=+51.097034591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4gc2w" (UID: "3320abb0-4218-4bcb-a023-1d267b06df39") : secret "insights-runtime-extractor-tls" not found
Jul 02 23:08:00.602513 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:00.602474    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:00.856493 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:00.856407    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:01.000379 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:01.000340    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:01.404014 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:01.403987    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:01.798182 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:01.798151    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:01.999821 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:01.999792    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:02.415457 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:02.415428    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:02.802082 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:02.802050    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:02.959059 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:02.959026    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:03.198734 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:03.198659    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:03.602416 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:03.602380    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:03.800318 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:03.800241    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:03.856460 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:03.856360    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:04.000235 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:04.000198    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:04.207177 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:04.207068    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:04.308526 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:04.308498    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:04.358674 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:04.358627    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:05.408502 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:05.408461    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:05.508513 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:05.508480    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:05.610065 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:05.610032    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:05.798508 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:05.798477    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:06.007529 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:06.007489    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:06.203075 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:06.202985    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:07.203570 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:07.203536    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:07.610036 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:07.610003    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:07.804684 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:07.804647    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:07.998849 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:07.998756    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:08.196490 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.196452    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:08:08.196490 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.196495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls\") pod \"dns-default-zc557\" (UID: \"634ade03-7ded-4891-87bf-e73daf8023b5\") " pod="openshift-dns/dns-default-zc557"
Jul 02 23:08:08.196693 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.196546    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:08:08.200356 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.200325    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/634ade03-7ded-4891-87bf-e73daf8023b5-metrics-tls\") pod \"dns-default-zc557\" (UID: \"634ade03-7ded-4891-87bf-e73daf8023b5\") " pod="openshift-dns/dns-default-zc557"
Jul 02 23:08:08.200474 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.200326    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3320abb0-4218-4bcb-a023-1d267b06df39-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4gc2w\" (UID: \"3320abb0-4218-4bcb-a023-1d267b06df39\") " pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:08:08.200474 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.200411    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls\") pod \"image-registry-7749c8cbb8-qrfgl\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") " pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:08:08.249901 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.249800    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:08:08.267036 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.267006    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4gc2w"
Jul 02 23:08:08.278055 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.278019    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zc557"
Jul 02 23:08:08.399810 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.399771    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:08.418675 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.418599    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7749c8cbb8-qrfgl"]
Jul 02 23:08:08.422320 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:08:08.422289    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda6ecf7_22ca_4a69_9bcd_6bcd7e497806.slice/crio-8a74c9ec5bdf2fe2c6155fad400e3818f5052dad355dfbd932583f8998dd9a67 WatchSource:0}: Error finding container 8a74c9ec5bdf2fe2c6155fad400e3818f5052dad355dfbd932583f8998dd9a67: Status 404 returned error can't find the container with id 8a74c9ec5bdf2fe2c6155fad400e3818f5052dad355dfbd932583f8998dd9a67
Jul 02 23:08:08.438347 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.438320    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4gc2w"]
Jul 02 23:08:08.443765 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:08:08.443730    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3320abb0_4218_4bcb_a023_1d267b06df39.slice/crio-d8243d62b7167e59b7cd509a9569ebfb06e60fc2a50a9c4a57196c792c97c326 WatchSource:0}: Error finding container d8243d62b7167e59b7cd509a9569ebfb06e60fc2a50a9c4a57196c792c97c326: Status 404 returned error can't find the container with id d8243d62b7167e59b7cd509a9569ebfb06e60fc2a50a9c4a57196c792c97c326
Jul 02 23:08:08.462304 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.462101    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zc557"]
Jul 02 23:08:08.466353 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:08:08.466326    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634ade03_7ded_4891_87bf_e73daf8023b5.slice/crio-c8e6aa26f9245bbc313b7e8dbf8c9449a125bccf475be5da4afe3c482c750ebb WatchSource:0}: Error finding container c8e6aa26f9245bbc313b7e8dbf8c9449a125bccf475be5da4afe3c482c750ebb: Status 404 returned error can't find the container with id c8e6aa26f9245bbc313b7e8dbf8c9449a125bccf475be5da4afe3c482c750ebb
Jul 02 23:08:08.806201 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.806159    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4gc2w" event={"ID":"3320abb0-4218-4bcb-a023-1d267b06df39","Type":"ContainerStarted","Data":"d8243d62b7167e59b7cd509a9569ebfb06e60fc2a50a9c4a57196c792c97c326"}
Jul 02 23:08:08.807294 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.807270    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zc557" event={"ID":"634ade03-7ded-4891-87bf-e73daf8023b5","Type":"ContainerStarted","Data":"c8e6aa26f9245bbc313b7e8dbf8c9449a125bccf475be5da4afe3c482c750ebb"}
Jul 02 23:08:08.808713 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.808691    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl" event={"ID":"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806","Type":"ContainerStarted","Data":"673392a49847133dad8eec5fa6ae55bbb44f040e72575dde2a44976c71234118"}
Jul 02 23:08:08.808822 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.808727    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl" event={"ID":"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806","Type":"ContainerStarted","Data":"8a74c9ec5bdf2fe2c6155fad400e3818f5052dad355dfbd932583f8998dd9a67"}
Jul 02 23:08:08.808822 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.808792    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:08:08.827086 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.827038    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl" podStartSLOduration=35.827017508 podStartE2EDuration="35.827017508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:08.825918371 +0000 UTC m=+51.789351705" watchObservedRunningTime="2026-07-02 23:08:08.827017508 +0000 UTC m=+51.790450844"
Jul 02 23:08:08.997427 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:08.997389    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:09.060807 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:09.060689    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:09.202213 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:09.202178    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:09.602442 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:09.602407    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:09.802243 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:09.802102    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:12.800968 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:12.800937    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:12.900607 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:12.900578    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:12.955588 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:12.955555    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:13.084327 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:13.084235    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:13.259565 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:13.259536    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:13.363446 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:13.363410    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:13.822458 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:13.822420    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4gc2w" event={"ID":"3320abb0-4218-4bcb-a023-1d267b06df39","Type":"ContainerStarted","Data":"ef8361329ed439b060d51eb9edcf5ceee66fe300629ed4369981cd17eb5ac260"}
Jul 02 23:08:13.824242 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:13.824215    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zc557" event={"ID":"634ade03-7ded-4891-87bf-e73daf8023b5","Type":"ContainerStarted","Data":"e0dc530a6e0f78b7b0c686e3064fcc426b9634b635400241b099298a71bcd4b1"}
Jul 02 23:08:13.824354 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:13.824262    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zc557" event={"ID":"634ade03-7ded-4891-87bf-e73daf8023b5","Type":"ContainerStarted","Data":"b33aafb607ced92d83b12ca9677e2c45cadfc8a45a4cd9991064cf0c148879c0"}
Jul 02 23:08:13.824394 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:13.824375    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zc557"
Jul 02 23:08:13.839998 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:13.839943    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zc557" podStartSLOduration=17.092930996 podStartE2EDuration="21.839926687s" totalImagesPullingTime="4.746995691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:13.839457211 +0000 UTC m=+56.802890543" watchObservedRunningTime="2026-07-02 23:08:13.839926687 +0000 UTC m=+56.803360055"
Jul 02 23:08:13.880367 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:13.880336    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:13.978051 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:13.978018    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:14.097182 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:14.097089    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:14.150933 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:14.150898    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:14.275000 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:14.274969    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:14.462843 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:14.462750    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:14.563775 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:14.563717    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:14.830266 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:14.830227    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4gc2w" event={"ID":"3320abb0-4218-4bcb-a023-1d267b06df39","Type":"ContainerStarted","Data":"51c02af687b19c30df8bcea4630c57c73c22b0c33b986eebe16abdb9e6928dbb"}
Jul 02 23:08:15.512667 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.512630    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4"]
Jul 02 23:08:15.517173 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.517138    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4"
Jul 02 23:08:15.519900 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.519864    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 23:08:15.520474 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.520454    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 23:08:15.520584 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.520495    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 23:08:15.521083 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.520945    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 02 23:08:15.531934 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.531911    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4"]
Jul 02 23:08:15.547920 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.547890    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7749c8cbb8-qrfgl"]
Jul 02 23:08:15.560342 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.560311    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/136c0a9a-9855-46fd-8213-8a392b785244-klusterlet-config\") pod \"klusterlet-addon-workmgr-868677c84-rp9d4\" (UID: \"136c0a9a-9855-46fd-8213-8a392b785244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4"
Jul 02 23:08:15.560482 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.560378    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcthx\" (UniqueName: \"kubernetes.io/projected/136c0a9a-9855-46fd-8213-8a392b785244-kube-api-access-mcthx\") pod \"klusterlet-addon-workmgr-868677c84-rp9d4\" (UID: \"136c0a9a-9855-46fd-8213-8a392b785244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4"
Jul 02 23:08:15.560482 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.560423    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/136c0a9a-9855-46fd-8213-8a392b785244-tmp\") pod \"klusterlet-addon-workmgr-868677c84-rp9d4\" (UID: \"136c0a9a-9855-46fd-8213-8a392b785244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4"
Jul 02 23:08:15.618146 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.618102    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-b9fdp"]
Jul 02 23:08:15.623415 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.623375    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c67b478c5-djn42"]
Jul 02 23:08:15.623556 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.623518    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-b9fdp"
Jul 02 23:08:15.623745 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.623717    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:15.625405 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.625386    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.626384 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.626368    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6dk44\""
Jul 02 23:08:15.626771 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.626751    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 23:08:15.626853 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.626800    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 23:08:15.637618 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.637595    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-b9fdp"]
Jul 02 23:08:15.638428 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.638406    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c67b478c5-djn42"]
Jul 02 23:08:15.661832 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.661804    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/136c0a9a-9855-46fd-8213-8a392b785244-tmp\") pod \"klusterlet-addon-workmgr-868677c84-rp9d4\" (UID: \"136c0a9a-9855-46fd-8213-8a392b785244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4"
Jul 02 23:08:15.662020 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.661897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcthx\" (UniqueName: \"kubernetes.io/projected/136c0a9a-9855-46fd-8213-8a392b785244-kube-api-access-mcthx\") pod \"klusterlet-addon-workmgr-868677c84-rp9d4\" (UID: \"136c0a9a-9855-46fd-8213-8a392b785244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4"
Jul 02 23:08:15.662020 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.661953    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-registry-tls\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.662020 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.661980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-installation-pull-secrets\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.662171 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.662043    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-bound-sa-token\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.662171 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.662072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-registry-certificates\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.662171 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.662120    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7lk8\" (UniqueName: \"kubernetes.io/projected/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-kube-api-access-q7lk8\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.662171 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.662160    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/136c0a9a-9855-46fd-8213-8a392b785244-klusterlet-config\") pod \"klusterlet-addon-workmgr-868677c84-rp9d4\" (UID: \"136c0a9a-9855-46fd-8213-8a392b785244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4"
Jul 02 23:08:15.662365 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.662180    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6lp2\" (UniqueName: \"kubernetes.io/projected/2963eb95-d18d-4e55-ab13-a546e256e740-kube-api-access-j6lp2\") pod \"downloads-685bfb5f64-b9fdp\" (UID: \"2963eb95-d18d-4e55-ab13-a546e256e740\") " pod="openshift-console/downloads-685bfb5f64-b9fdp"
Jul 02 23:08:15.662365 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.662213    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-image-registry-private-configuration\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.662365 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.662242    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-ca-trust-extracted\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.662365 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.662247    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/136c0a9a-9855-46fd-8213-8a392b785244-tmp\") pod \"klusterlet-addon-workmgr-868677c84-rp9d4\" (UID: \"136c0a9a-9855-46fd-8213-8a392b785244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4"
Jul 02 23:08:15.662365 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.662267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-trusted-ca\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.665037 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.665016    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/136c0a9a-9855-46fd-8213-8a392b785244-klusterlet-config\") pod \"klusterlet-addon-workmgr-868677c84-rp9d4\" (UID: \"136c0a9a-9855-46fd-8213-8a392b785244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4"
Jul 02 23:08:15.679037 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.679014    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcthx\" (UniqueName: \"kubernetes.io/projected/136c0a9a-9855-46fd-8213-8a392b785244-kube-api-access-mcthx\") pod \"klusterlet-addon-workmgr-868677c84-rp9d4\" (UID: \"136c0a9a-9855-46fd-8213-8a392b785244\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4"
Jul 02 23:08:15.762920 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.762824    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-registry-tls\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.762920 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.762860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-installation-pull-secrets\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.763153 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.763015    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-bound-sa-token\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.763153 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.763067    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-registry-certificates\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.763153 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.763101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7lk8\" (UniqueName: \"kubernetes.io/projected/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-kube-api-access-q7lk8\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.763153 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.763142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6lp2\" (UniqueName: \"kubernetes.io/projected/2963eb95-d18d-4e55-ab13-a546e256e740-kube-api-access-j6lp2\") pod \"downloads-685bfb5f64-b9fdp\" (UID: \"2963eb95-d18d-4e55-ab13-a546e256e740\") " pod="openshift-console/downloads-685bfb5f64-b9fdp"
Jul 02 23:08:15.763369 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.763174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-image-registry-private-configuration\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.763927 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.763900    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-ca-trust-extracted\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.764087 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.763943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-trusted-ca\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.764087 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.763974    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-registry-certificates\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.764433 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.764404    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-ca-trust-extracted\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.764736 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.764708    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-trusted-ca\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.765759 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.765734    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-registry-tls\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.765975 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.765956    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-installation-pull-secrets\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.766265 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.766244    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-image-registry-private-configuration\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.772582 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.772563    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6lp2\" (UniqueName: \"kubernetes.io/projected/2963eb95-d18d-4e55-ab13-a546e256e740-kube-api-access-j6lp2\") pod \"downloads-685bfb5f64-b9fdp\" (UID: \"2963eb95-d18d-4e55-ab13-a546e256e740\") " pod="openshift-console/downloads-685bfb5f64-b9fdp"
Jul 02 23:08:15.773141 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.773118    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7lk8\" (UniqueName: \"kubernetes.io/projected/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-kube-api-access-q7lk8\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.773442 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.773423    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d8e2c5eb-30b6-4213-aa3c-8db08d7ce665-bound-sa-token\") pod \"image-registry-5c67b478c5-djn42\" (UID: \"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665\") " pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:15.795098 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.795069    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:15.829545 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.829507    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4"
Jul 02 23:08:15.894855 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.894825    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:15.934781 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.934746    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-b9fdp"
Jul 02 23:08:15.943738 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:15.943709    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:16.369819 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:16.369788    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-b9fdp"]
Jul 02 23:08:16.374154 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:08:16.374122    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2963eb95_d18d_4e55_ab13_a546e256e740.slice/crio-c88f24b6fb6b0f7ec9c135b6a5757e2ef9d39cf6fbdfc6546475373bd83f8543 WatchSource:0}: Error finding container c88f24b6fb6b0f7ec9c135b6a5757e2ef9d39cf6fbdfc6546475373bd83f8543: Status 404 returned error can't find the container with id c88f24b6fb6b0f7ec9c135b6a5757e2ef9d39cf6fbdfc6546475373bd83f8543
Jul 02 23:08:16.381278 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:16.381250    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c67b478c5-djn42"]
Jul 02 23:08:16.384952 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:08:16.384927    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8e2c5eb_30b6_4213_aa3c_8db08d7ce665.slice/crio-8a89c5b5ba83eb3eb62d459c8877690ad8b4761644603b15e2dd7bb2191bbede WatchSource:0}: Error finding container 8a89c5b5ba83eb3eb62d459c8877690ad8b4761644603b15e2dd7bb2191bbede: Status 404 returned error can't find the container with id 8a89c5b5ba83eb3eb62d459c8877690ad8b4761644603b15e2dd7bb2191bbede
Jul 02 23:08:16.395197 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:16.395134    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4"]
Jul 02 23:08:16.398694 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:08:16.398668    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod136c0a9a_9855_46fd_8213_8a392b785244.slice/crio-44be2416b383ae75831bed84ee923fe88a7de1a8afde409c7813091af717eb07 WatchSource:0}: Error finding container 44be2416b383ae75831bed84ee923fe88a7de1a8afde409c7813091af717eb07: Status 404 returned error can't find the container with id 44be2416b383ae75831bed84ee923fe88a7de1a8afde409c7813091af717eb07
Jul 02 23:08:16.500032 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:16.499935    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:16.553115 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:16.553067    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:16.839372 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:16.839334    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4gc2w" event={"ID":"3320abb0-4218-4bcb-a023-1d267b06df39","Type":"ContainerStarted","Data":"79dbb68344786f0c4b750b5861e7c9516304ae803cccbca5caf1dad74d87c357"}
Jul 02 23:08:16.840520 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:16.840478    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-b9fdp" event={"ID":"2963eb95-d18d-4e55-ab13-a546e256e740","Type":"ContainerStarted","Data":"c88f24b6fb6b0f7ec9c135b6a5757e2ef9d39cf6fbdfc6546475373bd83f8543"}
Jul 02 23:08:16.841543 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:16.841522    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4" event={"ID":"136c0a9a-9855-46fd-8213-8a392b785244","Type":"ContainerStarted","Data":"44be2416b383ae75831bed84ee923fe88a7de1a8afde409c7813091af717eb07"}
Jul 02 23:08:16.842905 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:16.842869    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c67b478c5-djn42" event={"ID":"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665","Type":"ContainerStarted","Data":"878f792da1b43f8a15e3a9e2adc4075fc75dcc0c202a1d6216b35ad29713c8c0"}
Jul 02 23:08:16.842991 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:16.842919    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c67b478c5-djn42" event={"ID":"d8e2c5eb-30b6-4213-aa3c-8db08d7ce665","Type":"ContainerStarted","Data":"8a89c5b5ba83eb3eb62d459c8877690ad8b4761644603b15e2dd7bb2191bbede"}
Jul 02 23:08:16.843049 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:16.843017    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:16.856507 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:16.856452    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4gc2w" podStartSLOduration=17.168050921 podStartE2EDuration="24.856434957s" totalImagesPullingTime="7.688384036s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:16.855350778 +0000 UTC m=+59.818784122" watchObservedRunningTime="2026-07-02 23:08:16.856434957 +0000 UTC m=+59.819868290"
Jul 02 23:08:16.872117 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:16.872055    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c67b478c5-djn42" podStartSLOduration=1.872033766 podStartE2EDuration="1.872033766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:08:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:16.871932516 +0000 UTC m=+59.835365850" watchObservedRunningTime="2026-07-02 23:08:16.872033766 +0000 UTC m=+59.835467098"
Jul 02 23:08:18.763194 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:18.763161    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pq45t"
Jul 02 23:08:18.915710 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:18.915674    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:19.016164 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:19.016075    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:19.100396 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:19.100317    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:19.105925 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:19.105892    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx45l"]
Jul 02 23:08:19.125551 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:19.125520    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx45l"]
Jul 02 23:08:19.125730 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:19.125559    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx45l"
Jul 02 23:08:19.128533 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:19.128510    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hzlcf\""
Jul 02 23:08:19.128750 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:19.128726    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 02 23:08:19.172643 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:19.172608    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:19.199731 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:19.199695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8d02e4ea-3ccd-407e-aae0-679bed970485-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fx45l\" (UID: \"8d02e4ea-3ccd-407e-aae0-679bed970485\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx45l"
Jul 02 23:08:19.301280 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:19.301243    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8d02e4ea-3ccd-407e-aae0-679bed970485-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fx45l\" (UID: \"8d02e4ea-3ccd-407e-aae0-679bed970485\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx45l"
Jul 02 23:08:19.301453 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:08:19.301385    2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 02 23:08:19.301520 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:08:19.301461    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d02e4ea-3ccd-407e-aae0-679bed970485-tls-certificates podName:8d02e4ea-3ccd-407e-aae0-679bed970485 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:19.80144469 +0000 UTC m=+62.764878004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/8d02e4ea-3ccd-407e-aae0-679bed970485-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-fx45l" (UID: "8d02e4ea-3ccd-407e-aae0-679bed970485") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 02 23:08:19.491297 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:19.491260    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:19.806243 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:19.806204    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8d02e4ea-3ccd-407e-aae0-679bed970485-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fx45l\" (UID: \"8d02e4ea-3ccd-407e-aae0-679bed970485\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx45l"
Jul 02 23:08:19.808984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:19.808958    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8d02e4ea-3ccd-407e-aae0-679bed970485-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fx45l\" (UID: \"8d02e4ea-3ccd-407e-aae0-679bed970485\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx45l"
Jul 02 23:08:20.037559 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:20.037520    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx45l"
Jul 02 23:08:20.073352 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:20.073263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:20.452783 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:20.452695    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:20.552410 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:20.552370    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:20.898123 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:20.898092    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:20.932667 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:20.932562    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx45l"]
Jul 02 23:08:20.938038 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:08:20.937997    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d02e4ea_3ccd_407e_aae0_679bed970485.slice/crio-843a45d4f3312154bb21cbe4aad0a118e560a095c107a26828be5b83befc28bc WatchSource:0}: Error finding container 843a45d4f3312154bb21cbe4aad0a118e560a095c107a26828be5b83befc28bc: Status 404 returned error can't find the container with id 843a45d4f3312154bb21cbe4aad0a118e560a095c107a26828be5b83befc28bc
Jul 02 23:08:21.047080 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:21.047047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:21.866496 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:21.866458    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4" event={"ID":"136c0a9a-9855-46fd-8213-8a392b785244","Type":"ContainerStarted","Data":"aaa4d518d871cdb5cb5724f6413cbaa519c70fb5df252847dfee25bf4d42c390"}
Jul 02 23:08:21.866650 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:21.866522    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4"
Jul 02 23:08:21.868071 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:21.867997    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx45l" event={"ID":"8d02e4ea-3ccd-407e-aae0-679bed970485","Type":"ContainerStarted","Data":"843a45d4f3312154bb21cbe4aad0a118e560a095c107a26828be5b83befc28bc"}
Jul 02 23:08:21.868766 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:21.868732    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4"
Jul 02 23:08:21.884314 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:21.884264    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-868677c84-rp9d4" podStartSLOduration=2.438680662 podStartE2EDuration="6.884246615s" totalImagesPullingTime="4.445565953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:08:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:21.883202746 +0000 UTC m=+64.846636080" watchObservedRunningTime="2026-07-02 23:08:21.884246615 +0000 UTC m=+64.847679950"
Jul 02 23:08:22.873629 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:22.873581    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx45l" event={"ID":"8d02e4ea-3ccd-407e-aae0-679bed970485","Type":"ContainerStarted","Data":"9f2b98d35f2ae8b3377cb5545d0ca49b975ad7a900df24e93235a043a8ce1139"}
Jul 02 23:08:22.874245 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:22.873810    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx45l"
Jul 02 23:08:22.879373 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:22.879347    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx45l"
Jul 02 23:08:22.888946 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:22.888856    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fx45l" podStartSLOduration=2.562959622 podStartE2EDuration="3.888838627s" totalImagesPullingTime="1.325879005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:22.887608741 +0000 UTC m=+65.851042077" watchObservedRunningTime="2026-07-02 23:08:22.888838627 +0000 UTC m=+65.852271960"
Jul 02 23:08:23.109690 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.109649    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-569fc68b46-mpsrk"]
Jul 02 23:08:23.111814 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.111792    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.114089 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.114059    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 02 23:08:23.114188 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.114147    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 02 23:08:23.115068 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.114776    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 02 23:08:23.115068 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.114815    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vmc2w\""
Jul 02 23:08:23.115068 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.114833    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 02 23:08:23.115068 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.114836    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 02 23:08:23.123860 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.123809    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-569fc68b46-mpsrk"]
Jul 02 23:08:23.136043 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.136015    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:23.181336 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.181303    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"]
Jul 02 23:08:23.183970 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.183940    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"
Jul 02 23:08:23.186484 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.186309    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 02 23:08:23.186484 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.186347    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 23:08:23.186484 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.186442    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 23:08:23.186696 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.186671    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 02 23:08:23.187034 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.186799    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 23:08:23.187034 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.186858    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-f6mpt\""
Jul 02 23:08:23.196024 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.195999    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"]
Jul 02 23:08:23.208344 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.208307    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:23.239818 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.239782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzqg4\" (UniqueName: \"kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4\") pod \"network-check-target-7k6dt\" (UID: \"83a17801-1225-46d6-9b58-4a1c7e0c0534\") " pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:08:23.240021 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.239846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs\") pod \"network-metrics-daemon-27zv5\" (UID: \"9b58b91e-ef2e-4ecd-bfbe-619ba380493f\") " pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:08:23.240021 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.239899    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnksk\" (UniqueName: \"kubernetes.io/projected/9a5b8441-6882-4ff0-81dc-2b80c5837fc8-kube-api-access-mnksk\") pod \"prometheus-operator-567f7b8b7c-vj4wc\" (UID: \"9a5b8441-6882-4ff0-81dc-2b80c5837fc8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"
Jul 02 23:08:23.240021 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.239995    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-oauth-serving-cert\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.240168 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.240039    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78bh9\" (UniqueName: \"kubernetes.io/projected/486f0d5d-a45c-4526-a91b-502cc04aa1f0-kube-api-access-78bh9\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.240168 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.240100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-config\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.240168 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.240130    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a5b8441-6882-4ff0-81dc-2b80c5837fc8-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-vj4wc\" (UID: \"9a5b8441-6882-4ff0-81dc-2b80c5837fc8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"
Jul 02 23:08:23.240168 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.240157    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a5b8441-6882-4ff0-81dc-2b80c5837fc8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-vj4wc\" (UID: \"9a5b8441-6882-4ff0-81dc-2b80c5837fc8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"
Jul 02 23:08:23.240329 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.240209    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-oauth-config\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.240329 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.240230    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a5b8441-6882-4ff0-81dc-2b80c5837fc8-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-vj4wc\" (UID: \"9a5b8441-6882-4ff0-81dc-2b80c5837fc8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"
Jul 02 23:08:23.240329 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.240256    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-service-ca\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.240329 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.240275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-serving-cert\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.243066 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.243039    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 23:08:23.243066 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.243039    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 23:08:23.253081 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.253054    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 23:08:23.253480 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.253457    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b58b91e-ef2e-4ecd-bfbe-619ba380493f-metrics-certs\") pod \"network-metrics-daemon-27zv5\" (UID: \"9b58b91e-ef2e-4ecd-bfbe-619ba380493f\") " pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:08:23.264711 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.264687    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzqg4\" (UniqueName: \"kubernetes.io/projected/83a17801-1225-46d6-9b58-4a1c7e0c0534-kube-api-access-xzqg4\") pod \"network-check-target-7k6dt\" (UID: \"83a17801-1225-46d6-9b58-4a1c7e0c0534\") " pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:08:23.294234 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.294204    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dptv4\""
Jul 02 23:08:23.301864 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.301829    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:23.302627 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.302608    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:08:23.340810 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.340780    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnksk\" (UniqueName: \"kubernetes.io/projected/9a5b8441-6882-4ff0-81dc-2b80c5837fc8-kube-api-access-mnksk\") pod \"prometheus-operator-567f7b8b7c-vj4wc\" (UID: \"9a5b8441-6882-4ff0-81dc-2b80c5837fc8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"
Jul 02 23:08:23.340994 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.340826    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-oauth-serving-cert\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.340994 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.340855    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78bh9\" (UniqueName: \"kubernetes.io/projected/486f0d5d-a45c-4526-a91b-502cc04aa1f0-kube-api-access-78bh9\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.340994 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.340919    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-config\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.340994 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.340947    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a5b8441-6882-4ff0-81dc-2b80c5837fc8-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-vj4wc\" (UID: \"9a5b8441-6882-4ff0-81dc-2b80c5837fc8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"
Jul 02 23:08:23.340994 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.340972    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a5b8441-6882-4ff0-81dc-2b80c5837fc8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-vj4wc\" (UID: \"9a5b8441-6882-4ff0-81dc-2b80c5837fc8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"
Jul 02 23:08:23.341242 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.341012    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-oauth-config\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.341242 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.341037    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a5b8441-6882-4ff0-81dc-2b80c5837fc8-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-vj4wc\" (UID: \"9a5b8441-6882-4ff0-81dc-2b80c5837fc8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"
Jul 02 23:08:23.341242 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.341065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-service-ca\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.341242 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.341093    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-serving-cert\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.341242 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.341123    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret\") pod \"global-pull-secret-syncer-4rpk9\" (UID: \"dee8ea60-68c5-4775-adbe-0f7a82fca7a3\") " pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:08:23.342070 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:08:23.342043    2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 02 23:08:23.342187 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:08:23.342120    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a5b8441-6882-4ff0-81dc-2b80c5837fc8-prometheus-operator-tls podName:9a5b8441-6882-4ff0-81dc-2b80c5837fc8 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:23.842103057 +0000 UTC m=+66.805536380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/9a5b8441-6882-4ff0-81dc-2b80c5837fc8-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-vj4wc" (UID: "9a5b8441-6882-4ff0-81dc-2b80c5837fc8") : secret "prometheus-operator-tls" not found
Jul 02 23:08:23.342187 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.342157    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-oauth-serving-cert\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.342845 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.342821    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-service-ca\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.343283 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.343258    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-config\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.343283 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.343268    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a5b8441-6882-4ff0-81dc-2b80c5837fc8-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-vj4wc\" (UID: \"9a5b8441-6882-4ff0-81dc-2b80c5837fc8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"
Jul 02 23:08:23.344404 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.344384    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 23:08:23.345103 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.345084    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-oauth-config\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.345617 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.345600    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-serving-cert\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.345708 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.345684    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a5b8441-6882-4ff0-81dc-2b80c5837fc8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-vj4wc\" (UID: \"9a5b8441-6882-4ff0-81dc-2b80c5837fc8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"
Jul 02 23:08:23.351114 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.351092    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnksk\" (UniqueName: \"kubernetes.io/projected/9a5b8441-6882-4ff0-81dc-2b80c5837fc8-kube-api-access-mnksk\") pod \"prometheus-operator-567f7b8b7c-vj4wc\" (UID: \"9a5b8441-6882-4ff0-81dc-2b80c5837fc8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"
Jul 02 23:08:23.355664 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.353833    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dee8ea60-68c5-4775-adbe-0f7a82fca7a3-original-pull-secret\") pod \"global-pull-secret-syncer-4rpk9\" (UID: \"dee8ea60-68c5-4775-adbe-0f7a82fca7a3\") " pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:08:23.358211 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.358188    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78bh9\" (UniqueName: \"kubernetes.io/projected/486f0d5d-a45c-4526-a91b-502cc04aa1f0-kube-api-access-78bh9\") pod \"console-569fc68b46-mpsrk\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") " pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.424037 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.424006    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:23.448141 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.447905    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7k6dt"]
Jul 02 23:08:23.451797 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:08:23.451748    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83a17801_1225_46d6_9b58_4a1c7e0c0534.slice/crio-dfc056f8c4707c9a43b2ff71c4cff38148997fca1c5fe2f06bce1f54072540d0 WatchSource:0}: Error finding container dfc056f8c4707c9a43b2ff71c4cff38148997fca1c5fe2f06bce1f54072540d0: Status 404 returned error can't find the container with id dfc056f8c4707c9a43b2ff71c4cff38148997fca1c5fe2f06bce1f54072540d0
Jul 02 23:08:23.494743 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.494717    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jkmkq\""
Jul 02 23:08:23.502390 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.502362    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-27zv5"
Jul 02 23:08:23.583160 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.580815    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-569fc68b46-mpsrk"]
Jul 02 23:08:23.590896 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.585314    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:23.600901 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.597298    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4rpk9"
Jul 02 23:08:23.666533 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.666499    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-27zv5"]
Jul 02 23:08:23.757143 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.757112    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4rpk9"]
Jul 02 23:08:23.760937 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:08:23.760903    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee8ea60_68c5_4775_adbe_0f7a82fca7a3.slice/crio-912fec28ab0d14a6518083ad5516570215d4b195ce928bc246821fe7386b8471 WatchSource:0}: Error finding container 912fec28ab0d14a6518083ad5516570215d4b195ce928bc246821fe7386b8471: Status 404 returned error can't find the container with id 912fec28ab0d14a6518083ad5516570215d4b195ce928bc246821fe7386b8471
Jul 02 23:08:23.833121 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.833085    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zc557"
Jul 02 23:08:23.844435 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.844402    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a5b8441-6882-4ff0-81dc-2b80c5837fc8-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-vj4wc\" (UID: \"9a5b8441-6882-4ff0-81dc-2b80c5837fc8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"
Jul 02 23:08:23.847491 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.847468    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a5b8441-6882-4ff0-81dc-2b80c5837fc8-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-vj4wc\" (UID: \"9a5b8441-6882-4ff0-81dc-2b80c5837fc8\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"
Jul 02 23:08:23.879638 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.879589    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4rpk9" event={"ID":"dee8ea60-68c5-4775-adbe-0f7a82fca7a3","Type":"ContainerStarted","Data":"912fec28ab0d14a6518083ad5516570215d4b195ce928bc246821fe7386b8471"}
Jul 02 23:08:23.881381 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.881322    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-27zv5" event={"ID":"9b58b91e-ef2e-4ecd-bfbe-619ba380493f","Type":"ContainerStarted","Data":"0342a4bc638db867bde0550eef35a41c3f1e590b241da3dbc72952d4f2b20ab6"}
Jul 02 23:08:23.883575 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.883549    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-569fc68b46-mpsrk" event={"ID":"486f0d5d-a45c-4526-a91b-502cc04aa1f0","Type":"ContainerStarted","Data":"13448b86e85d7379554dc56a62a3d98fc95f1916d9868e0d40c90894d43f98e3"}
Jul 02 23:08:23.885487 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.885464    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7k6dt" event={"ID":"83a17801-1225-46d6-9b58-4a1c7e0c0534","Type":"ContainerStarted","Data":"dfc056f8c4707c9a43b2ff71c4cff38148997fca1c5fe2f06bce1f54072540d0"}
Jul 02 23:08:23.991294 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:23.991210    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:24.069766 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:24.069727    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:24.096258 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:24.096220    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"
Jul 02 23:08:24.163340 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:24.163268    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:24.258550 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:24.258475    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:24.268605 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:24.268575    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc"]
Jul 02 23:08:24.273099 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:08:24.273070    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5b8441_6882_4ff0_81dc_2b80c5837fc8.slice/crio-bd4958dfaadf364e673787d0ea57f10539ff596236b908dd2ae2a710c8f095a8 WatchSource:0}: Error finding container bd4958dfaadf364e673787d0ea57f10539ff596236b908dd2ae2a710c8f095a8: Status 404 returned error can't find the container with id bd4958dfaadf364e673787d0ea57f10539ff596236b908dd2ae2a710c8f095a8
Jul 02 23:08:24.894999 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:24.894953    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc" event={"ID":"9a5b8441-6882-4ff0-81dc-2b80c5837fc8","Type":"ContainerStarted","Data":"bd4958dfaadf364e673787d0ea57f10539ff596236b908dd2ae2a710c8f095a8"}
Jul 02 23:08:25.555822 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:25.555783    2581 patch_prober.go:28] interesting pod/image-registry-7749c8cbb8-qrfgl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 02 23:08:25.556027 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:25.555848    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl" podUID="fda6ecf7-22ca-4a69-9bcd-6bcd7e497806" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 02 23:08:25.905584 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:25.905494    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-27zv5" event={"ID":"9b58b91e-ef2e-4ecd-bfbe-619ba380493f","Type":"ContainerStarted","Data":"b63ade7b102c33a56711ab0f684fc3f9b454355823091fb8c1266184cfd3a531"}
Jul 02 23:08:25.906058 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:25.905605    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-27zv5" event={"ID":"9b58b91e-ef2e-4ecd-bfbe-619ba380493f","Type":"ContainerStarted","Data":"c2a0fcf3428bf9ff8f1b27ce05fd92cfa738f6e80b52a73625133b248eef74d5"}
Jul 02 23:08:25.923426 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:25.922987    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-27zv5" podStartSLOduration=67.630054053 podStartE2EDuration="1m8.922964913s" totalImagesPullingTime="1.29291086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:25.921188312 +0000 UTC m=+68.884621646" watchObservedRunningTime="2026-07-02 23:08:25.922964913 +0000 UTC m=+68.886398247"
Jul 02 23:08:26.004906 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:26.004822    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:26.057894 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:26.057847    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:29.500372 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:29.500335    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:29.553140 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:29.553104    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:32.294378 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.294346    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b868fdf6f-crtq5"]
Jul 02 23:08:32.299359 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.299336    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.306625 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.306553    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b868fdf6f-crtq5"]
Jul 02 23:08:32.306843 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.306702    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 02 23:08:32.421489 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.421454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-oauth-config\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.421675 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.421530    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-serving-cert\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.421675 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.421568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-service-ca\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.421675 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.421589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-oauth-serving-cert\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.421675 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.421615    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-trusted-ca-bundle\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.421833 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.421721    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-config\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.421833 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.421752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8s5f\" (UniqueName: \"kubernetes.io/projected/e80d0c9c-4286-49eb-83fc-9f5bc374576d-kube-api-access-f8s5f\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.522304 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.522269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-serving-cert\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.522515 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.522315    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-service-ca\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.522515 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.522331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-oauth-serving-cert\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.522515 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.522347    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-trusted-ca-bundle\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.522515 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.522382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-config\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.522515 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.522400    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8s5f\" (UniqueName: \"kubernetes.io/projected/e80d0c9c-4286-49eb-83fc-9f5bc374576d-kube-api-access-f8s5f\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.522515 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.522438    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-oauth-config\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.523553 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.523524    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-oauth-serving-cert\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.523757 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.523733    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-config\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.524026 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.524003    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-service-ca\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.524121 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.524105    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-trusted-ca-bundle\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.525252 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.525226    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-oauth-config\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.525669 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.525653    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-serving-cert\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.531794 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.531773    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8s5f\" (UniqueName: \"kubernetes.io/projected/e80d0c9c-4286-49eb-83fc-9f5bc374576d-kube-api-access-f8s5f\") pod \"console-b868fdf6f-crtq5\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") " pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.610931 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.610843    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:32.953528 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:32.953399    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:33.596628 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:33.596594    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:33.658483 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:33.658450    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:33.901221 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:33.901097    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:35.552785 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:35.552752    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:08:37.853670 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:37.853641    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c67b478c5-djn42"
Jul 02 23:08:37.913022 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:37.912949    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:37.929368 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:37.929337    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b868fdf6f-crtq5"]
Jul 02 23:08:37.954708 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:37.954678    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-569fc68b46-mpsrk" event={"ID":"486f0d5d-a45c-4526-a91b-502cc04aa1f0","Type":"ContainerStarted","Data":"0b0579a97af90269317728c28396b1a60d182e4ecd5bd4f4d60d82c5ed8de38f"}
Jul 02 23:08:37.956704 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:37.956376    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7k6dt" event={"ID":"83a17801-1225-46d6-9b58-4a1c7e0c0534","Type":"ContainerStarted","Data":"474cb53ac0e112b9945229e63244fd13526ff16d587f8403e54cd7fe0efc8689"}
Jul 02 23:08:37.956704 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:37.956573    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:08:37.958856 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:37.958834    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc" event={"ID":"9a5b8441-6882-4ff0-81dc-2b80c5837fc8","Type":"ContainerStarted","Data":"419becab40fab70796dcff20582b3d232c509c4f68e29f0def4e75688755725f"}
Jul 02 23:08:37.970951 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:37.970868    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-569fc68b46-mpsrk" podStartSLOduration=0.780867345 podStartE2EDuration="14.970849496s" totalImagesPullingTime="14.189982151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:37.970240059 +0000 UTC m=+80.933673394" watchObservedRunningTime="2026-07-02 23:08:37.970849496 +0000 UTC m=+80.934282807"
Jul 02 23:08:37.971652 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:37.971627    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:37.986593 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:37.986549    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7k6dt" podStartSLOduration=66.647959138 podStartE2EDuration="1m20.986535031s" totalImagesPullingTime="14.338575893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:37.985158179 +0000 UTC m=+80.948591516" watchObservedRunningTime="2026-07-02 23:08:37.986535031 +0000 UTC m=+80.949968363"
Jul 02 23:08:38.008120 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:08:38.008048    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80d0c9c_4286_49eb_83fc_9f5bc374576d.slice/crio-d19fc712e850031bb0dbada9b8ad9fe0d62d500d58f0d03343fbba6aaf2d10be WatchSource:0}: Error finding container d19fc712e850031bb0dbada9b8ad9fe0d62d500d58f0d03343fbba6aaf2d10be: Status 404 returned error can't find the container with id d19fc712e850031bb0dbada9b8ad9fe0d62d500d58f0d03343fbba6aaf2d10be
Jul 02 23:08:38.071790 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:38.071724    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:38.169241 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:38.169165    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:38.269599 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:38.269500    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:38.965398 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:38.965358    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b868fdf6f-crtq5" event={"ID":"e80d0c9c-4286-49eb-83fc-9f5bc374576d","Type":"ContainerStarted","Data":"6586d6b7c1559a51c950614b0b5ae9945c95d859d3d04c6be8af61807dbab54e"}
Jul 02 23:08:38.966036 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:38.966001    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b868fdf6f-crtq5" event={"ID":"e80d0c9c-4286-49eb-83fc-9f5bc374576d","Type":"ContainerStarted","Data":"d19fc712e850031bb0dbada9b8ad9fe0d62d500d58f0d03343fbba6aaf2d10be"}
Jul 02 23:08:38.967377 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:38.967340    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-b9fdp" event={"ID":"2963eb95-d18d-4e55-ab13-a546e256e740","Type":"ContainerStarted","Data":"365e4d409d6b264dd75c90a027f3401338e2d567fef8c88b5ccc43a1515be4cd"}
Jul 02 23:08:38.967521 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:38.967503    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-b9fdp"
Jul 02 23:08:38.969346 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:38.969311    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4rpk9" event={"ID":"dee8ea60-68c5-4775-adbe-0f7a82fca7a3","Type":"ContainerStarted","Data":"41095317037e4bb9ca39081fe1dc6135de3bfe161f16c1c8000b080284b472ba"}
Jul 02 23:08:38.971494 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:38.971461    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc" event={"ID":"9a5b8441-6882-4ff0-81dc-2b80c5837fc8","Type":"ContainerStarted","Data":"681b1187a5ba1272e3986e86908d23f1afaab709ecf57dfa5908f1ed1fd0f1a9"}
Jul 02 23:08:38.982370 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:38.982311    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b868fdf6f-crtq5" podStartSLOduration=6.982291937 podStartE2EDuration="6.982291937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:08:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:38.980849924 +0000 UTC m=+81.944283258" watchObservedRunningTime="2026-07-02 23:08:38.982291937 +0000 UTC m=+81.945725271"
Jul 02 23:08:38.983463 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:38.983432    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-b9fdp"
Jul 02 23:08:38.995784 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:38.995721    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-b9fdp" podStartSLOduration=2.28324983 podStartE2EDuration="23.995701098s" totalImagesPullingTime="21.712451268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:08:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:38.995446791 +0000 UTC m=+81.958880128" watchObservedRunningTime="2026-07-02 23:08:38.995701098 +0000 UTC m=+81.959134432"
Jul 02 23:08:39.009016 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:39.008961    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4rpk9" podStartSLOduration=67.966954262 podStartE2EDuration="1m22.008943187s" totalImagesPullingTime="14.041988925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:07:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:39.008935609 +0000 UTC m=+81.972368942" watchObservedRunningTime="2026-07-02 23:08:39.008943187 +0000 UTC m=+81.972376520"
Jul 02 23:08:39.030273 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:39.030208    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-vj4wc" podStartSLOduration=2.516102328 podStartE2EDuration="16.030185033s" totalImagesPullingTime="13.514082705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:39.029446932 +0000 UTC m=+81.992880265" watchObservedRunningTime="2026-07-02 23:08:39.030185033 +0000 UTC m=+81.993618365"
Jul 02 23:08:40.272952 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.272915    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:40.476946 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.476913    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:40.544844 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.544767    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7vvdj"]
Jul 02 23:08:40.567741 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.567707    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:40.575331 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.575297    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.577266 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.577230    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl" podUID="fda6ecf7-22ca-4a69-9bcd-6bcd7e497806" containerName="registry" containerID="cri-o://673392a49847133dad8eec5fa6ae55bbb44f040e72575dde2a44976c71234118" gracePeriod=30
Jul 02 23:08:40.579475 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.579433    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 23:08:40.579475 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.579453    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 23:08:40.579641 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.579481    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 23:08:40.579641 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.579453    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tk5z5\""
Jul 02 23:08:40.634288 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.634253    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:40.697317 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.697264    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-accelerators-collector-config\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.697317 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.697319    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-tls\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.697535 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.697391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-wtmp\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.697535 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.697494    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-root\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.697658 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.697539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p7zj\" (UniqueName: \"kubernetes.io/projected/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-kube-api-access-5p7zj\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.697658 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.697572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-sys\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.697658 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.697602    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.697658 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.697622    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-metrics-client-ca\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.697658 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.697649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-textfile\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.735795 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.735763    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:40.798941 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.798741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-wtmp\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.798941 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.798794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-root\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.798941 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.798830    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p7zj\" (UniqueName: \"kubernetes.io/projected/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-kube-api-access-5p7zj\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.799158 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.798944    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-root\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.799158 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.798961    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-wtmp\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.799404 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.799381    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-sys\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.799515 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.799433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.799515 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.799484    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-sys\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.800174 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.799533    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-metrics-client-ca\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.800174 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.799566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-textfile\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.800174 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.799598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-accelerators-collector-config\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.800174 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.799628    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-tls\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.800174 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:08:40.799734    2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 02 23:08:40.800174 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:08:40.799789    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-tls podName:ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:41.299770437 +0000 UTC m=+84.263203763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-tls") pod "node-exporter-7vvdj" (UID: "ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22") : secret "node-exporter-tls" not found
Jul 02 23:08:40.800174 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.799955    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-textfile\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.800504 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.800219    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-metrics-client-ca\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.800541 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.800519    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-accelerators-collector-config\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.802825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.802798    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.811118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.811091    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p7zj\" (UniqueName: \"kubernetes.io/projected/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-kube-api-access-5p7zj\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:40.835561 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.835519    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:40.883771 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.883735    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:08:40.906355 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.906326    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:40.965640 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.965604    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:40.987119 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.987081    2581 generic.go:356] "Generic (PLEG): container finished" podID="fda6ecf7-22ca-4a69-9bcd-6bcd7e497806" containerID="673392a49847133dad8eec5fa6ae55bbb44f040e72575dde2a44976c71234118" exitCode=0
Jul 02 23:08:40.987309 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.987151    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl"
Jul 02 23:08:40.987309 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.987198    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl" event={"ID":"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806","Type":"ContainerDied","Data":"673392a49847133dad8eec5fa6ae55bbb44f040e72575dde2a44976c71234118"}
Jul 02 23:08:40.987309 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.987272    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7749c8cbb8-qrfgl" event={"ID":"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806","Type":"ContainerDied","Data":"8a74c9ec5bdf2fe2c6155fad400e3818f5052dad355dfbd932583f8998dd9a67"}
Jul 02 23:08:40.987309 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.987296    2581 scope.go:117] "RemoveContainer" containerID="673392a49847133dad8eec5fa6ae55bbb44f040e72575dde2a44976c71234118"
Jul 02 23:08:40.999556 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:40.999460    2581 scope.go:117] "RemoveContainer" containerID="673392a49847133dad8eec5fa6ae55bbb44f040e72575dde2a44976c71234118"
Jul 02 23:08:41.000338 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:08:41.000307    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"673392a49847133dad8eec5fa6ae55bbb44f040e72575dde2a44976c71234118\": container with ID starting with 673392a49847133dad8eec5fa6ae55bbb44f040e72575dde2a44976c71234118 not found: ID does not exist" containerID="673392a49847133dad8eec5fa6ae55bbb44f040e72575dde2a44976c71234118"
Jul 02 23:08:41.000454 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.000350    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"673392a49847133dad8eec5fa6ae55bbb44f040e72575dde2a44976c71234118"} err="failed to get container status \"673392a49847133dad8eec5fa6ae55bbb44f040e72575dde2a44976c71234118\": rpc error: code = NotFound desc = could not find container \"673392a49847133dad8eec5fa6ae55bbb44f040e72575dde2a44976c71234118\": container with ID starting with 673392a49847133dad8eec5fa6ae55bbb44f040e72575dde2a44976c71234118 not found: ID does not exist"
Jul 02 23:08:41.001549 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.001523    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-bound-sa-token\") pod \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") "
Jul 02 23:08:41.001642 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.001599    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls\") pod \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") "
Jul 02 23:08:41.001642 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.001632    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-installation-pull-secrets\") pod \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") "
Jul 02 23:08:41.001741 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.001652    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsjs6\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-kube-api-access-tsjs6\") pod \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") "
Jul 02 23:08:41.001741 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.001681    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-ca-trust-extracted\") pod \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") "
Jul 02 23:08:41.001847 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.001790    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-image-registry-private-configuration\") pod \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") "
Jul 02 23:08:41.001916 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.001852    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-trusted-ca\") pod \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") "
Jul 02 23:08:41.001964 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.001947    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-certificates\") pod \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\" (UID: \"fda6ecf7-22ca-4a69-9bcd-6bcd7e497806\") "
Jul 02 23:08:41.002777 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.002512    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806" (UID: "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:08:41.003155 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.003112    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806" (UID: "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:08:41.006451 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.006424    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806" (UID: "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:08:41.007021 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.006980    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806" (UID: "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:08:41.007114 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.007035    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-kube-api-access-tsjs6" (OuterVolumeSpecName: "kube-api-access-tsjs6") pod "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806" (UID: "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806"). InnerVolumeSpecName "kube-api-access-tsjs6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:08:41.007114 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.007084    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806" (UID: "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:08:41.007385 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.007360    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806" (UID: "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:08:41.011645 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.011618    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806" (UID: "fda6ecf7-22ca-4a69-9bcd-6bcd7e497806"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:08:41.021983 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.021897    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:41.103000 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.102916    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-bound-sa-token\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:08:41.103000 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.102948    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-tls\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:08:41.103000 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.102962    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-installation-pull-secrets\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:08:41.103000 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.102977    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsjs6\" (UniqueName: \"kubernetes.io/projected/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-kube-api-access-tsjs6\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:08:41.103000 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.102993    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-ca-trust-extracted\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:08:41.103000 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.103007    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-image-registry-private-configuration\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:08:41.103396 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.103022    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-trusted-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:08:41.103396 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.103036    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806-registry-certificates\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:08:41.122204 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.122159    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:41.305124 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.305087    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-tls\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:41.307815 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.307789    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22-node-exporter-tls\") pod \"node-exporter-7vvdj\" (UID: \"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22\") " pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:41.315779 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.315751    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7749c8cbb8-qrfgl"]
Jul 02 23:08:41.319735 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.319709    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7749c8cbb8-qrfgl"]
Jul 02 23:08:41.489063 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.488968    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7vvdj"
Jul 02 23:08:41.494333 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.494301    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:41.529568 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:08:41.529535    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0b3cd6_7487_4bf9_89d4_ae94e9c7dd22.slice/crio-c29598e4070c7ebea06aacd0b6898fcf47e1d05aa821cd70d2148ad75dc95d81 WatchSource:0}: Error finding container c29598e4070c7ebea06aacd0b6898fcf47e1d05aa821cd70d2148ad75dc95d81: Status 404 returned error can't find the container with id c29598e4070c7ebea06aacd0b6898fcf47e1d05aa821cd70d2148ad75dc95d81
Jul 02 23:08:41.573066 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.573021    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:41.574043 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.574010    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fda6ecf7-22ca-4a69-9bcd-6bcd7e497806" path="/var/lib/kubelet/pods/fda6ecf7-22ca-4a69-9bcd-6bcd7e497806/volumes"
Jul 02 23:08:41.576905 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.576864    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 23:08:41.577178 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.577163    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fda6ecf7-22ca-4a69-9bcd-6bcd7e497806" containerName="registry"
Jul 02 23:08:41.577246 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.577182    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fda6ecf7-22ca-4a69-9bcd-6bcd7e497806" containerName="registry"
Jul 02 23:08:41.577298 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.577250    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fda6ecf7-22ca-4a69-9bcd-6bcd7e497806" containerName="registry"
Jul 02 23:08:41.608470 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.608433    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 23:08:41.608649 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.608566    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.612176 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.612152    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 02 23:08:41.614277 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.612558    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 02 23:08:41.614418 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.612626    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rs45x\""
Jul 02 23:08:41.614549 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.612656    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 02 23:08:41.615829 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.612713    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 02 23:08:41.616053 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.613810    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 02 23:08:41.616233 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.613859    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 02 23:08:41.616401 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.613946    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 02 23:08:41.616497 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.613998    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 02 23:08:41.616553 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.614052    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 02 23:08:41.707861 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.707822    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.708031 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.707900    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-config-volume\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.708031 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.707932    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.708031 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.707958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxrjg\" (UniqueName: \"kubernetes.io/projected/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-kube-api-access-qxrjg\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.708031 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.707977    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-web-config\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.708031 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.707999    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-config-out\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.708031 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.708021    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.708303 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.708048    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.708303 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.708142    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.708303 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.708174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.708303 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.708204    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.708460 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.708295    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.708460 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.708344    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.809200 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.809157    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.809377 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.809210    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.809377 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.809235    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.809377 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.809267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.809377 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.809303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.809377 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:08:41.809363    2581 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 02 23:08:41.809694 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:08:41.809443    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-main-tls podName:f7167cd4-1414-4eef-ac2a-7b2a690df9b2 nodeName:}" failed. No retries permitted until 2026-07-02 23:08:42.309420568 +0000 UTC m=+85.272853880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "f7167cd4-1414-4eef-ac2a-7b2a690df9b2") : secret "alertmanager-main-tls" not found
Jul 02 23:08:41.809912 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.809890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.809969 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.809938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-config-volume\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.810024 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.809965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.810024 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.809990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxrjg\" (UniqueName: \"kubernetes.io/projected/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-kube-api-access-qxrjg\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.810122 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.810024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-web-config\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.810122 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.810070    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-config-out\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.810122 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.810102    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.810218 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.810133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.810292 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.810273    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.810836 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.810803    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.812091 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.811850    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.813647 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.813615    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.813760 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.813734    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.814377 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.814355    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.814749 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.814729    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.816012 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.815899    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.816012 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.815920    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-web-config\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.816313 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.816279    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-config-volume\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.816472 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.816449    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-config-out\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.818476 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.818456    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxrjg\" (UniqueName: \"kubernetes.io/projected/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-kube-api-access-qxrjg\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:41.970285 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.970249    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:41.995252 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:41.995207    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7vvdj" event={"ID":"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22","Type":"ContainerStarted","Data":"c29598e4070c7ebea06aacd0b6898fcf47e1d05aa821cd70d2148ad75dc95d81"}
Jul 02 23:08:42.032601 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:42.032557    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:42.208811 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:42.208689    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:42.310045 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:42.310007    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:42.315155 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:42.315119    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:42.318002 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:42.317975    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:42.527158 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:42.527117    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:08:42.611720 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:42.611585    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:42.611720 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:42.611667    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:42.618218 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:42.618191    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:42.866742 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:08:42.866306    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7167cd4_1414_4eef_ac2a_7b2a690df9b2.slice/crio-ed373f208105e64f19625abfe3c17a1d17cd18113436ba0292c568447d067237 WatchSource:0}: Error finding container ed373f208105e64f19625abfe3c17a1d17cd18113436ba0292c568447d067237: Status 404 returned error can't find the container with id ed373f208105e64f19625abfe3c17a1d17cd18113436ba0292c568447d067237
Jul 02 23:08:42.867587 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:42.867334    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 23:08:43.000883 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.000845    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7167cd4-1414-4eef-ac2a-7b2a690df9b2","Type":"ContainerStarted","Data":"ed373f208105e64f19625abfe3c17a1d17cd18113436ba0292c568447d067237"}
Jul 02 23:08:43.005468 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.005436    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:08:43.048271 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.048190    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-569fc68b46-mpsrk"]
Jul 02 23:08:43.147409 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.147373    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:43.207640 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.207611    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:43.426113 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.426074    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:08:43.458245 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.458209    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:43.504310 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.504258    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66f78f7496-p4t8t"]
Jul 02 23:08:43.518717 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.516839    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.518717 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.518644    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66f78f7496-p4t8t"]
Jul 02 23:08:43.519701 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.519501    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 02 23:08:43.519701 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.519514    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 02 23:08:43.519701 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.519501    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 02 23:08:43.520193 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.520033    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nglk8\""
Jul 02 23:08:43.520193 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.520051    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7embgkd1981qb\""
Jul 02 23:08:43.520193 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.520098    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 02 23:08:43.520193 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.520055    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 02 23:08:43.526234 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.524774    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:43.534891 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.534847    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-thanos-querier-tls\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.535047 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.534947    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.535047 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.534984    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-grpc-tls\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.535047 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.535022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4cwk\" (UniqueName: \"kubernetes.io/projected/49c85672-bf50-48b5-8740-1d845a6c1735-kube-api-access-h4cwk\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.535047 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.535043    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49c85672-bf50-48b5-8740-1d845a6c1735-metrics-client-ca\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.535225 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.535102    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.535225 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.535145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.535225 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.535175    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.637665 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.637562    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-grpc-tls\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.637665 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.637644    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4cwk\" (UniqueName: \"kubernetes.io/projected/49c85672-bf50-48b5-8740-1d845a6c1735-kube-api-access-h4cwk\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.637914 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.637680    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49c85672-bf50-48b5-8740-1d845a6c1735-metrics-client-ca\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.637914 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.637723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.637914 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.637776    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.637914 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.637822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.637914 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.637854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-thanos-querier-tls\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.637914 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.637908    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.641215 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.641176    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49c85672-bf50-48b5-8740-1d845a6c1735-metrics-client-ca\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.642665 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.642607    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.643618 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.643589    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.645081 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.644267    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.645081 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.644580    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.645081 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.645019    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-thanos-querier-tls\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.645986 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.645955    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/49c85672-bf50-48b5-8740-1d845a6c1735-secret-grpc-tls\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.648340 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.648318    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4cwk\" (UniqueName: \"kubernetes.io/projected/49c85672-bf50-48b5-8740-1d845a6c1735-kube-api-access-h4cwk\") pod \"thanos-querier-66f78f7496-p4t8t\" (UID: \"49c85672-bf50-48b5-8740-1d845a6c1735\") " pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:43.684104 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.684065    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:43.829677 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:43.829635    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:44.007562 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.007521    2581 generic.go:356] "Generic (PLEG): container finished" podID="ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22" containerID="73992e840df5145ecdef94eb2946cdc77a4900d0fe7d08f6e215b182a1fe6e5c" exitCode=0
Jul 02 23:08:44.008155 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.008128    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7vvdj" event={"ID":"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22","Type":"ContainerDied","Data":"73992e840df5145ecdef94eb2946cdc77a4900d0fe7d08f6e215b182a1fe6e5c"}
Jul 02 23:08:44.043606 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.043572    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66f78f7496-p4t8t"]
Jul 02 23:08:44.106703 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.106649    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:44.206706 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.206566    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:44.260568 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.260535    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:44.385919 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:08:44.385862    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c85672_bf50_48b5_8740_1d845a6c1735.slice/crio-826e65540ea603c85fff63083f0efb921e418ff2bfb05b69f4964b2f3b746abf WatchSource:0}: Error finding container 826e65540ea603c85fff63083f0efb921e418ff2bfb05b69f4964b2f3b746abf: Status 404 returned error can't find the container with id 826e65540ea603c85fff63083f0efb921e418ff2bfb05b69f4964b2f3b746abf
Jul 02 23:08:44.813795 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.813764    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-666cf66bbd-9ljk9"]
Jul 02 23:08:44.844819 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.844779    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-666cf66bbd-9ljk9"]
Jul 02 23:08:44.844981 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.844941    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:44.847453 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.847429    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 23:08:44.847597 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.847524    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 02 23:08:44.847597 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.847528    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gvrnj\""
Jul 02 23:08:44.847761 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.847654    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6psqvgv1c2lso\""
Jul 02 23:08:44.847820 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.847766    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 02 23:08:44.847916 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.847899    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 02 23:08:44.948693 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.948656    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/477e0b8b-d5ad-40a3-9418-68316bd6e209-client-ca-bundle\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:44.948838 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.948702    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j54m6\" (UniqueName: \"kubernetes.io/projected/477e0b8b-d5ad-40a3-9418-68316bd6e209-kube-api-access-j54m6\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:44.948914 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.948842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/477e0b8b-d5ad-40a3-9418-68316bd6e209-secret-metrics-server-tls\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:44.948963 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.948925    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/477e0b8b-d5ad-40a3-9418-68316bd6e209-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:44.948963 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.948956    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/477e0b8b-d5ad-40a3-9418-68316bd6e209-audit-log\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:44.949041 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.948986    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/477e0b8b-d5ad-40a3-9418-68316bd6e209-metrics-server-audit-profiles\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:44.949041 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:44.949014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/477e0b8b-d5ad-40a3-9418-68316bd6e209-secret-metrics-server-client-certs\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:45.015254 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.015192    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7vvdj" event={"ID":"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22","Type":"ContainerStarted","Data":"6e1bbe6caed803fc075ad4b1587f00fae8687716e327fa0b600ca09c9596b5eb"}
Jul 02 23:08:45.015473 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.015309    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7vvdj" event={"ID":"ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22","Type":"ContainerStarted","Data":"3f3279e209f8f170c657fd690de8eb792a872e5522bc866b25aa8e17a8a5d41e"}
Jul 02 23:08:45.017117 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.017086    2581 generic.go:356] "Generic (PLEG): container finished" podID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerID="671debedc280876555396981fb17dee8d11df79760c1fac9250b842a0e2151a5" exitCode=0
Jul 02 23:08:45.017279 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.017179    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7167cd4-1414-4eef-ac2a-7b2a690df9b2","Type":"ContainerDied","Data":"671debedc280876555396981fb17dee8d11df79760c1fac9250b842a0e2151a5"}
Jul 02 23:08:45.019351 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.019243    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t" event={"ID":"49c85672-bf50-48b5-8740-1d845a6c1735","Type":"ContainerStarted","Data":"826e65540ea603c85fff63083f0efb921e418ff2bfb05b69f4964b2f3b746abf"}
Jul 02 23:08:45.034488 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.034297    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7vvdj" podStartSLOduration=3.323874814 podStartE2EDuration="5.034268052s" totalImagesPullingTime="1.595302272s" totalInitContainerRuntime="115.090966ms" isStatefulPod=true podCreationTimestamp="2026-07-02 23:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:45.032201461 +0000 UTC m=+87.995634816" watchObservedRunningTime="2026-07-02 23:08:45.034268052 +0000 UTC m=+87.997701579"
Jul 02 23:08:45.050536 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.050497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/477e0b8b-d5ad-40a3-9418-68316bd6e209-secret-metrics-server-client-certs\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:45.054225 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.050832    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/477e0b8b-d5ad-40a3-9418-68316bd6e209-client-ca-bundle\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:45.054225 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.050903    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j54m6\" (UniqueName: \"kubernetes.io/projected/477e0b8b-d5ad-40a3-9418-68316bd6e209-kube-api-access-j54m6\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:45.054225 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.051752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/477e0b8b-d5ad-40a3-9418-68316bd6e209-secret-metrics-server-tls\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:45.054225 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.051845    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/477e0b8b-d5ad-40a3-9418-68316bd6e209-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:45.054225 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.051896    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/477e0b8b-d5ad-40a3-9418-68316bd6e209-audit-log\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:45.054225 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.051928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/477e0b8b-d5ad-40a3-9418-68316bd6e209-metrics-server-audit-profiles\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:45.054225 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.053544    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/477e0b8b-d5ad-40a3-9418-68316bd6e209-audit-log\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:45.054225 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.054049    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/477e0b8b-d5ad-40a3-9418-68316bd6e209-metrics-server-audit-profiles\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:45.056201 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.056127    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/477e0b8b-d5ad-40a3-9418-68316bd6e209-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:45.057402 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.057355    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/477e0b8b-d5ad-40a3-9418-68316bd6e209-client-ca-bundle\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:45.057505 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.057397    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/477e0b8b-d5ad-40a3-9418-68316bd6e209-secret-metrics-server-tls\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:45.058625 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.058555    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/477e0b8b-d5ad-40a3-9418-68316bd6e209-secret-metrics-server-client-certs\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:45.060396 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.060369    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j54m6\" (UniqueName: \"kubernetes.io/projected/477e0b8b-d5ad-40a3-9418-68316bd6e209-kube-api-access-j54m6\") pod \"metrics-server-666cf66bbd-9ljk9\" (UID: \"477e0b8b-d5ad-40a3-9418-68316bd6e209\") " pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:45.174813 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.174774    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:08:45.295956 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.294309    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:45.297920 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.297337    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-2gwxr"]
Jul 02 23:08:45.324398 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.324366    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-2gwxr"]
Jul 02 23:08:45.324398 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.324341    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gwxr"
Jul 02 23:08:45.327818 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.326998    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mplpx\""
Jul 02 23:08:45.327818 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.327269    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 02 23:08:45.354693 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.354656    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ff89c3b-ea48-4ced-9381-787ef22e0080-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-2gwxr\" (UID: \"0ff89c3b-ea48-4ced-9381-787ef22e0080\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gwxr"
Jul 02 23:08:45.354855 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.354723    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8n2f\" (UniqueName: \"kubernetes.io/projected/0ff89c3b-ea48-4ced-9381-787ef22e0080-kube-api-access-v8n2f\") pod \"monitoring-plugin-d5dcff7cf-2gwxr\" (UID: \"0ff89c3b-ea48-4ced-9381-787ef22e0080\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gwxr"
Jul 02 23:08:45.378189 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.378145    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-666cf66bbd-9ljk9"]
Jul 02 23:08:45.386762 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.386732    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:45.455971 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.455848    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ff89c3b-ea48-4ced-9381-787ef22e0080-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-2gwxr\" (UID: \"0ff89c3b-ea48-4ced-9381-787ef22e0080\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gwxr"
Jul 02 23:08:45.455971 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.455932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8n2f\" (UniqueName: \"kubernetes.io/projected/0ff89c3b-ea48-4ced-9381-787ef22e0080-kube-api-access-v8n2f\") pod \"monitoring-plugin-d5dcff7cf-2gwxr\" (UID: \"0ff89c3b-ea48-4ced-9381-787ef22e0080\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gwxr"
Jul 02 23:08:45.459530 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.459464    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0ff89c3b-ea48-4ced-9381-787ef22e0080-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-2gwxr\" (UID: \"0ff89c3b-ea48-4ced-9381-787ef22e0080\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gwxr"
Jul 02 23:08:45.465405 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.465371    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8n2f\" (UniqueName: \"kubernetes.io/projected/0ff89c3b-ea48-4ced-9381-787ef22e0080-kube-api-access-v8n2f\") pod \"monitoring-plugin-d5dcff7cf-2gwxr\" (UID: \"0ff89c3b-ea48-4ced-9381-787ef22e0080\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gwxr"
Jul 02 23:08:45.493823 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.493736    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:45.643946 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.643665    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gwxr"
Jul 02 23:08:45.856684 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:45.856605    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-2gwxr"]
Jul 02 23:08:45.861299 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:08:45.861268    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ff89c3b_ea48_4ced_9381_787ef22e0080.slice/crio-088ec8c8e267fd5d71bdfa7afa5f5f3b92c839dbd535680404f528142c3f512e WatchSource:0}: Error finding container 088ec8c8e267fd5d71bdfa7afa5f5f3b92c839dbd535680404f528142c3f512e: Status 404 returned error can't find the container with id 088ec8c8e267fd5d71bdfa7afa5f5f3b92c839dbd535680404f528142c3f512e
Jul 02 23:08:46.029385 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.029296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gwxr" event={"ID":"0ff89c3b-ea48-4ced-9381-787ef22e0080","Type":"ContainerStarted","Data":"088ec8c8e267fd5d71bdfa7afa5f5f3b92c839dbd535680404f528142c3f512e"}
Jul 02 23:08:46.031487 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.031406    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9" event={"ID":"477e0b8b-d5ad-40a3-9418-68316bd6e209","Type":"ContainerStarted","Data":"4ee11d0bfac47ed10d974239f95e3944c38849728214ddebc9920200248dd596"}
Jul 02 23:08:46.860903 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.860836    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 23:08:46.863747 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.863713    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:46.896056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.896016    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 23:08:46.896226 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.896215    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.899619 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.899588    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 23:08:46.899867 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.899848    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 23:08:46.901361 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.900710    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 23:08:46.901361 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.900803    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 23:08:46.901361 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.900939    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 23:08:46.901361 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.901199    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 23:08:46.903788 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.903039    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s7wln\""
Jul 02 23:08:46.903788 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.903529    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 23:08:46.904342 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.904184    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 23:08:46.906900 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.906301    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 23:08:46.906900 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.906506    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 23:08:46.906900 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.906661    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 23:08:46.907179 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.907156    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-13a4iv6h21cei\""
Jul 02 23:08:46.907364 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.907344    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 23:08:46.908112 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.908091    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 23:08:46.918585 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.918557    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 23:08:46.977382 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977339    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.977570 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.977570 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977456    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.977570 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977488    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-config\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.977570 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977550    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.977786 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977578    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.977786 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce375602-b7c0-4e4c-bfb3-498f378e67a9-config-out\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.977786 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.977786 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv6hg\" (UniqueName: \"kubernetes.io/projected/ce375602-b7c0-4e4c-bfb3-498f378e67a9-kube-api-access-nv6hg\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.977786 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.977786 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977689    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.977786 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977704    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.977786 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977734    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-web-config\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.977786 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977768    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.977786 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977784    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.978296 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce375602-b7c0-4e4c-bfb3-498f378e67a9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.978296 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.978296 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.978296 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977930    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:46.978296 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:46.977945    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.078750 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.078703    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.078980 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.078763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.078980 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.078804    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce375602-b7c0-4e4c-bfb3-498f378e67a9-config-out\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.078980 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.078835    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.078980 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.078860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv6hg\" (UniqueName: \"kubernetes.io/projected/ce375602-b7c0-4e4c-bfb3-498f378e67a9-kube-api-access-nv6hg\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.078980 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.078912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.078980 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.078936    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.078980 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.078959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.079320 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.078989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-web-config\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.079320 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.079020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.079320 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.079044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.079320 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.079073    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce375602-b7c0-4e4c-bfb3-498f378e67a9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.079320 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.079096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.079320 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.079143    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.079320 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.079172    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.079320 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.079197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.079320 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.079229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.079320 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.079260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.079320 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.079306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.079865 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.079332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-config\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.079865 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.079627    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.080551 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.080520    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.081225 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.081196    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.082178 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.082150    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.083400 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.082714    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.083400 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.083129    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.086136 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.085705    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.086136 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.086095    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce375602-b7c0-4e4c-bfb3-498f378e67a9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.086299 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.086225    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.086371 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.086347    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.087187 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.086712    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.087187 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.087139    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.087187 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.087148    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-web-config\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.087187 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.087169    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.088207 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.087994    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-config\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.088207 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.088173    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce375602-b7c0-4e4c-bfb3-498f378e67a9-config-out\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.088383 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.088367    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.089063 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.089024    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.089777 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.089754    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.091126 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.091098    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv6hg\" (UniqueName: \"kubernetes.io/projected/ce375602-b7c0-4e4c-bfb3-498f378e67a9-kube-api-access-nv6hg\") pod \"prometheus-k8s-0\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.220743 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.220649    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:47.340089 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.340052    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:47.440605 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:47.440560    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:49.047254 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:49.047220    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 23:08:49.372091 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:08:49.372067    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce375602_b7c0_4e4c_bfb3_498f378e67a9.slice/crio-a5b9c5cd870e51a17562f61e2433ae0a8accb0f23d1f5048d183d929de75ba73 WatchSource:0}: Error finding container a5b9c5cd870e51a17562f61e2433ae0a8accb0f23d1f5048d183d929de75ba73: Status 404 returned error can't find the container with id a5b9c5cd870e51a17562f61e2433ae0a8accb0f23d1f5048d183d929de75ba73
Jul 02 23:08:50.054086 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:50.054043    2581 generic.go:356] "Generic (PLEG): container finished" podID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerID="df4c768f5b2194008964994ce14f862d844fb3c07417ecea7c4ee84191c14334" exitCode=0
Jul 02 23:08:50.054476 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:50.054171    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce375602-b7c0-4e4c-bfb3-498f378e67a9","Type":"ContainerDied","Data":"df4c768f5b2194008964994ce14f862d844fb3c07417ecea7c4ee84191c14334"}
Jul 02 23:08:50.054476 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:50.054244    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce375602-b7c0-4e4c-bfb3-498f378e67a9","Type":"ContainerStarted","Data":"a5b9c5cd870e51a17562f61e2433ae0a8accb0f23d1f5048d183d929de75ba73"}
Jul 02 23:08:50.058744 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:50.058501    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t" event={"ID":"49c85672-bf50-48b5-8740-1d845a6c1735","Type":"ContainerStarted","Data":"b5843000edd313bab2f6f864a67e1f7eeacfb9ed4add06b40dd702c5470f22e7"}
Jul 02 23:08:50.058744 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:50.058582    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t" event={"ID":"49c85672-bf50-48b5-8740-1d845a6c1735","Type":"ContainerStarted","Data":"e8b22300635eaaae142254970cc6c08baee70882cd5e75c9c8aded55d85e8521"}
Jul 02 23:08:50.058744 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:50.058612    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t" event={"ID":"49c85672-bf50-48b5-8740-1d845a6c1735","Type":"ContainerStarted","Data":"f88102e5f15593e79d6a61fc11316e37218ab6b47e9f7637bbd4fd6a6abf60c0"}
Jul 02 23:08:50.060421 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:50.060371    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9" event={"ID":"477e0b8b-d5ad-40a3-9418-68316bd6e209","Type":"ContainerStarted","Data":"a78fb9ce1a35b5fa58e349dde5f534df5173aa6e705d229229e8eac3cf94d187"}
Jul 02 23:08:50.064041 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:50.064017    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7167cd4-1414-4eef-ac2a-7b2a690df9b2","Type":"ContainerStarted","Data":"81178ae3f788d2a4fb9cd005701e245724141a75bb0d9403861684abcacc9181"}
Jul 02 23:08:50.064139 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:50.064068    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7167cd4-1414-4eef-ac2a-7b2a690df9b2","Type":"ContainerStarted","Data":"8a349b75db05dadfaab8f26ceb4920b80e988c053ed642595624afa108398ce3"}
Jul 02 23:08:50.064139 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:50.064093    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7167cd4-1414-4eef-ac2a-7b2a690df9b2","Type":"ContainerStarted","Data":"5044501ba1fe7edd3614cf1afda45ebbb65cb59eadba60dc31a0488ddea31a6a"}
Jul 02 23:08:50.064139 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:50.064117    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7167cd4-1414-4eef-ac2a-7b2a690df9b2","Type":"ContainerStarted","Data":"1a608fdc7a6b94d3de8da94efdda9e0060b4c1e9862044244f1dec1d617b16ef"}
Jul 02 23:08:50.064289 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:50.064143    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7167cd4-1414-4eef-ac2a-7b2a690df9b2","Type":"ContainerStarted","Data":"a95112f117254d78e954e6fc12d4bd5636277f5bd3b13cfe269450f8f9aab852"}
Jul 02 23:08:50.065761 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:50.065741    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gwxr" event={"ID":"0ff89c3b-ea48-4ced-9381-787ef22e0080","Type":"ContainerStarted","Data":"1a1bb3aed938ba460657c6f353c19364cbf1ad5a1cbae52c4712caf2724dfbfb"}
Jul 02 23:08:50.066006 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:50.065984    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gwxr"
Jul 02 23:08:50.071251 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:50.071232    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gwxr"
Jul 02 23:08:50.094238 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:50.094194    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-2gwxr" podStartSLOduration=1.259255729 podStartE2EDuration="5.094178034s" totalImagesPullingTime="3.834922305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:08:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:50.093541241 +0000 UTC m=+93.056974572" watchObservedRunningTime="2026-07-02 23:08:50.094178034 +0000 UTC m=+93.057611366"
Jul 02 23:08:50.110935 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:50.110857    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9" podStartSLOduration=2.616254975 podStartE2EDuration="6.110835358s" totalImagesPullingTime="3.494580383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:08:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:50.108179816 +0000 UTC m=+93.071613150" watchObservedRunningTime="2026-07-02 23:08:50.110835358 +0000 UTC m=+93.074268692"
Jul 02 23:08:51.285620 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:51.285567    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:51.345678 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:51.345641    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:52.085061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.085023    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7167cd4-1414-4eef-ac2a-7b2a690df9b2","Type":"ContainerStarted","Data":"61acd8534e90bb550f88cc2cdded74b60cf5f7abcf8047873a73c145bf8af744"}
Jul 02 23:08:52.090047 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.090010    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t" event={"ID":"49c85672-bf50-48b5-8740-1d845a6c1735","Type":"ContainerStarted","Data":"32335ba86504fe238b5ec58699906a1f3abbc451d501ed21e3b349e644c100f8"}
Jul 02 23:08:52.090223 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.090093    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t" event={"ID":"49c85672-bf50-48b5-8740-1d845a6c1735","Type":"ContainerStarted","Data":"576fc8e55643fe2bcd2b1e6cda35c18a98c2d8e11a00f2168479b38577e4f671"}
Jul 02 23:08:52.090223 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.090135    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t" event={"ID":"49c85672-bf50-48b5-8740-1d845a6c1735","Type":"ContainerStarted","Data":"c1e95ac1d2e7d4e5f79a30b0838b468732e501cb6565fb7103571ca69254121c"}
Jul 02 23:08:52.090326 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.090227    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:08:52.112211 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.112151    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.982244637 podStartE2EDuration="11.112130573s" totalImagesPullingTime="7.110486256s" totalInitContainerRuntime="19.39968ms" isStatefulPod=false podCreationTimestamp="2026-07-02 23:08:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:52.110363911 +0000 UTC m=+95.073797245" watchObservedRunningTime="2026-07-02 23:08:52.112130573 +0000 UTC m=+95.075563937"
Jul 02 23:08:52.132460 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.132397    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t" podStartSLOduration=3.054119302 podStartE2EDuration="9.132370659s" totalImagesPullingTime="6.078251357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:08:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:52.130521004 +0000 UTC m=+95.093954337" watchObservedRunningTime="2026-07-02 23:08:52.132370659 +0000 UTC m=+95.095803992"
Jul 02 23:08:52.382578 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.382475    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6487fd5bb9-5dqrb"]
Jul 02 23:08:52.408757 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.408724    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6487fd5bb9-5dqrb"]
Jul 02 23:08:52.408962 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.408852    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.543881 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.543845    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-oauth-serving-cert\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.544048 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.543976    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-oauth-config\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.544048 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.544005    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmsk5\" (UniqueName: \"kubernetes.io/projected/0b1af846-a78d-4fd5-aabd-dca26443df4c-kube-api-access-bmsk5\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.544048 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.544038    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-serving-cert\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.544202 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.544075    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-trusted-ca-bundle\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.544202 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.544163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-config\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.544202 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.544186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-service-ca\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.644951 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.644850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-oauth-serving-cert\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.645117 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.644949    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-oauth-config\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.645117 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.644980    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmsk5\" (UniqueName: \"kubernetes.io/projected/0b1af846-a78d-4fd5-aabd-dca26443df4c-kube-api-access-bmsk5\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.645117 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.645009    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-serving-cert\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.645117 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.645068    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-trusted-ca-bundle\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.645331 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.645131    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-config\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.645331 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.645157    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-service-ca\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.646209 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.645707    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-oauth-serving-cert\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.646209 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.646163    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-service-ca\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.646401 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.646379    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-config\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.646829 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.646808    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-trusted-ca-bundle\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.648077 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.648052    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-serving-cert\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.648481 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.648459    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-oauth-config\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.653232 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.653212    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmsk5\" (UniqueName: \"kubernetes.io/projected/0b1af846-a78d-4fd5-aabd-dca26443df4c-kube-api-access-bmsk5\") pod \"console-6487fd5bb9-5dqrb\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") " pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.721083 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.721047    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:08:52.871003 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:52.870974    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6487fd5bb9-5dqrb"]
Jul 02 23:08:53.951175 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:08:53.951140    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b1af846_a78d_4fd5_aabd_dca26443df4c.slice/crio-42be91fac8855a090bae3dcfc83fdf029022bf9a46dec7ddaccafb79c9720176 WatchSource:0}: Error finding container 42be91fac8855a090bae3dcfc83fdf029022bf9a46dec7ddaccafb79c9720176: Status 404 returned error can't find the container with id 42be91fac8855a090bae3dcfc83fdf029022bf9a46dec7ddaccafb79c9720176
Jul 02 23:08:53.991346 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:53.991320    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:54.044390 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:54.044363    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:08:54.106543 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:54.106503    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6487fd5bb9-5dqrb" event={"ID":"0b1af846-a78d-4fd5-aabd-dca26443df4c","Type":"ContainerStarted","Data":"2af6c6a9aff236ac257cd53573fe618d2ec01770e177be8877204b53fe256aba"}
Jul 02 23:08:54.106694 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:54.106602    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6487fd5bb9-5dqrb" event={"ID":"0b1af846-a78d-4fd5-aabd-dca26443df4c","Type":"ContainerStarted","Data":"42be91fac8855a090bae3dcfc83fdf029022bf9a46dec7ddaccafb79c9720176"}
Jul 02 23:08:54.123828 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:54.123782    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6487fd5bb9-5dqrb" podStartSLOduration=2.123747122 podStartE2EDuration="2.123747122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:08:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:54.122960941 +0000 UTC m=+97.086394274" watchObservedRunningTime="2026-07-02 23:08:54.123747122 +0000 UTC m=+97.087180456"
Jul 02 23:08:55.114892 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:55.114803    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce375602-b7c0-4e4c-bfb3-498f378e67a9","Type":"ContainerStarted","Data":"4bf717daa86f481db92e23d04707249a419abc9475411583a5b625dfa64c1310"}
Jul 02 23:08:55.115285 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:55.114897    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce375602-b7c0-4e4c-bfb3-498f378e67a9","Type":"ContainerStarted","Data":"ac2e1f5d323fef812eb97e4826ed01a4ed56054165364aafae2b0f3a84e41921"}
Jul 02 23:08:55.115285 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:55.114926    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce375602-b7c0-4e4c-bfb3-498f378e67a9","Type":"ContainerStarted","Data":"5b59f89b38b7557001fdf1b08449d70efe835e77731e10383c9549657de2fa3f"}
Jul 02 23:08:55.115285 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:55.114959    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce375602-b7c0-4e4c-bfb3-498f378e67a9","Type":"ContainerStarted","Data":"938ad4ec077a878551b2390e600b14bc04c963dcdf08c6f533ff2db6e8440887"}
Jul 02 23:08:55.115285 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:55.114996    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce375602-b7c0-4e4c-bfb3-498f378e67a9","Type":"ContainerStarted","Data":"a3a1f86e6228650f19ff09a8e8146829e839426b4e3d7bee7d6c0bc114d13a10"}
Jul 02 23:08:55.115285 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:55.115022    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce375602-b7c0-4e4c-bfb3-498f378e67a9","Type":"ContainerStarted","Data":"cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc"}
Jul 02 23:08:55.151546 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:55.151498    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.862903965 podStartE2EDuration="9.151479729s" totalImagesPullingTime="4.273883909s" totalInitContainerRuntime="14.691855ms" isStatefulPod=false podCreationTimestamp="2026-07-02 23:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:08:55.148525003 +0000 UTC m=+98.111958335" watchObservedRunningTime="2026-07-02 23:08:55.151479729 +0000 UTC m=+98.114913061"
Jul 02 23:08:57.222094 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:57.222019    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:08:58.101362 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:08:58.101335    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66f78f7496-p4t8t"
Jul 02 23:09:00.691089 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:00.691064    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7r4br_a467ba7c-cf83-46e6-94fc-07bdd59d653e/serve-healthcheck-canary/0.log"
Jul 02 23:09:00.773458 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:00.773417    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:09:00.872376 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:00.872344    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:09:02.721541 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:02.721491    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:09:02.721541 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:02.721564    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:09:02.726559 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:02.726537    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:09:03.155067 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:03.155036    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:09:03.202155 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:03.202120    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b868fdf6f-crtq5"]
Jul 02 23:09:03.334668 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:03.334624    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:09:03.434931 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:03.434829    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:09:03.490434 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:03.490402    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:09:05.175120 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:05.175085    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:09:05.175486 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:05.175147    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:09:08.074479 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.074436    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-569fc68b46-mpsrk" podUID="486f0d5d-a45c-4526-a91b-502cc04aa1f0" containerName="console" containerID="cri-o://0b0579a97af90269317728c28396b1a60d182e4ecd5bd4f4d60d82c5ed8de38f" gracePeriod=15
Jul 02 23:09:08.351364 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.351305    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:09:08.493610 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.493577    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-config\") pod \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") "
Jul 02 23:09:08.493811 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.493618    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-oauth-config\") pod \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") "
Jul 02 23:09:08.493811 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.493663    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78bh9\" (UniqueName: \"kubernetes.io/projected/486f0d5d-a45c-4526-a91b-502cc04aa1f0-kube-api-access-78bh9\") pod \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") "
Jul 02 23:09:08.493811 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.493683    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-service-ca\") pod \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") "
Jul 02 23:09:08.493811 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.493702    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-serving-cert\") pod \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") "
Jul 02 23:09:08.493811 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.493779    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-oauth-serving-cert\") pod \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\" (UID: \"486f0d5d-a45c-4526-a91b-502cc04aa1f0\") "
Jul 02 23:09:08.494162 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.494137    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-config" (OuterVolumeSpecName: "console-config") pod "486f0d5d-a45c-4526-a91b-502cc04aa1f0" (UID: "486f0d5d-a45c-4526-a91b-502cc04aa1f0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:09:08.494271 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.494194    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-service-ca" (OuterVolumeSpecName: "service-ca") pod "486f0d5d-a45c-4526-a91b-502cc04aa1f0" (UID: "486f0d5d-a45c-4526-a91b-502cc04aa1f0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:09:08.494271 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.494235    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "486f0d5d-a45c-4526-a91b-502cc04aa1f0" (UID: "486f0d5d-a45c-4526-a91b-502cc04aa1f0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:09:08.496309 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.496279    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/486f0d5d-a45c-4526-a91b-502cc04aa1f0-kube-api-access-78bh9" (OuterVolumeSpecName: "kube-api-access-78bh9") pod "486f0d5d-a45c-4526-a91b-502cc04aa1f0" (UID: "486f0d5d-a45c-4526-a91b-502cc04aa1f0"). InnerVolumeSpecName "kube-api-access-78bh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:09:08.496667 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.496339    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "486f0d5d-a45c-4526-a91b-502cc04aa1f0" (UID: "486f0d5d-a45c-4526-a91b-502cc04aa1f0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:09:08.496667 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.496375    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "486f0d5d-a45c-4526-a91b-502cc04aa1f0" (UID: "486f0d5d-a45c-4526-a91b-502cc04aa1f0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:09:08.594956 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.594927    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-config\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:09:08.594956 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.594952    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-oauth-config\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:09:08.594956 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.594962    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78bh9\" (UniqueName: \"kubernetes.io/projected/486f0d5d-a45c-4526-a91b-502cc04aa1f0-kube-api-access-78bh9\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:09:08.595170 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.594972    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-service-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:09:08.595170 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.594981    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/486f0d5d-a45c-4526-a91b-502cc04aa1f0-console-serving-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:09:08.595170 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.594988    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/486f0d5d-a45c-4526-a91b-502cc04aa1f0-oauth-serving-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:09:08.974216 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.974190    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7k6dt"
Jul 02 23:09:08.997151 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:08.997122    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:09:09.101247 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:09.101212    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:09:09.172460 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:09.172426    2581 generic.go:356] "Generic (PLEG): container finished" podID="486f0d5d-a45c-4526-a91b-502cc04aa1f0" containerID="0b0579a97af90269317728c28396b1a60d182e4ecd5bd4f4d60d82c5ed8de38f" exitCode=0
Jul 02 23:09:09.172635 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:09.172470    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-569fc68b46-mpsrk"
Jul 02 23:09:09.172635 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:09.172504    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-569fc68b46-mpsrk" event={"ID":"486f0d5d-a45c-4526-a91b-502cc04aa1f0","Type":"ContainerDied","Data":"0b0579a97af90269317728c28396b1a60d182e4ecd5bd4f4d60d82c5ed8de38f"}
Jul 02 23:09:09.172635 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:09.172551    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-569fc68b46-mpsrk" event={"ID":"486f0d5d-a45c-4526-a91b-502cc04aa1f0","Type":"ContainerDied","Data":"13448b86e85d7379554dc56a62a3d98fc95f1916d9868e0d40c90894d43f98e3"}
Jul 02 23:09:09.172635 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:09.172571    2581 scope.go:117] "RemoveContainer" containerID="0b0579a97af90269317728c28396b1a60d182e4ecd5bd4f4d60d82c5ed8de38f"
Jul 02 23:09:09.183529 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:09.183504    2581 scope.go:117] "RemoveContainer" containerID="0b0579a97af90269317728c28396b1a60d182e4ecd5bd4f4d60d82c5ed8de38f"
Jul 02 23:09:09.183916 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:09:09.183868    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b0579a97af90269317728c28396b1a60d182e4ecd5bd4f4d60d82c5ed8de38f\": container with ID starting with 0b0579a97af90269317728c28396b1a60d182e4ecd5bd4f4d60d82c5ed8de38f not found: ID does not exist" containerID="0b0579a97af90269317728c28396b1a60d182e4ecd5bd4f4d60d82c5ed8de38f"
Jul 02 23:09:09.183973 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:09.183928    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b0579a97af90269317728c28396b1a60d182e4ecd5bd4f4d60d82c5ed8de38f"} err="failed to get container status \"0b0579a97af90269317728c28396b1a60d182e4ecd5bd4f4d60d82c5ed8de38f\": rpc error: code = NotFound desc = could not find container \"0b0579a97af90269317728c28396b1a60d182e4ecd5bd4f4d60d82c5ed8de38f\": container with ID starting with 0b0579a97af90269317728c28396b1a60d182e4ecd5bd4f4d60d82c5ed8de38f not found: ID does not exist"
Jul 02 23:09:09.193892 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:09.193846    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-569fc68b46-mpsrk"]
Jul 02 23:09:09.197501 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:09.197472    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-569fc68b46-mpsrk"]
Jul 02 23:09:09.570643 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:09.570608    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="486f0d5d-a45c-4526-a91b-502cc04aa1f0" path="/var/lib/kubelet/pods/486f0d5d-a45c-4526-a91b-502cc04aa1f0/volumes"
Jul 02 23:09:25.180827 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:25.180793    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:09:25.184632 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:25.184608    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-666cf66bbd-9ljk9"
Jul 02 23:09:28.225824 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.225765    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b868fdf6f-crtq5" podUID="e80d0c9c-4286-49eb-83fc-9f5bc374576d" containerName="console" containerID="cri-o://6586d6b7c1559a51c950614b0b5ae9945c95d859d3d04c6be8af61807dbab54e" gracePeriod=15
Jul 02 23:09:28.515423 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.515391    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:09:28.576737 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.576703    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-serving-cert\") pod \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") "
Jul 02 23:09:28.577014 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.576756    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8s5f\" (UniqueName: \"kubernetes.io/projected/e80d0c9c-4286-49eb-83fc-9f5bc374576d-kube-api-access-f8s5f\") pod \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") "
Jul 02 23:09:28.577014 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.576796    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-oauth-config\") pod \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") "
Jul 02 23:09:28.577014 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.576812    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-service-ca\") pod \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") "
Jul 02 23:09:28.577014 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.576836    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-config\") pod \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") "
Jul 02 23:09:28.577014 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.576901    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-trusted-ca-bundle\") pod \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") "
Jul 02 23:09:28.577014 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.576976    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-oauth-serving-cert\") pod \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\" (UID: \"e80d0c9c-4286-49eb-83fc-9f5bc374576d\") "
Jul 02 23:09:28.577340 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.577272    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-config" (OuterVolumeSpecName: "console-config") pod "e80d0c9c-4286-49eb-83fc-9f5bc374576d" (UID: "e80d0c9c-4286-49eb-83fc-9f5bc374576d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:09:28.577340 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.577289    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-service-ca" (OuterVolumeSpecName: "service-ca") pod "e80d0c9c-4286-49eb-83fc-9f5bc374576d" (UID: "e80d0c9c-4286-49eb-83fc-9f5bc374576d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:09:28.577455 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.577427    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e80d0c9c-4286-49eb-83fc-9f5bc374576d" (UID: "e80d0c9c-4286-49eb-83fc-9f5bc374576d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:09:28.577511 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.577468    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e80d0c9c-4286-49eb-83fc-9f5bc374576d" (UID: "e80d0c9c-4286-49eb-83fc-9f5bc374576d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:09:28.579277 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.579252    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e80d0c9c-4286-49eb-83fc-9f5bc374576d" (UID: "e80d0c9c-4286-49eb-83fc-9f5bc374576d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:09:28.579390 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.579298    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e80d0c9c-4286-49eb-83fc-9f5bc374576d-kube-api-access-f8s5f" (OuterVolumeSpecName: "kube-api-access-f8s5f") pod "e80d0c9c-4286-49eb-83fc-9f5bc374576d" (UID: "e80d0c9c-4286-49eb-83fc-9f5bc374576d"). InnerVolumeSpecName "kube-api-access-f8s5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:09:28.579390 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.579321    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e80d0c9c-4286-49eb-83fc-9f5bc374576d" (UID: "e80d0c9c-4286-49eb-83fc-9f5bc374576d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:09:28.677788 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.677748    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-oauth-serving-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:09:28.677788 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.677781    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-serving-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:09:28.677788 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.677790    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8s5f\" (UniqueName: \"kubernetes.io/projected/e80d0c9c-4286-49eb-83fc-9f5bc374576d-kube-api-access-f8s5f\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:09:28.677788 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.677799    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-oauth-config\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:09:28.678072 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.677808    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-service-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:09:28.678072 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.677816    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-console-config\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:09:28.678072 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:28.677824    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e80d0c9c-4286-49eb-83fc-9f5bc374576d-trusted-ca-bundle\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:09:29.238636 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:29.238603    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:09:29.262045 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:29.262015    2581 generic.go:356] "Generic (PLEG): container finished" podID="e80d0c9c-4286-49eb-83fc-9f5bc374576d" containerID="6586d6b7c1559a51c950614b0b5ae9945c95d859d3d04c6be8af61807dbab54e" exitCode=0
Jul 02 23:09:29.262194 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:29.262063    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b868fdf6f-crtq5" event={"ID":"e80d0c9c-4286-49eb-83fc-9f5bc374576d","Type":"ContainerDied","Data":"6586d6b7c1559a51c950614b0b5ae9945c95d859d3d04c6be8af61807dbab54e"}
Jul 02 23:09:29.262194 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:29.262070    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b868fdf6f-crtq5"
Jul 02 23:09:29.262194 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:29.262099    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b868fdf6f-crtq5" event={"ID":"e80d0c9c-4286-49eb-83fc-9f5bc374576d","Type":"ContainerDied","Data":"d19fc712e850031bb0dbada9b8ad9fe0d62d500d58f0d03343fbba6aaf2d10be"}
Jul 02 23:09:29.262194 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:29.262119    2581 scope.go:117] "RemoveContainer" containerID="6586d6b7c1559a51c950614b0b5ae9945c95d859d3d04c6be8af61807dbab54e"
Jul 02 23:09:29.270836 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:29.270820    2581 scope.go:117] "RemoveContainer" containerID="6586d6b7c1559a51c950614b0b5ae9945c95d859d3d04c6be8af61807dbab54e"
Jul 02 23:09:29.271136 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:09:29.271117    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6586d6b7c1559a51c950614b0b5ae9945c95d859d3d04c6be8af61807dbab54e\": container with ID starting with 6586d6b7c1559a51c950614b0b5ae9945c95d859d3d04c6be8af61807dbab54e not found: ID does not exist" containerID="6586d6b7c1559a51c950614b0b5ae9945c95d859d3d04c6be8af61807dbab54e"
Jul 02 23:09:29.271185 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:29.271145    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6586d6b7c1559a51c950614b0b5ae9945c95d859d3d04c6be8af61807dbab54e"} err="failed to get container status \"6586d6b7c1559a51c950614b0b5ae9945c95d859d3d04c6be8af61807dbab54e\": rpc error: code = NotFound desc = could not find container \"6586d6b7c1559a51c950614b0b5ae9945c95d859d3d04c6be8af61807dbab54e\": container with ID starting with 6586d6b7c1559a51c950614b0b5ae9945c95d859d3d04c6be8af61807dbab54e not found: ID does not exist"
Jul 02 23:09:29.281794 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:29.281771    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b868fdf6f-crtq5"]
Jul 02 23:09:29.286072 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:29.286053    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b868fdf6f-crtq5"]
Jul 02 23:09:29.300900 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:29.300860    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:09:29.571119 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:29.571091    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e80d0c9c-4286-49eb-83fc-9f5bc374576d" path="/var/lib/kubelet/pods/e80d0c9c-4286-49eb-83fc-9f5bc374576d/volumes"
Jul 02 23:09:42.342513 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:42.342477    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:09:47.222119 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:47.222070    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:09:47.242564 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:47.242533    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:09:47.354641 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:47.354612    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:09:56.637930 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:56.637868    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:09:56.738552 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:09:56.738518    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:00.868987 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:00.868950    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 23:10:00.869436 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:00.869216    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="alertmanager" containerID="cri-o://a95112f117254d78e954e6fc12d4bd5636277f5bd3b13cfe269450f8f9aab852" gracePeriod=120
Jul 02 23:10:00.869436 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:00.869295    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="kube-rbac-proxy-metric" containerID="cri-o://81178ae3f788d2a4fb9cd005701e245724141a75bb0d9403861684abcacc9181" gracePeriod=120
Jul 02 23:10:00.869436 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:00.869312    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="prom-label-proxy" containerID="cri-o://61acd8534e90bb550f88cc2cdded74b60cf5f7abcf8047873a73c145bf8af744" gracePeriod=120
Jul 02 23:10:00.869436 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:00.869318    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="kube-rbac-proxy-web" containerID="cri-o://5044501ba1fe7edd3614cf1afda45ebbb65cb59eadba60dc31a0488ddea31a6a" gracePeriod=120
Jul 02 23:10:00.869436 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:00.869343    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="config-reloader" containerID="cri-o://1a608fdc7a6b94d3de8da94efdda9e0060b4c1e9862044244f1dec1d617b16ef" gracePeriod=120
Jul 02 23:10:00.869436 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:00.869382    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="kube-rbac-proxy" containerID="cri-o://8a349b75db05dadfaab8f26ceb4920b80e988c053ed642595624afa108398ce3" gracePeriod=120
Jul 02 23:10:01.392132 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:01.392098    2581 generic.go:356] "Generic (PLEG): container finished" podID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerID="61acd8534e90bb550f88cc2cdded74b60cf5f7abcf8047873a73c145bf8af744" exitCode=0
Jul 02 23:10:01.392132 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:01.392122    2581 generic.go:356] "Generic (PLEG): container finished" podID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerID="81178ae3f788d2a4fb9cd005701e245724141a75bb0d9403861684abcacc9181" exitCode=0
Jul 02 23:10:01.392132 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:01.392128    2581 generic.go:356] "Generic (PLEG): container finished" podID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerID="8a349b75db05dadfaab8f26ceb4920b80e988c053ed642595624afa108398ce3" exitCode=0
Jul 02 23:10:01.392132 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:01.392133    2581 generic.go:356] "Generic (PLEG): container finished" podID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerID="1a608fdc7a6b94d3de8da94efdda9e0060b4c1e9862044244f1dec1d617b16ef" exitCode=0
Jul 02 23:10:01.392132 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:01.392138    2581 generic.go:356] "Generic (PLEG): container finished" podID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerID="a95112f117254d78e954e6fc12d4bd5636277f5bd3b13cfe269450f8f9aab852" exitCode=0
Jul 02 23:10:01.392408 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:01.392170    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7167cd4-1414-4eef-ac2a-7b2a690df9b2","Type":"ContainerDied","Data":"61acd8534e90bb550f88cc2cdded74b60cf5f7abcf8047873a73c145bf8af744"}
Jul 02 23:10:01.392408 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:01.392234    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7167cd4-1414-4eef-ac2a-7b2a690df9b2","Type":"ContainerDied","Data":"81178ae3f788d2a4fb9cd005701e245724141a75bb0d9403861684abcacc9181"}
Jul 02 23:10:01.392408 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:01.392259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7167cd4-1414-4eef-ac2a-7b2a690df9b2","Type":"ContainerDied","Data":"8a349b75db05dadfaab8f26ceb4920b80e988c053ed642595624afa108398ce3"}
Jul 02 23:10:01.392408 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:01.392282    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7167cd4-1414-4eef-ac2a-7b2a690df9b2","Type":"ContainerDied","Data":"1a608fdc7a6b94d3de8da94efdda9e0060b4c1e9862044244f1dec1d617b16ef"}
Jul 02 23:10:01.392408 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:01.392304    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7167cd4-1414-4eef-ac2a-7b2a690df9b2","Type":"ContainerDied","Data":"a95112f117254d78e954e6fc12d4bd5636277f5bd3b13cfe269450f8f9aab852"}
Jul 02 23:10:02.141700 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.141674    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:10:02.179906 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.179857    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-cluster-tls-config\") pod \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") "
Jul 02 23:10:02.180099 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.179920    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") "
Jul 02 23:10:02.180099 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.179954    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy\") pod \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") "
Jul 02 23:10:02.180099 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.179984    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-metrics-client-ca\") pod \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") "
Jul 02 23:10:02.180099 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.180019    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-web-config\") pod \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") "
Jul 02 23:10:02.180099 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.180056    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-main-tls\") pod \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") "
Jul 02 23:10:02.180370 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.180124    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-tls-assets\") pod \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") "
Jul 02 23:10:02.180370 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.180170    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxrjg\" (UniqueName: \"kubernetes.io/projected/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-kube-api-access-qxrjg\") pod \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") "
Jul 02 23:10:02.180370 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.180200    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-config-volume\") pod \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") "
Jul 02 23:10:02.180370 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.180225    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-config-out\") pod \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") "
Jul 02 23:10:02.180370 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.180245    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-alertmanager-trusted-ca-bundle\") pod \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") "
Jul 02 23:10:02.180370 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.180271    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-alertmanager-main-db\") pod \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") "
Jul 02 23:10:02.180370 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.180297    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy-web\") pod \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\" (UID: \"f7167cd4-1414-4eef-ac2a-7b2a690df9b2\") "
Jul 02 23:10:02.181534 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.181500    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f7167cd4-1414-4eef-ac2a-7b2a690df9b2" (UID: "f7167cd4-1414-4eef-ac2a-7b2a690df9b2"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:10:02.183905 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.183108    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f7167cd4-1414-4eef-ac2a-7b2a690df9b2" (UID: "f7167cd4-1414-4eef-ac2a-7b2a690df9b2"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:10:02.183905 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.183806    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f7167cd4-1414-4eef-ac2a-7b2a690df9b2" (UID: "f7167cd4-1414-4eef-ac2a-7b2a690df9b2"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:10:02.185063 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.185017    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f7167cd4-1414-4eef-ac2a-7b2a690df9b2" (UID: "f7167cd4-1414-4eef-ac2a-7b2a690df9b2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:02.185168 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.185070    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-config-volume" (OuterVolumeSpecName: "config-volume") pod "f7167cd4-1414-4eef-ac2a-7b2a690df9b2" (UID: "f7167cd4-1414-4eef-ac2a-7b2a690df9b2"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:02.186389 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.186330    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f7167cd4-1414-4eef-ac2a-7b2a690df9b2" (UID: "f7167cd4-1414-4eef-ac2a-7b2a690df9b2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:10:02.188487 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.188440    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-config-out" (OuterVolumeSpecName: "config-out") pod "f7167cd4-1414-4eef-ac2a-7b2a690df9b2" (UID: "f7167cd4-1414-4eef-ac2a-7b2a690df9b2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:10:02.188623 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.188547    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f7167cd4-1414-4eef-ac2a-7b2a690df9b2" (UID: "f7167cd4-1414-4eef-ac2a-7b2a690df9b2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:02.188922 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.188894    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f7167cd4-1414-4eef-ac2a-7b2a690df9b2" (UID: "f7167cd4-1414-4eef-ac2a-7b2a690df9b2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:02.189361 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.189333    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f7167cd4-1414-4eef-ac2a-7b2a690df9b2" (UID: "f7167cd4-1414-4eef-ac2a-7b2a690df9b2"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:02.189483 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.189366    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f7167cd4-1414-4eef-ac2a-7b2a690df9b2" (UID: "f7167cd4-1414-4eef-ac2a-7b2a690df9b2"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:02.190459 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.190338    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-kube-api-access-qxrjg" (OuterVolumeSpecName: "kube-api-access-qxrjg") pod "f7167cd4-1414-4eef-ac2a-7b2a690df9b2" (UID: "f7167cd4-1414-4eef-ac2a-7b2a690df9b2"). InnerVolumeSpecName "kube-api-access-qxrjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:10:02.199983 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.199955    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-web-config" (OuterVolumeSpecName: "web-config") pod "f7167cd4-1414-4eef-ac2a-7b2a690df9b2" (UID: "f7167cd4-1414-4eef-ac2a-7b2a690df9b2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:02.281038 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.280998    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxrjg\" (UniqueName: \"kubernetes.io/projected/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-kube-api-access-qxrjg\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:02.281038 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.281032    2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-config-volume\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:02.281038 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.281041    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-config-out\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:02.281265 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.281051    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:02.281265 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.281061    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-alertmanager-main-db\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:02.281265 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.281072    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:02.281265 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.281080    2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-cluster-tls-config\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:02.281265 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.281089    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:02.281265 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.281098    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:02.281265 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.281106    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-metrics-client-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:02.281265 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.281114    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-web-config\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:02.281265 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.281137    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-secret-alertmanager-main-tls\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:02.281265 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.281145    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f7167cd4-1414-4eef-ac2a-7b2a690df9b2-tls-assets\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:02.399028 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.398993    2581 generic.go:356] "Generic (PLEG): container finished" podID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerID="5044501ba1fe7edd3614cf1afda45ebbb65cb59eadba60dc31a0488ddea31a6a" exitCode=0
Jul 02 23:10:02.399224 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.399046    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7167cd4-1414-4eef-ac2a-7b2a690df9b2","Type":"ContainerDied","Data":"5044501ba1fe7edd3614cf1afda45ebbb65cb59eadba60dc31a0488ddea31a6a"}
Jul 02 23:10:02.399224 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.399093    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 23:10:02.399224 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.399102    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f7167cd4-1414-4eef-ac2a-7b2a690df9b2","Type":"ContainerDied","Data":"ed373f208105e64f19625abfe3c17a1d17cd18113436ba0292c568447d067237"}
Jul 02 23:10:02.399224 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.399133    2581 scope.go:117] "RemoveContainer" containerID="61acd8534e90bb550f88cc2cdded74b60cf5f7abcf8047873a73c145bf8af744"
Jul 02 23:10:02.409896 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.409849    2581 scope.go:117] "RemoveContainer" containerID="81178ae3f788d2a4fb9cd005701e245724141a75bb0d9403861684abcacc9181"
Jul 02 23:10:02.417585 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.417569    2581 scope.go:117] "RemoveContainer" containerID="8a349b75db05dadfaab8f26ceb4920b80e988c053ed642595624afa108398ce3"
Jul 02 23:10:02.424794 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.424768    2581 scope.go:117] "RemoveContainer" containerID="5044501ba1fe7edd3614cf1afda45ebbb65cb59eadba60dc31a0488ddea31a6a"
Jul 02 23:10:02.426028 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.426004    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 23:10:02.430179 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.430154    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 23:10:02.433568 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.433552    2581 scope.go:117] "RemoveContainer" containerID="1a608fdc7a6b94d3de8da94efdda9e0060b4c1e9862044244f1dec1d617b16ef"
Jul 02 23:10:02.440416 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.440398    2581 scope.go:117] "RemoveContainer" containerID="a95112f117254d78e954e6fc12d4bd5636277f5bd3b13cfe269450f8f9aab852"
Jul 02 23:10:02.447447 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.447426    2581 scope.go:117] "RemoveContainer" containerID="671debedc280876555396981fb17dee8d11df79760c1fac9250b842a0e2151a5"
Jul 02 23:10:02.454199 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.454175    2581 scope.go:117] "RemoveContainer" containerID="61acd8534e90bb550f88cc2cdded74b60cf5f7abcf8047873a73c145bf8af744"
Jul 02 23:10:02.454478 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:02.454456    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61acd8534e90bb550f88cc2cdded74b60cf5f7abcf8047873a73c145bf8af744\": container with ID starting with 61acd8534e90bb550f88cc2cdded74b60cf5f7abcf8047873a73c145bf8af744 not found: ID does not exist" containerID="61acd8534e90bb550f88cc2cdded74b60cf5f7abcf8047873a73c145bf8af744"
Jul 02 23:10:02.454561 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.454491    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61acd8534e90bb550f88cc2cdded74b60cf5f7abcf8047873a73c145bf8af744"} err="failed to get container status \"61acd8534e90bb550f88cc2cdded74b60cf5f7abcf8047873a73c145bf8af744\": rpc error: code = NotFound desc = could not find container \"61acd8534e90bb550f88cc2cdded74b60cf5f7abcf8047873a73c145bf8af744\": container with ID starting with 61acd8534e90bb550f88cc2cdded74b60cf5f7abcf8047873a73c145bf8af744 not found: ID does not exist"
Jul 02 23:10:02.454561 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.454518    2581 scope.go:117] "RemoveContainer" containerID="81178ae3f788d2a4fb9cd005701e245724141a75bb0d9403861684abcacc9181"
Jul 02 23:10:02.454736 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:02.454718    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81178ae3f788d2a4fb9cd005701e245724141a75bb0d9403861684abcacc9181\": container with ID starting with 81178ae3f788d2a4fb9cd005701e245724141a75bb0d9403861684abcacc9181 not found: ID does not exist" containerID="81178ae3f788d2a4fb9cd005701e245724141a75bb0d9403861684abcacc9181"
Jul 02 23:10:02.454782 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.454744    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81178ae3f788d2a4fb9cd005701e245724141a75bb0d9403861684abcacc9181"} err="failed to get container status \"81178ae3f788d2a4fb9cd005701e245724141a75bb0d9403861684abcacc9181\": rpc error: code = NotFound desc = could not find container \"81178ae3f788d2a4fb9cd005701e245724141a75bb0d9403861684abcacc9181\": container with ID starting with 81178ae3f788d2a4fb9cd005701e245724141a75bb0d9403861684abcacc9181 not found: ID does not exist"
Jul 02 23:10:02.454782 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.454765    2581 scope.go:117] "RemoveContainer" containerID="8a349b75db05dadfaab8f26ceb4920b80e988c053ed642595624afa108398ce3"
Jul 02 23:10:02.455096 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:02.455078    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a349b75db05dadfaab8f26ceb4920b80e988c053ed642595624afa108398ce3\": container with ID starting with 8a349b75db05dadfaab8f26ceb4920b80e988c053ed642595624afa108398ce3 not found: ID does not exist" containerID="8a349b75db05dadfaab8f26ceb4920b80e988c053ed642595624afa108398ce3"
Jul 02 23:10:02.455161 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.455102    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a349b75db05dadfaab8f26ceb4920b80e988c053ed642595624afa108398ce3"} err="failed to get container status \"8a349b75db05dadfaab8f26ceb4920b80e988c053ed642595624afa108398ce3\": rpc error: code = NotFound desc = could not find container \"8a349b75db05dadfaab8f26ceb4920b80e988c053ed642595624afa108398ce3\": container with ID starting with 8a349b75db05dadfaab8f26ceb4920b80e988c053ed642595624afa108398ce3 not found: ID does not exist"
Jul 02 23:10:02.455161 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.455117    2581 scope.go:117] "RemoveContainer" containerID="5044501ba1fe7edd3614cf1afda45ebbb65cb59eadba60dc31a0488ddea31a6a"
Jul 02 23:10:02.455364 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:02.455347    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5044501ba1fe7edd3614cf1afda45ebbb65cb59eadba60dc31a0488ddea31a6a\": container with ID starting with 5044501ba1fe7edd3614cf1afda45ebbb65cb59eadba60dc31a0488ddea31a6a not found: ID does not exist" containerID="5044501ba1fe7edd3614cf1afda45ebbb65cb59eadba60dc31a0488ddea31a6a"
Jul 02 23:10:02.455405 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.455371    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5044501ba1fe7edd3614cf1afda45ebbb65cb59eadba60dc31a0488ddea31a6a"} err="failed to get container status \"5044501ba1fe7edd3614cf1afda45ebbb65cb59eadba60dc31a0488ddea31a6a\": rpc error: code = NotFound desc = could not find container \"5044501ba1fe7edd3614cf1afda45ebbb65cb59eadba60dc31a0488ddea31a6a\": container with ID starting with 5044501ba1fe7edd3614cf1afda45ebbb65cb59eadba60dc31a0488ddea31a6a not found: ID does not exist"
Jul 02 23:10:02.455405 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.455388    2581 scope.go:117] "RemoveContainer" containerID="1a608fdc7a6b94d3de8da94efdda9e0060b4c1e9862044244f1dec1d617b16ef"
Jul 02 23:10:02.455628 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:02.455601    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a608fdc7a6b94d3de8da94efdda9e0060b4c1e9862044244f1dec1d617b16ef\": container with ID starting with 1a608fdc7a6b94d3de8da94efdda9e0060b4c1e9862044244f1dec1d617b16ef not found: ID does not exist" containerID="1a608fdc7a6b94d3de8da94efdda9e0060b4c1e9862044244f1dec1d617b16ef"
Jul 02 23:10:02.455673 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.455631    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a608fdc7a6b94d3de8da94efdda9e0060b4c1e9862044244f1dec1d617b16ef"} err="failed to get container status \"1a608fdc7a6b94d3de8da94efdda9e0060b4c1e9862044244f1dec1d617b16ef\": rpc error: code = NotFound desc = could not find container \"1a608fdc7a6b94d3de8da94efdda9e0060b4c1e9862044244f1dec1d617b16ef\": container with ID starting with 1a608fdc7a6b94d3de8da94efdda9e0060b4c1e9862044244f1dec1d617b16ef not found: ID does not exist"
Jul 02 23:10:02.455673 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.455643    2581 scope.go:117] "RemoveContainer" containerID="a95112f117254d78e954e6fc12d4bd5636277f5bd3b13cfe269450f8f9aab852"
Jul 02 23:10:02.455862 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:02.455847    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a95112f117254d78e954e6fc12d4bd5636277f5bd3b13cfe269450f8f9aab852\": container with ID starting with a95112f117254d78e954e6fc12d4bd5636277f5bd3b13cfe269450f8f9aab852 not found: ID does not exist" containerID="a95112f117254d78e954e6fc12d4bd5636277f5bd3b13cfe269450f8f9aab852"
Jul 02 23:10:02.455935 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.455865    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a95112f117254d78e954e6fc12d4bd5636277f5bd3b13cfe269450f8f9aab852"} err="failed to get container status \"a95112f117254d78e954e6fc12d4bd5636277f5bd3b13cfe269450f8f9aab852\": rpc error: code = NotFound desc = could not find container \"a95112f117254d78e954e6fc12d4bd5636277f5bd3b13cfe269450f8f9aab852\": container with ID starting with a95112f117254d78e954e6fc12d4bd5636277f5bd3b13cfe269450f8f9aab852 not found: ID does not exist"
Jul 02 23:10:02.455935 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.455901    2581 scope.go:117] "RemoveContainer" containerID="671debedc280876555396981fb17dee8d11df79760c1fac9250b842a0e2151a5"
Jul 02 23:10:02.456118 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:02.456098    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"671debedc280876555396981fb17dee8d11df79760c1fac9250b842a0e2151a5\": container with ID starting with 671debedc280876555396981fb17dee8d11df79760c1fac9250b842a0e2151a5 not found: ID does not exist" containerID="671debedc280876555396981fb17dee8d11df79760c1fac9250b842a0e2151a5"
Jul 02 23:10:02.456211 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:02.456120    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"671debedc280876555396981fb17dee8d11df79760c1fac9250b842a0e2151a5"} err="failed to get container status \"671debedc280876555396981fb17dee8d11df79760c1fac9250b842a0e2151a5\": rpc error: code = NotFound desc = could not find container \"671debedc280876555396981fb17dee8d11df79760c1fac9250b842a0e2151a5\": container with ID starting with 671debedc280876555396981fb17dee8d11df79760c1fac9250b842a0e2151a5 not found: ID does not exist"
Jul 02 23:10:03.571202 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:03.571167    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" path="/var/lib/kubelet/pods/f7167cd4-1414-4eef-ac2a-7b2a690df9b2/volumes"
Jul 02 23:10:05.132543 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:05.132495    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 23:10:05.133074 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:05.132997    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="prometheus" containerID="cri-o://cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc" gracePeriod=600
Jul 02 23:10:05.133074 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:05.133036    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4bf717daa86f481db92e23d04707249a419abc9475411583a5b625dfa64c1310" gracePeriod=600
Jul 02 23:10:05.133190 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:05.133131    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="thanos-sidecar" containerID="cri-o://938ad4ec077a878551b2390e600b14bc04c963dcdf08c6f533ff2db6e8440887" gracePeriod=600
Jul 02 23:10:05.133247 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:05.133196    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="config-reloader" containerID="cri-o://a3a1f86e6228650f19ff09a8e8146829e839426b4e3d7bee7d6c0bc114d13a10" gracePeriod=600
Jul 02 23:10:05.133247 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:05.133216    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="kube-rbac-proxy" containerID="cri-o://ac2e1f5d323fef812eb97e4826ed01a4ed56054165364aafae2b0f3a84e41921" gracePeriod=600
Jul 02 23:10:05.133348 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:05.133275    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="kube-rbac-proxy-web" containerID="cri-o://5b59f89b38b7557001fdf1b08449d70efe835e77731e10383c9549657de2fa3f" gracePeriod=600
Jul 02 23:10:05.425735 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:05.425623    2581 generic.go:356] "Generic (PLEG): container finished" podID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerID="5b59f89b38b7557001fdf1b08449d70efe835e77731e10383c9549657de2fa3f" exitCode=0
Jul 02 23:10:05.425735 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:05.425682    2581 generic.go:356] "Generic (PLEG): container finished" podID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerID="938ad4ec077a878551b2390e600b14bc04c963dcdf08c6f533ff2db6e8440887" exitCode=0
Jul 02 23:10:05.425735 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:05.425697    2581 generic.go:356] "Generic (PLEG): container finished" podID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerID="a3a1f86e6228650f19ff09a8e8146829e839426b4e3d7bee7d6c0bc114d13a10" exitCode=0
Jul 02 23:10:05.425735 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:05.425696    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce375602-b7c0-4e4c-bfb3-498f378e67a9","Type":"ContainerDied","Data":"5b59f89b38b7557001fdf1b08449d70efe835e77731e10383c9549657de2fa3f"}
Jul 02 23:10:05.426085 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:05.425833    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce375602-b7c0-4e4c-bfb3-498f378e67a9","Type":"ContainerDied","Data":"938ad4ec077a878551b2390e600b14bc04c963dcdf08c6f533ff2db6e8440887"}
Jul 02 23:10:05.426085 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:05.425864    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce375602-b7c0-4e4c-bfb3-498f378e67a9","Type":"ContainerDied","Data":"a3a1f86e6228650f19ff09a8e8146829e839426b4e3d7bee7d6c0bc114d13a10"}
Jul 02 23:10:06.433963 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:06.433926    2581 generic.go:356] "Generic (PLEG): container finished" podID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerID="4bf717daa86f481db92e23d04707249a419abc9475411583a5b625dfa64c1310" exitCode=0
Jul 02 23:10:06.433963 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:06.433951    2581 generic.go:356] "Generic (PLEG): container finished" podID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerID="ac2e1f5d323fef812eb97e4826ed01a4ed56054165364aafae2b0f3a84e41921" exitCode=0
Jul 02 23:10:06.434506 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:06.434001    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce375602-b7c0-4e4c-bfb3-498f378e67a9","Type":"ContainerDied","Data":"4bf717daa86f481db92e23d04707249a419abc9475411583a5b625dfa64c1310"}
Jul 02 23:10:06.434506 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:06.434086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce375602-b7c0-4e4c-bfb3-498f378e67a9","Type":"ContainerDied","Data":"ac2e1f5d323fef812eb97e4826ed01a4ed56054165364aafae2b0f3a84e41921"}
Jul 02 23:10:07.338633 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:07.338594    2581 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Jul 02 23:10:07.339552 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:07.339515    2581 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Jul 02 23:10:07.340442 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:07.340405    2581 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" containerID="cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Jul 02 23:10:07.340519 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:07.340454    2581 prober.go:104] "Probe errored" err="rpc error: code = Unknown desc = command error: cannot register an exec PID: container is stopping, stdout: , stderr: , exit code -1" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="prometheus" probeResult="unknown"
Jul 02 23:10:07.712719 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:07.712596    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:07.766144 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:07.766092    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:07.845217 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:07.845177    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:07.896064 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:07.896023    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:08.447445 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:08.447407    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:08.547417 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:08.547375    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:08.602466 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:08.602439    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:12.337765 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:12.337721    2581 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc is running failed: container process not found" containerID="cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Jul 02 23:10:12.338222 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:12.338123    2581 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc is running failed: container process not found" containerID="cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Jul 02 23:10:12.338416 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:12.338395    2581 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc is running failed: container process not found" containerID="cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc" cmd=["sh","-c","if [ -x \"$(command -v curl)\" ]; then exec curl --fail http://localhost:9090/-/ready; elif [ -x \"$(command -v wget)\" ]; then exec wget -q -O /dev/null http://localhost:9090/-/ready; else exit 1; fi"]
Jul 02 23:10:12.338494 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:12.338429    2581 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc is running failed: container process not found" probeType="Readiness" pod="openshift-monitoring/prometheus-k8s-0" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="prometheus" probeResult="unknown"
Jul 02 23:10:12.387720 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.387695    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.465202 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465163    2581 generic.go:356] "Generic (PLEG): container finished" podID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerID="cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc" exitCode=0
Jul 02 23:10:12.465387 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465256    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce375602-b7c0-4e4c-bfb3-498f378e67a9","Type":"ContainerDied","Data":"cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc"}
Jul 02 23:10:12.465387 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465270    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.465387 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465316    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ce375602-b7c0-4e4c-bfb3-498f378e67a9","Type":"ContainerDied","Data":"a5b9c5cd870e51a17562f61e2433ae0a8accb0f23d1f5048d183d929de75ba73"}
Jul 02 23:10:12.465387 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465347    2581 scope.go:117] "RemoveContainer" containerID="4bf717daa86f481db92e23d04707249a419abc9475411583a5b625dfa64c1310"
Jul 02 23:10:12.465599 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465271    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-config\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.465599 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465515    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-web-config\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.465599 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465580    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-tls\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.465758 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465607    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.465758 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465633    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv6hg\" (UniqueName: \"kubernetes.io/projected/ce375602-b7c0-4e4c-bfb3-498f378e67a9-kube-api-access-nv6hg\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.465758 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465660    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-0\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.465758 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465687    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-grpc-tls\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.465758 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465713    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce375602-b7c0-4e4c-bfb3-498f378e67a9-tls-assets\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.465758 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465745    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-metrics-client-certs\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.466253 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465769    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-thanos-prometheus-http-client-file\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.466253 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465800    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-kubelet-serving-ca-bundle\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.466253 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465839    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-kube-rbac-proxy\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.466253 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465863    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-1\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.466253 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465909    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-trusted-ca-bundle\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.466253 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465930    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.466253 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.465971    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-metrics-client-ca\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.466253 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.466005    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-serving-certs-ca-bundle\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.466253 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.466040    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-db\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.466253 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.466064    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce375602-b7c0-4e4c-bfb3-498f378e67a9-config-out\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.466253 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.466090    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-2\") pod \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\" (UID: \"ce375602-b7c0-4e4c-bfb3-498f378e67a9\") "
Jul 02 23:10:12.466845 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.466311    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:10:12.466845 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.466378    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.466845 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.466628    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:10:12.470331 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.468134    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:10:12.470331 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.468513    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:10:12.470331 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.468684    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:10:12.470331 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.468867    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:10:12.470331 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.469325    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-config" (OuterVolumeSpecName: "config") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:12.470331 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.469825    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:10:12.470331 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.469898    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:12.471288 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.471259    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:10:12.472455 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.472427    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:12.472866 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.472842    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:12.473353 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.473304    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:12.473438 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.473398    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce375602-b7c0-4e4c-bfb3-498f378e67a9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:10:12.473438 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.473398    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:12.473518 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.473490    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:12.473630 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.473613    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce375602-b7c0-4e4c-bfb3-498f378e67a9-config-out" (OuterVolumeSpecName: "config-out") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:10:12.474146 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.474114    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:12.474948 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.474923    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce375602-b7c0-4e4c-bfb3-498f378e67a9-kube-api-access-nv6hg" (OuterVolumeSpecName: "kube-api-access-nv6hg") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "kube-api-access-nv6hg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:10:12.481814 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.481791    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-web-config" (OuterVolumeSpecName: "web-config") pod "ce375602-b7c0-4e4c-bfb3-498f378e67a9" (UID: "ce375602-b7c0-4e4c-bfb3-498f378e67a9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:12.488048 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.488031    2581 scope.go:117] "RemoveContainer" containerID="ac2e1f5d323fef812eb97e4826ed01a4ed56054165364aafae2b0f3a84e41921"
Jul 02 23:10:12.495630 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.495602    2581 scope.go:117] "RemoveContainer" containerID="5b59f89b38b7557001fdf1b08449d70efe835e77731e10383c9549657de2fa3f"
Jul 02 23:10:12.502279 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.502265    2581 scope.go:117] "RemoveContainer" containerID="938ad4ec077a878551b2390e600b14bc04c963dcdf08c6f533ff2db6e8440887"
Jul 02 23:10:12.509082 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.509060    2581 scope.go:117] "RemoveContainer" containerID="a3a1f86e6228650f19ff09a8e8146829e839426b4e3d7bee7d6c0bc114d13a10"
Jul 02 23:10:12.517642 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.517622    2581 scope.go:117] "RemoveContainer" containerID="cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc"
Jul 02 23:10:12.524671 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.524654    2581 scope.go:117] "RemoveContainer" containerID="df4c768f5b2194008964994ce14f862d844fb3c07417ecea7c4ee84191c14334"
Jul 02 23:10:12.531258 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.531241    2581 scope.go:117] "RemoveContainer" containerID="4bf717daa86f481db92e23d04707249a419abc9475411583a5b625dfa64c1310"
Jul 02 23:10:12.531519 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:12.531502    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bf717daa86f481db92e23d04707249a419abc9475411583a5b625dfa64c1310\": container with ID starting with 4bf717daa86f481db92e23d04707249a419abc9475411583a5b625dfa64c1310 not found: ID does not exist" containerID="4bf717daa86f481db92e23d04707249a419abc9475411583a5b625dfa64c1310"
Jul 02 23:10:12.531565 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.531528    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bf717daa86f481db92e23d04707249a419abc9475411583a5b625dfa64c1310"} err="failed to get container status \"4bf717daa86f481db92e23d04707249a419abc9475411583a5b625dfa64c1310\": rpc error: code = NotFound desc = could not find container \"4bf717daa86f481db92e23d04707249a419abc9475411583a5b625dfa64c1310\": container with ID starting with 4bf717daa86f481db92e23d04707249a419abc9475411583a5b625dfa64c1310 not found: ID does not exist"
Jul 02 23:10:12.531565 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.531545    2581 scope.go:117] "RemoveContainer" containerID="ac2e1f5d323fef812eb97e4826ed01a4ed56054165364aafae2b0f3a84e41921"
Jul 02 23:10:12.531773 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:12.531753    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac2e1f5d323fef812eb97e4826ed01a4ed56054165364aafae2b0f3a84e41921\": container with ID starting with ac2e1f5d323fef812eb97e4826ed01a4ed56054165364aafae2b0f3a84e41921 not found: ID does not exist" containerID="ac2e1f5d323fef812eb97e4826ed01a4ed56054165364aafae2b0f3a84e41921"
Jul 02 23:10:12.531837 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.531783    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac2e1f5d323fef812eb97e4826ed01a4ed56054165364aafae2b0f3a84e41921"} err="failed to get container status \"ac2e1f5d323fef812eb97e4826ed01a4ed56054165364aafae2b0f3a84e41921\": rpc error: code = NotFound desc = could not find container \"ac2e1f5d323fef812eb97e4826ed01a4ed56054165364aafae2b0f3a84e41921\": container with ID starting with ac2e1f5d323fef812eb97e4826ed01a4ed56054165364aafae2b0f3a84e41921 not found: ID does not exist"
Jul 02 23:10:12.531837 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.531808    2581 scope.go:117] "RemoveContainer" containerID="5b59f89b38b7557001fdf1b08449d70efe835e77731e10383c9549657de2fa3f"
Jul 02 23:10:12.532075 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:12.532059    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b59f89b38b7557001fdf1b08449d70efe835e77731e10383c9549657de2fa3f\": container with ID starting with 5b59f89b38b7557001fdf1b08449d70efe835e77731e10383c9549657de2fa3f not found: ID does not exist" containerID="5b59f89b38b7557001fdf1b08449d70efe835e77731e10383c9549657de2fa3f"
Jul 02 23:10:12.532134 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.532083    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b59f89b38b7557001fdf1b08449d70efe835e77731e10383c9549657de2fa3f"} err="failed to get container status \"5b59f89b38b7557001fdf1b08449d70efe835e77731e10383c9549657de2fa3f\": rpc error: code = NotFound desc = could not find container \"5b59f89b38b7557001fdf1b08449d70efe835e77731e10383c9549657de2fa3f\": container with ID starting with 5b59f89b38b7557001fdf1b08449d70efe835e77731e10383c9549657de2fa3f not found: ID does not exist"
Jul 02 23:10:12.532134 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.532105    2581 scope.go:117] "RemoveContainer" containerID="938ad4ec077a878551b2390e600b14bc04c963dcdf08c6f533ff2db6e8440887"
Jul 02 23:10:12.532337 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:12.532321    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"938ad4ec077a878551b2390e600b14bc04c963dcdf08c6f533ff2db6e8440887\": container with ID starting with 938ad4ec077a878551b2390e600b14bc04c963dcdf08c6f533ff2db6e8440887 not found: ID does not exist" containerID="938ad4ec077a878551b2390e600b14bc04c963dcdf08c6f533ff2db6e8440887"
Jul 02 23:10:12.532375 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.532342    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"938ad4ec077a878551b2390e600b14bc04c963dcdf08c6f533ff2db6e8440887"} err="failed to get container status \"938ad4ec077a878551b2390e600b14bc04c963dcdf08c6f533ff2db6e8440887\": rpc error: code = NotFound desc = could not find container \"938ad4ec077a878551b2390e600b14bc04c963dcdf08c6f533ff2db6e8440887\": container with ID starting with 938ad4ec077a878551b2390e600b14bc04c963dcdf08c6f533ff2db6e8440887 not found: ID does not exist"
Jul 02 23:10:12.532375 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.532356    2581 scope.go:117] "RemoveContainer" containerID="a3a1f86e6228650f19ff09a8e8146829e839426b4e3d7bee7d6c0bc114d13a10"
Jul 02 23:10:12.532601 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:12.532585    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3a1f86e6228650f19ff09a8e8146829e839426b4e3d7bee7d6c0bc114d13a10\": container with ID starting with a3a1f86e6228650f19ff09a8e8146829e839426b4e3d7bee7d6c0bc114d13a10 not found: ID does not exist" containerID="a3a1f86e6228650f19ff09a8e8146829e839426b4e3d7bee7d6c0bc114d13a10"
Jul 02 23:10:12.532661 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.532608    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a1f86e6228650f19ff09a8e8146829e839426b4e3d7bee7d6c0bc114d13a10"} err="failed to get container status \"a3a1f86e6228650f19ff09a8e8146829e839426b4e3d7bee7d6c0bc114d13a10\": rpc error: code = NotFound desc = could not find container \"a3a1f86e6228650f19ff09a8e8146829e839426b4e3d7bee7d6c0bc114d13a10\": container with ID starting with a3a1f86e6228650f19ff09a8e8146829e839426b4e3d7bee7d6c0bc114d13a10 not found: ID does not exist"
Jul 02 23:10:12.532661 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.532626    2581 scope.go:117] "RemoveContainer" containerID="cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc"
Jul 02 23:10:12.532851 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:12.532835    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc\": container with ID starting with cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc not found: ID does not exist" containerID="cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc"
Jul 02 23:10:12.532915 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.532857    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc"} err="failed to get container status \"cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc\": rpc error: code = NotFound desc = could not find container \"cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc\": container with ID starting with cb08b5860ec6bdcf5e66b4555d407bd1dfa1dc7dd82a420746799c4cfeef9abc not found: ID does not exist"
Jul 02 23:10:12.532915 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.532885    2581 scope.go:117] "RemoveContainer" containerID="df4c768f5b2194008964994ce14f862d844fb3c07417ecea7c4ee84191c14334"
Jul 02 23:10:12.533140 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:12.533117    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df4c768f5b2194008964994ce14f862d844fb3c07417ecea7c4ee84191c14334\": container with ID starting with df4c768f5b2194008964994ce14f862d844fb3c07417ecea7c4ee84191c14334 not found: ID does not exist" containerID="df4c768f5b2194008964994ce14f862d844fb3c07417ecea7c4ee84191c14334"
Jul 02 23:10:12.533226 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.533147    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df4c768f5b2194008964994ce14f862d844fb3c07417ecea7c4ee84191c14334"} err="failed to get container status \"df4c768f5b2194008964994ce14f862d844fb3c07417ecea7c4ee84191c14334\": rpc error: code = NotFound desc = could not find container \"df4c768f5b2194008964994ce14f862d844fb3c07417ecea7c4ee84191c14334\": container with ID starting with df4c768f5b2194008964994ce14f862d844fb3c07417ecea7c4ee84191c14334 not found: ID does not exist"
Jul 02 23:10:12.566717 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566691    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-db\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566717 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566715    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ce375602-b7c0-4e4c-bfb3-498f378e67a9-config-out\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566727    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566737    2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-config\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566747    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-web-config\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566756    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566765    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566774    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv6hg\" (UniqueName: \"kubernetes.io/projected/ce375602-b7c0-4e4c-bfb3-498f378e67a9-kube-api-access-nv6hg\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566782    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566790    2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-grpc-tls\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566798    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ce375602-b7c0-4e4c-bfb3-498f378e67a9-tls-assets\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566805    2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-metrics-client-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566813    2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566822    2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-kube-rbac-proxy\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566829    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566837    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566846    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ce375602-b7c0-4e4c-bfb3-498f378e67a9-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566854    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-metrics-client-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.566902 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.566862    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ce375602-b7c0-4e4c-bfb3-498f378e67a9-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:12.788698 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.788673    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 23:10:12.794739 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.794717    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 23:10:12.822966 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.822943    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 23:10:12.823239 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823224    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="init-config-reloader"
Jul 02 23:10:12.823279 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823245    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="init-config-reloader"
Jul 02 23:10:12.823279 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823257    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="kube-rbac-proxy"
Jul 02 23:10:12.823279 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823263    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="kube-rbac-proxy"
Jul 02 23:10:12.823279 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823269    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="alertmanager"
Jul 02 23:10:12.823279 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823275    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="alertmanager"
Jul 02 23:10:12.823279 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823280    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="prom-label-proxy"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823286    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="prom-label-proxy"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823295    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e80d0c9c-4286-49eb-83fc-9f5bc374576d" containerName="console"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823300    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e80d0c9c-4286-49eb-83fc-9f5bc374576d" containerName="console"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823305    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="kube-rbac-proxy-web"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823311    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="kube-rbac-proxy-web"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823321    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="config-reloader"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823329    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="config-reloader"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823337    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="prometheus"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823342    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="prometheus"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823348    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="thanos-sidecar"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823352    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="thanos-sidecar"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823359    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="486f0d5d-a45c-4526-a91b-502cc04aa1f0" containerName="console"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823363    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="486f0d5d-a45c-4526-a91b-502cc04aa1f0" containerName="console"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823370    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="init-config-reloader"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823376    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="init-config-reloader"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823383    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="kube-rbac-proxy-web"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823389    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="kube-rbac-proxy-web"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823397    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="kube-rbac-proxy"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823406    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="kube-rbac-proxy"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823415    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="kube-rbac-proxy-metric"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823420    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="kube-rbac-proxy-metric"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823425    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="kube-rbac-proxy-thanos"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823430    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="kube-rbac-proxy-thanos"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823437    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="config-reloader"
Jul 02 23:10:12.823452 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823441    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="config-reloader"
Jul 02 23:10:12.824149 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823484    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="kube-rbac-proxy"
Jul 02 23:10:12.824149 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823494    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="prometheus"
Jul 02 23:10:12.824149 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823502    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e80d0c9c-4286-49eb-83fc-9f5bc374576d" containerName="console"
Jul 02 23:10:12.824149 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823508    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="kube-rbac-proxy-metric"
Jul 02 23:10:12.824149 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823514    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="alertmanager"
Jul 02 23:10:12.824149 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823519    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="config-reloader"
Jul 02 23:10:12.824149 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823523    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="kube-rbac-proxy-web"
Jul 02 23:10:12.824149 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823528    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="config-reloader"
Jul 02 23:10:12.824149 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823533    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="kube-rbac-proxy"
Jul 02 23:10:12.824149 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823537    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="prom-label-proxy"
Jul 02 23:10:12.824149 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823543    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="kube-rbac-proxy-thanos"
Jul 02 23:10:12.824149 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823547    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="486f0d5d-a45c-4526-a91b-502cc04aa1f0" containerName="console"
Jul 02 23:10:12.824149 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823552    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" containerName="thanos-sidecar"
Jul 02 23:10:12.824149 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.823560    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7167cd4-1414-4eef-ac2a-7b2a690df9b2" containerName="kube-rbac-proxy-web"
Jul 02 23:10:12.827275 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.827250    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.830493 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.830206    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 23:10:12.830493 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.830234    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 23:10:12.830493 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.830246    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 23:10:12.830493 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.830312    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 23:10:12.830493 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.830207    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 23:10:12.830493 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.830206    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-s7wln\""
Jul 02 23:10:12.830493 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.830208    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 23:10:12.830972 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.830497    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 23:10:12.830972 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.830500    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-13a4iv6h21cei\""
Jul 02 23:10:12.830972 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.830662    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 23:10:12.830972 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.830711    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 23:10:12.830972 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.830757    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 23:10:12.830972 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.830828    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 23:10:12.830972 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.830894    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 23:10:12.833478 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.833458    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 23:10:12.835794 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.835773    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 23:10:12.843811 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.843791    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 23:10:12.871337 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871297    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.871524 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871359    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.871524 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871417    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.871524 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871443    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.871524 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871480    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.871524 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871507    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.871724 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871534    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b109c42-9ee0-44d7-9504-c6da977deb8f-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.871724 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871560    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.871724 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b109c42-9ee0-44d7-9504-c6da977deb8f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.871724 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b109c42-9ee0-44d7-9504-c6da977deb8f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.871724 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.871724 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.871724 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871717    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.872018 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871733    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.872018 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871810    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.872018 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871830    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrf7n\" (UniqueName: \"kubernetes.io/projected/0b109c42-9ee0-44d7-9504-c6da977deb8f-kube-api-access-wrf7n\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.872018 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871849    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-config\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.872018 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.872018 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871915    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.872018 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.871950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.972387 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.972341    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.972387 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.972390    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.972632 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.972423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.972632 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.972451    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b109c42-9ee0-44d7-9504-c6da977deb8f-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.972632 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.972479    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.972632 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.972507    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b109c42-9ee0-44d7-9504-c6da977deb8f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.972632 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.972528    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b109c42-9ee0-44d7-9504-c6da977deb8f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.972914 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.972651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.972914 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.972687    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.972914 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.972718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.972914 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.972744    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.972914 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.972789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.972914 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.972820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrf7n\" (UniqueName: \"kubernetes.io/projected/0b109c42-9ee0-44d7-9504-c6da977deb8f-kube-api-access-wrf7n\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.972914 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.972854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-config\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.972914 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.972904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.973316 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.972941    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.973316 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.972978    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.973316 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.973007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.973316 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.973054    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.973316 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.973077    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.973316 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.973091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.973316 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.973116    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0b109c42-9ee0-44d7-9504-c6da977deb8f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.973316 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.973142    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.973316 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.973229    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.975350 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.973987    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.975350 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.975249    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.976574 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.976526    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.976574 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.976550    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.976761 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.976737    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b109c42-9ee0-44d7-9504-c6da977deb8f-config-out\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.976859 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.976813    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-web-config\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.976999 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.976974    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.977350 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.977328    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b109c42-9ee0-44d7-9504-c6da977deb8f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.977704 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.977515    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.977893 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.977855    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.977968 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.977865    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.978100 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.978080    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-config\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.978280 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.978264    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.979156 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.979135    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0b109c42-9ee0-44d7-9504-c6da977deb8f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.979228 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.979175    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0b109c42-9ee0-44d7-9504-c6da977deb8f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:12.982279 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:12.982260    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrf7n\" (UniqueName: \"kubernetes.io/projected/0b109c42-9ee0-44d7-9504-c6da977deb8f-kube-api-access-wrf7n\") pod \"prometheus-k8s-0\" (UID: \"0b109c42-9ee0-44d7-9504-c6da977deb8f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:13.137971 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:13.137862    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:13.279128 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:13.279062    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 23:10:13.281319 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:10:13.281292    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b109c42_9ee0_44d7_9504_c6da977deb8f.slice/crio-e53886d10041bf8c4873d9c8c6dc701f710434ef7c19c21a4b7078ae665aeda4 WatchSource:0}: Error finding container e53886d10041bf8c4873d9c8c6dc701f710434ef7c19c21a4b7078ae665aeda4: Status 404 returned error can't find the container with id e53886d10041bf8c4873d9c8c6dc701f710434ef7c19c21a4b7078ae665aeda4
Jul 02 23:10:13.472185 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:13.472101    2581 generic.go:356] "Generic (PLEG): container finished" podID="0b109c42-9ee0-44d7-9504-c6da977deb8f" containerID="ce34bc5d194441ced8dd53a69cdb20963deacfce643bddc547033fd091ffa3e3" exitCode=0
Jul 02 23:10:13.472527 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:13.472186    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b109c42-9ee0-44d7-9504-c6da977deb8f","Type":"ContainerDied","Data":"ce34bc5d194441ced8dd53a69cdb20963deacfce643bddc547033fd091ffa3e3"}
Jul 02 23:10:13.472527 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:13.472256    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b109c42-9ee0-44d7-9504-c6da977deb8f","Type":"ContainerStarted","Data":"e53886d10041bf8c4873d9c8c6dc701f710434ef7c19c21a4b7078ae665aeda4"}
Jul 02 23:10:13.572091 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:13.571981    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce375602-b7c0-4e4c-bfb3-498f378e67a9" path="/var/lib/kubelet/pods/ce375602-b7c0-4e4c-bfb3-498f378e67a9/volumes"
Jul 02 23:10:14.479538 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:14.479501    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b109c42-9ee0-44d7-9504-c6da977deb8f","Type":"ContainerStarted","Data":"8930236d89cb6c211925244e010bc1242d3e621e960ce14cbcc7031b44460315"}
Jul 02 23:10:14.479966 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:14.479584    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b109c42-9ee0-44d7-9504-c6da977deb8f","Type":"ContainerStarted","Data":"729a9cada895b11ba5fa0a144c57cb53d4c962d050d19cafcdf7276c7306fc05"}
Jul 02 23:10:14.479966 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:14.479623    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b109c42-9ee0-44d7-9504-c6da977deb8f","Type":"ContainerStarted","Data":"732c14f04f7501f47e58869f2aeb1f38d3f57836c6de4a8a6ab2c32694e6b992"}
Jul 02 23:10:14.479966 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:14.479660    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b109c42-9ee0-44d7-9504-c6da977deb8f","Type":"ContainerStarted","Data":"fcbbbb6656a71623b9951997d8cbcd8abb7fb5c996971d31216f234ff9bf21c2"}
Jul 02 23:10:14.479966 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:14.479701    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b109c42-9ee0-44d7-9504-c6da977deb8f","Type":"ContainerStarted","Data":"f37b65f14379cfd54d9d33701d079b2074ead1d085738109e7529b51b42fb154"}
Jul 02 23:10:14.479966 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:14.479737    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0b109c42-9ee0-44d7-9504-c6da977deb8f","Type":"ContainerStarted","Data":"88785eccd6c346b153dc0a3b1b529f60d0918903b55f702d06519a80d26ed2a0"}
Jul 02 23:10:14.505533 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:14.505377    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.486103884 podStartE2EDuration="2.505358986s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.255102ms" isStatefulPod=false podCreationTimestamp="2026-07-02 23:10:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:10:14.504263188 +0000 UTC m=+177.467696520" watchObservedRunningTime="2026-07-02 23:10:14.505358986 +0000 UTC m=+177.468792318"
Jul 02 23:10:18.042132 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:18.042093    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:18.138493 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:18.138465    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:10:18.450176 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:18.450071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:18.517896 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:18.517842    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6487fd5bb9-5dqrb"]
Jul 02 23:10:18.616019 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:18.615984    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:18.677325 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:18.677294    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:18.737985 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:18.737891    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:24.001798 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:24.001765    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:24.102203 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:24.102172    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:24.152513 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:24.152483    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:30.797249 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:30.797209    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:30.849002 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:30.848972    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:43.545753 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.545687    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6487fd5bb9-5dqrb" podUID="0b1af846-a78d-4fd5-aabd-dca26443df4c" containerName="console" containerID="cri-o://2af6c6a9aff236ac257cd53573fe618d2ec01770e177be8877204b53fe256aba" gracePeriod=15
Jul 02 23:10:43.805667 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.805598    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:10:43.955679 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.955643    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-oauth-serving-cert\") pod \"0b1af846-a78d-4fd5-aabd-dca26443df4c\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") "
Jul 02 23:10:43.955679 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.955680    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-oauth-config\") pod \"0b1af846-a78d-4fd5-aabd-dca26443df4c\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") "
Jul 02 23:10:43.955973 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.955705    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-service-ca\") pod \"0b1af846-a78d-4fd5-aabd-dca26443df4c\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") "
Jul 02 23:10:43.955973 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.955781    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmsk5\" (UniqueName: \"kubernetes.io/projected/0b1af846-a78d-4fd5-aabd-dca26443df4c-kube-api-access-bmsk5\") pod \"0b1af846-a78d-4fd5-aabd-dca26443df4c\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") "
Jul 02 23:10:43.955973 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.955836    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-trusted-ca-bundle\") pod \"0b1af846-a78d-4fd5-aabd-dca26443df4c\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") "
Jul 02 23:10:43.955973 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.955860    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-serving-cert\") pod \"0b1af846-a78d-4fd5-aabd-dca26443df4c\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") "
Jul 02 23:10:43.955973 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.955905    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-config\") pod \"0b1af846-a78d-4fd5-aabd-dca26443df4c\" (UID: \"0b1af846-a78d-4fd5-aabd-dca26443df4c\") "
Jul 02 23:10:43.956221 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.956108    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0b1af846-a78d-4fd5-aabd-dca26443df4c" (UID: "0b1af846-a78d-4fd5-aabd-dca26443df4c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:10:43.956275 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.956219    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-service-ca" (OuterVolumeSpecName: "service-ca") pod "0b1af846-a78d-4fd5-aabd-dca26443df4c" (UID: "0b1af846-a78d-4fd5-aabd-dca26443df4c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:10:43.956325 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.956292    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-config" (OuterVolumeSpecName: "console-config") pod "0b1af846-a78d-4fd5-aabd-dca26443df4c" (UID: "0b1af846-a78d-4fd5-aabd-dca26443df4c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:10:43.956406 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.956389    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-service-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:43.956451 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.956412    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-config\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:43.956451 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.956428    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-oauth-serving-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:43.956515 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.956462    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0b1af846-a78d-4fd5-aabd-dca26443df4c" (UID: "0b1af846-a78d-4fd5-aabd-dca26443df4c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:10:43.958333 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.958309    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0b1af846-a78d-4fd5-aabd-dca26443df4c" (UID: "0b1af846-a78d-4fd5-aabd-dca26443df4c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:43.958652 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.958622    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0b1af846-a78d-4fd5-aabd-dca26443df4c" (UID: "0b1af846-a78d-4fd5-aabd-dca26443df4c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:10:43.958744 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:43.958645    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b1af846-a78d-4fd5-aabd-dca26443df4c-kube-api-access-bmsk5" (OuterVolumeSpecName: "kube-api-access-bmsk5") pod "0b1af846-a78d-4fd5-aabd-dca26443df4c" (UID: "0b1af846-a78d-4fd5-aabd-dca26443df4c"). InnerVolumeSpecName "kube-api-access-bmsk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:10:44.057309 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:44.057214    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmsk5\" (UniqueName: \"kubernetes.io/projected/0b1af846-a78d-4fd5-aabd-dca26443df4c-kube-api-access-bmsk5\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:44.057309 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:44.057248    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b1af846-a78d-4fd5-aabd-dca26443df4c-trusted-ca-bundle\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:44.057309 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:44.057257    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-serving-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:44.057309 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:44.057266    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0b1af846-a78d-4fd5-aabd-dca26443df4c-console-oauth-config\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:10:44.597866 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:44.597823    2581 generic.go:356] "Generic (PLEG): container finished" podID="0b1af846-a78d-4fd5-aabd-dca26443df4c" containerID="2af6c6a9aff236ac257cd53573fe618d2ec01770e177be8877204b53fe256aba" exitCode=0
Jul 02 23:10:44.598274 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:44.597897    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6487fd5bb9-5dqrb"
Jul 02 23:10:44.598274 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:44.597913    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6487fd5bb9-5dqrb" event={"ID":"0b1af846-a78d-4fd5-aabd-dca26443df4c","Type":"ContainerDied","Data":"2af6c6a9aff236ac257cd53573fe618d2ec01770e177be8877204b53fe256aba"}
Jul 02 23:10:44.598274 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:44.597962    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6487fd5bb9-5dqrb" event={"ID":"0b1af846-a78d-4fd5-aabd-dca26443df4c","Type":"ContainerDied","Data":"42be91fac8855a090bae3dcfc83fdf029022bf9a46dec7ddaccafb79c9720176"}
Jul 02 23:10:44.598274 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:44.597980    2581 scope.go:117] "RemoveContainer" containerID="2af6c6a9aff236ac257cd53573fe618d2ec01770e177be8877204b53fe256aba"
Jul 02 23:10:44.605994 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:44.605977    2581 scope.go:117] "RemoveContainer" containerID="2af6c6a9aff236ac257cd53573fe618d2ec01770e177be8877204b53fe256aba"
Jul 02 23:10:44.606225 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:10:44.606209    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2af6c6a9aff236ac257cd53573fe618d2ec01770e177be8877204b53fe256aba\": container with ID starting with 2af6c6a9aff236ac257cd53573fe618d2ec01770e177be8877204b53fe256aba not found: ID does not exist" containerID="2af6c6a9aff236ac257cd53573fe618d2ec01770e177be8877204b53fe256aba"
Jul 02 23:10:44.606273 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:44.606232    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2af6c6a9aff236ac257cd53573fe618d2ec01770e177be8877204b53fe256aba"} err="failed to get container status \"2af6c6a9aff236ac257cd53573fe618d2ec01770e177be8877204b53fe256aba\": rpc error: code = NotFound desc = could not find container \"2af6c6a9aff236ac257cd53573fe618d2ec01770e177be8877204b53fe256aba\": container with ID starting with 2af6c6a9aff236ac257cd53573fe618d2ec01770e177be8877204b53fe256aba not found: ID does not exist"
Jul 02 23:10:44.617672 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:44.617649    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6487fd5bb9-5dqrb"]
Jul 02 23:10:44.621823 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:44.621804    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6487fd5bb9-5dqrb"]
Jul 02 23:10:45.570308 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:45.570278    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b1af846-a78d-4fd5-aabd-dca26443df4c" path="/var/lib/kubelet/pods/0b1af846-a78d-4fd5-aabd-dca26443df4c/volumes"
Jul 02 23:10:47.215030 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:47.215000    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:10:47.307627 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:10:47.307594    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:08.811446 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:08.811408    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:09.659259 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:09.659223    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:12.419551 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:12.419506    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:12.521940 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:12.521902    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:13.139048 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:13.139000    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:13.154660 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:13.154632    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:13.720843 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:13.720816    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 23:11:14.049485 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:14.049453    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:14.140196 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:14.140165    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:14.614751 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:14.614716    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:14.730001 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:14.729963    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:16.469306 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:16.469256    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:16.665568 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:16.665537    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:19.209732 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:19.209697    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:19.310662 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:19.310626    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:20.249253 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:20.249219    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:23.684390 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:23.684356    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:27.827310 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:27.827273    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:27.925938 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:27.925892    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:39.392392 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:39.392308    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:39.490164 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:39.490125    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:41.634268 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:41.634235    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:43.128768 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:43.128729    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:43.230712 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:43.230683    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:53.029438 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:53.029392    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:53.124175 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:53.124133    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:53.653388 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:53.653351    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:53.873723 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:53.873688    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:53.978628 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:53.978544    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:54.031455 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.031423    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"]
Jul 02 23:11:54.031800 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.031706    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b1af846-a78d-4fd5-aabd-dca26443df4c" containerName="console"
Jul 02 23:11:54.031800 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.031716    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b1af846-a78d-4fd5-aabd-dca26443df4c" containerName="console"
Jul 02 23:11:54.031800 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.031761    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b1af846-a78d-4fd5-aabd-dca26443df4c" containerName="console"
Jul 02 23:11:54.034648 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.034633    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:54.037473 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.037452    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 23:11:54.037600 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.037470    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 23:11:54.037813 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.037791    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 23:11:54.037987 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.037972    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 23:11:54.037987 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.037981    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mfznl\""
Jul 02 23:11:54.051022 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.051003    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"]
Jul 02 23:11:54.138680 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.138647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3a8eff66-6136-4c0d-a860-13d9f48f6a3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fb7747bfc-xsmq2\" (UID: \"3a8eff66-6136-4c0d-a860-13d9f48f6a3c\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:54.138851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.138707    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a8eff66-6136-4c0d-a860-13d9f48f6a3c-tmp\") pod \"opendatahub-operator-controller-manager-fb7747bfc-xsmq2\" (UID: \"3a8eff66-6136-4c0d-a860-13d9f48f6a3c\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:54.138851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.138731    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h6x2\" (UniqueName: \"kubernetes.io/projected/3a8eff66-6136-4c0d-a860-13d9f48f6a3c-kube-api-access-6h6x2\") pod \"opendatahub-operator-controller-manager-fb7747bfc-xsmq2\" (UID: \"3a8eff66-6136-4c0d-a860-13d9f48f6a3c\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:54.138851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.138756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3a8eff66-6136-4c0d-a860-13d9f48f6a3c-manifests\") pod \"opendatahub-operator-controller-manager-fb7747bfc-xsmq2\" (UID: \"3a8eff66-6136-4c0d-a860-13d9f48f6a3c\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:54.138851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.138779    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a8eff66-6136-4c0d-a860-13d9f48f6a3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-fb7747bfc-xsmq2\" (UID: \"3a8eff66-6136-4c0d-a860-13d9f48f6a3c\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:54.190294 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.190264    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:54.239463 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.239397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a8eff66-6136-4c0d-a860-13d9f48f6a3c-tmp\") pod \"opendatahub-operator-controller-manager-fb7747bfc-xsmq2\" (UID: \"3a8eff66-6136-4c0d-a860-13d9f48f6a3c\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:54.239463 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.239430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h6x2\" (UniqueName: \"kubernetes.io/projected/3a8eff66-6136-4c0d-a860-13d9f48f6a3c-kube-api-access-6h6x2\") pod \"opendatahub-operator-controller-manager-fb7747bfc-xsmq2\" (UID: \"3a8eff66-6136-4c0d-a860-13d9f48f6a3c\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:54.239463 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.239459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3a8eff66-6136-4c0d-a860-13d9f48f6a3c-manifests\") pod \"opendatahub-operator-controller-manager-fb7747bfc-xsmq2\" (UID: \"3a8eff66-6136-4c0d-a860-13d9f48f6a3c\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:54.239676 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.239481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a8eff66-6136-4c0d-a860-13d9f48f6a3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-fb7747bfc-xsmq2\" (UID: \"3a8eff66-6136-4c0d-a860-13d9f48f6a3c\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:54.239676 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.239548    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3a8eff66-6136-4c0d-a860-13d9f48f6a3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fb7747bfc-xsmq2\" (UID: \"3a8eff66-6136-4c0d-a860-13d9f48f6a3c\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:54.239866 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.239840    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3a8eff66-6136-4c0d-a860-13d9f48f6a3c-manifests\") pod \"opendatahub-operator-controller-manager-fb7747bfc-xsmq2\" (UID: \"3a8eff66-6136-4c0d-a860-13d9f48f6a3c\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:54.241891 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.241852    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a8eff66-6136-4c0d-a860-13d9f48f6a3c-tmp\") pod \"opendatahub-operator-controller-manager-fb7747bfc-xsmq2\" (UID: \"3a8eff66-6136-4c0d-a860-13d9f48f6a3c\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:54.242066 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.242048    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a8eff66-6136-4c0d-a860-13d9f48f6a3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-fb7747bfc-xsmq2\" (UID: \"3a8eff66-6136-4c0d-a860-13d9f48f6a3c\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:54.242151 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.242135    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3a8eff66-6136-4c0d-a860-13d9f48f6a3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fb7747bfc-xsmq2\" (UID: \"3a8eff66-6136-4c0d-a860-13d9f48f6a3c\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:54.247046 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.247025    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h6x2\" (UniqueName: \"kubernetes.io/projected/3a8eff66-6136-4c0d-a860-13d9f48f6a3c-kube-api-access-6h6x2\") pod \"opendatahub-operator-controller-manager-fb7747bfc-xsmq2\" (UID: \"3a8eff66-6136-4c0d-a860-13d9f48f6a3c\") " pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:54.294955 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.294923    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:54.344830 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.344801    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:54.386478 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.386445    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:54.482843 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.482810    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"]
Jul 02 23:11:54.484795 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.484760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:54.486500 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:11:54.486474    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a8eff66_6136_4c0d_a860_13d9f48f6a3c.slice/crio-5e0798e66d6e45d9b5a0583e0349a619c93b1f19c06d38abfa9a52b38c781840 WatchSource:0}: Error finding container 5e0798e66d6e45d9b5a0583e0349a619c93b1f19c06d38abfa9a52b38c781840: Status 404 returned error can't find the container with id 5e0798e66d6e45d9b5a0583e0349a619c93b1f19c06d38abfa9a52b38c781840
Jul 02 23:11:54.544542 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.544508    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:54.644357 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.644324    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:54.742650 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.742558    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:11:54.859921 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:54.859867    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2" event={"ID":"3a8eff66-6136-4c0d-a860-13d9f48f6a3c","Type":"ContainerStarted","Data":"5e0798e66d6e45d9b5a0583e0349a619c93b1f19c06d38abfa9a52b38c781840"}
Jul 02 23:11:57.874611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:57.874576    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2" event={"ID":"3a8eff66-6136-4c0d-a860-13d9f48f6a3c","Type":"ContainerStarted","Data":"f7575272b418e0c443986b506becf029493c6677c2ab8190e8aafdebbd97ef8b"}
Jul 02 23:11:58.879666 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:58.879632    2581 generic.go:356] "Generic (PLEG): container finished" podID="3a8eff66-6136-4c0d-a860-13d9f48f6a3c" containerID="f7575272b418e0c443986b506becf029493c6677c2ab8190e8aafdebbd97ef8b" exitCode=0
Jul 02 23:11:58.880161 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:58.879689    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2" event={"ID":"3a8eff66-6136-4c0d-a860-13d9f48f6a3c","Type":"ContainerDied","Data":"f7575272b418e0c443986b506becf029493c6677c2ab8190e8aafdebbd97ef8b"}
Jul 02 23:11:59.886531 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:59.886501    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2" event={"ID":"3a8eff66-6136-4c0d-a860-13d9f48f6a3c","Type":"ContainerStarted","Data":"ac7c4c4a3a8d04a7a18d86ba7152cd87dfad0c9789969b336d58539dbd36fe25"}
Jul 02 23:11:59.887055 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:59.886658    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:11:59.906964 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:11:59.906911    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2" podStartSLOduration=1.6670790819999999 podStartE2EDuration="5.906894953s" totalImagesPullingTime="3.175010894s" totalInitContainerRuntime="1.064804977s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:11:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:11:59.905243078 +0000 UTC m=+282.868676412" watchObservedRunningTime="2026-07-02 23:11:59.906894953 +0000 UTC m=+282.870328281"
Jul 02 23:12:01.855508 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:01.855473    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:01.964009 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:01.963975    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:10.893384 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:10.893348    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-fb7747bfc-xsmq2"
Jul 02 23:12:13.111968 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:13.111931    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:14.373676 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.373644    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"]
Jul 02 23:12:14.379249 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.379224    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"
Jul 02 23:12:14.381774 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.381745    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 02 23:12:14.381937 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.381829    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 23:12:14.382555 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.382526    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 23:12:14.382672 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.382563    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 02 23:12:14.382672 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.382565    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dx7kz\""
Jul 02 23:12:14.382672 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.382649    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 02 23:12:14.387295 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.386836    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"]
Jul 02 23:12:14.458655 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.458613    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:14.520632 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.520590    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vppt\" (UniqueName: \"kubernetes.io/projected/2ff7f3fe-3282-446c-b7b1-0978b1fe19a1-kube-api-access-9vppt\") pod \"lws-controller-manager-675f46f85c-nmc4b\" (UID: \"2ff7f3fe-3282-446c-b7b1-0978b1fe19a1\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"
Jul 02 23:12:14.520810 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.520646    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ff7f3fe-3282-446c-b7b1-0978b1fe19a1-metrics-cert\") pod \"lws-controller-manager-675f46f85c-nmc4b\" (UID: \"2ff7f3fe-3282-446c-b7b1-0978b1fe19a1\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"
Jul 02 23:12:14.520810 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.520693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2ff7f3fe-3282-446c-b7b1-0978b1fe19a1-manager-config\") pod \"lws-controller-manager-675f46f85c-nmc4b\" (UID: \"2ff7f3fe-3282-446c-b7b1-0978b1fe19a1\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"
Jul 02 23:12:14.520810 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.520774    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ff7f3fe-3282-446c-b7b1-0978b1fe19a1-cert\") pod \"lws-controller-manager-675f46f85c-nmc4b\" (UID: \"2ff7f3fe-3282-446c-b7b1-0978b1fe19a1\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"
Jul 02 23:12:14.559345 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.559310    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:14.621192 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.621155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vppt\" (UniqueName: \"kubernetes.io/projected/2ff7f3fe-3282-446c-b7b1-0978b1fe19a1-kube-api-access-9vppt\") pod \"lws-controller-manager-675f46f85c-nmc4b\" (UID: \"2ff7f3fe-3282-446c-b7b1-0978b1fe19a1\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"
Jul 02 23:12:14.621192 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.621199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ff7f3fe-3282-446c-b7b1-0978b1fe19a1-metrics-cert\") pod \"lws-controller-manager-675f46f85c-nmc4b\" (UID: \"2ff7f3fe-3282-446c-b7b1-0978b1fe19a1\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"
Jul 02 23:12:14.621408 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.621247    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2ff7f3fe-3282-446c-b7b1-0978b1fe19a1-manager-config\") pod \"lws-controller-manager-675f46f85c-nmc4b\" (UID: \"2ff7f3fe-3282-446c-b7b1-0978b1fe19a1\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"
Jul 02 23:12:14.621408 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.621299    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ff7f3fe-3282-446c-b7b1-0978b1fe19a1-cert\") pod \"lws-controller-manager-675f46f85c-nmc4b\" (UID: \"2ff7f3fe-3282-446c-b7b1-0978b1fe19a1\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"
Jul 02 23:12:14.622025 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.621958    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2ff7f3fe-3282-446c-b7b1-0978b1fe19a1-manager-config\") pod \"lws-controller-manager-675f46f85c-nmc4b\" (UID: \"2ff7f3fe-3282-446c-b7b1-0978b1fe19a1\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"
Jul 02 23:12:14.623806 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.623761    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2ff7f3fe-3282-446c-b7b1-0978b1fe19a1-metrics-cert\") pod \"lws-controller-manager-675f46f85c-nmc4b\" (UID: \"2ff7f3fe-3282-446c-b7b1-0978b1fe19a1\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"
Jul 02 23:12:14.623904 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.623831    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ff7f3fe-3282-446c-b7b1-0978b1fe19a1-cert\") pod \"lws-controller-manager-675f46f85c-nmc4b\" (UID: \"2ff7f3fe-3282-446c-b7b1-0978b1fe19a1\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"
Jul 02 23:12:14.629330 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.629306    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vppt\" (UniqueName: \"kubernetes.io/projected/2ff7f3fe-3282-446c-b7b1-0978b1fe19a1-kube-api-access-9vppt\") pod \"lws-controller-manager-675f46f85c-nmc4b\" (UID: \"2ff7f3fe-3282-446c-b7b1-0978b1fe19a1\") " pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"
Jul 02 23:12:14.659384 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.659345    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:14.690436 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.690397    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"
Jul 02 23:12:14.826344 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.826313    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"]
Jul 02 23:12:14.829638 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:12:14.829614    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff7f3fe_3282_446c_b7b1_0978b1fe19a1.slice/crio-f3d75673f8bbbb3f6ab35beb7118dbf5c35e2210e1972eceec58cae4e8f64c6e WatchSource:0}: Error finding container f3d75673f8bbbb3f6ab35beb7118dbf5c35e2210e1972eceec58cae4e8f64c6e: Status 404 returned error can't find the container with id f3d75673f8bbbb3f6ab35beb7118dbf5c35e2210e1972eceec58cae4e8f64c6e
Jul 02 23:12:14.951363 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:14.951266    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b" event={"ID":"2ff7f3fe-3282-446c-b7b1-0978b1fe19a1","Type":"ContainerStarted","Data":"f3d75673f8bbbb3f6ab35beb7118dbf5c35e2210e1972eceec58cae4e8f64c6e"}
Jul 02 23:12:17.423082 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:17.423013    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 23:12:17.968086 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:17.968041    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b" event={"ID":"2ff7f3fe-3282-446c-b7b1-0978b1fe19a1","Type":"ContainerStarted","Data":"0eba08c8423afbf790bfc7e8c4d322630bd23d8718bb304b4cb8ce6b735906d8"}
Jul 02 23:12:17.969210 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:17.968260    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"
Jul 02 23:12:17.986068 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:17.986014    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b" podStartSLOduration=1.7371581489999999 podStartE2EDuration="3.985998936s" totalImagesPullingTime="2.248840787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:17.985053578 +0000 UTC m=+300.948486913" watchObservedRunningTime="2026-07-02 23:12:17.985998936 +0000 UTC m=+300.949432269"
Jul 02 23:12:19.088863 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.088816    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:19.138367 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.138336    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55fc97dffd-nfqhr"]
Jul 02 23:12:19.140727 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.140708    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55fc97dffd-nfqhr"
Jul 02 23:12:19.143060 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.143021    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 23:12:19.143178 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.143087    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pv9d7\""
Jul 02 23:12:19.143178 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.143133    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 23:12:19.143856 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.143837    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 23:12:19.143983 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.143836    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 23:12:19.154680 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.154653    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55fc97dffd-nfqhr"]
Jul 02 23:12:19.221607 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.221574    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:19.264843 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.264798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/477691e0-93d4-4709-b361-b4313cb14ccc-tls-certs\") pod \"kube-auth-proxy-55fc97dffd-nfqhr\" (UID: \"477691e0-93d4-4709-b361-b4313cb14ccc\") " pod="openshift-ingress/kube-auth-proxy-55fc97dffd-nfqhr"
Jul 02 23:12:19.265054 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.264889    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fxxw\" (UniqueName: \"kubernetes.io/projected/477691e0-93d4-4709-b361-b4313cb14ccc-kube-api-access-9fxxw\") pod \"kube-auth-proxy-55fc97dffd-nfqhr\" (UID: \"477691e0-93d4-4709-b361-b4313cb14ccc\") " pod="openshift-ingress/kube-auth-proxy-55fc97dffd-nfqhr"
Jul 02 23:12:19.265054 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.264945    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/477691e0-93d4-4709-b361-b4313cb14ccc-tmp\") pod \"kube-auth-proxy-55fc97dffd-nfqhr\" (UID: \"477691e0-93d4-4709-b361-b4313cb14ccc\") " pod="openshift-ingress/kube-auth-proxy-55fc97dffd-nfqhr"
Jul 02 23:12:19.366453 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.366357    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/477691e0-93d4-4709-b361-b4313cb14ccc-tmp\") pod \"kube-auth-proxy-55fc97dffd-nfqhr\" (UID: \"477691e0-93d4-4709-b361-b4313cb14ccc\") " pod="openshift-ingress/kube-auth-proxy-55fc97dffd-nfqhr"
Jul 02 23:12:19.366453 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.366412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/477691e0-93d4-4709-b361-b4313cb14ccc-tls-certs\") pod \"kube-auth-proxy-55fc97dffd-nfqhr\" (UID: \"477691e0-93d4-4709-b361-b4313cb14ccc\") " pod="openshift-ingress/kube-auth-proxy-55fc97dffd-nfqhr"
Jul 02 23:12:19.366673 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.366460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fxxw\" (UniqueName: \"kubernetes.io/projected/477691e0-93d4-4709-b361-b4313cb14ccc-kube-api-access-9fxxw\") pod \"kube-auth-proxy-55fc97dffd-nfqhr\" (UID: \"477691e0-93d4-4709-b361-b4313cb14ccc\") " pod="openshift-ingress/kube-auth-proxy-55fc97dffd-nfqhr"
Jul 02 23:12:19.368912 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.368867    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/477691e0-93d4-4709-b361-b4313cb14ccc-tmp\") pod \"kube-auth-proxy-55fc97dffd-nfqhr\" (UID: \"477691e0-93d4-4709-b361-b4313cb14ccc\") " pod="openshift-ingress/kube-auth-proxy-55fc97dffd-nfqhr"
Jul 02 23:12:19.369118 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.369102    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/477691e0-93d4-4709-b361-b4313cb14ccc-tls-certs\") pod \"kube-auth-proxy-55fc97dffd-nfqhr\" (UID: \"477691e0-93d4-4709-b361-b4313cb14ccc\") " pod="openshift-ingress/kube-auth-proxy-55fc97dffd-nfqhr"
Jul 02 23:12:19.378435 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.378409    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fxxw\" (UniqueName: \"kubernetes.io/projected/477691e0-93d4-4709-b361-b4313cb14ccc-kube-api-access-9fxxw\") pod \"kube-auth-proxy-55fc97dffd-nfqhr\" (UID: \"477691e0-93d4-4709-b361-b4313cb14ccc\") " pod="openshift-ingress/kube-auth-proxy-55fc97dffd-nfqhr"
Jul 02 23:12:19.451427 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.451385    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55fc97dffd-nfqhr"
Jul 02 23:12:19.587844 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.587781    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55fc97dffd-nfqhr"]
Jul 02 23:12:19.593920 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:12:19.593862    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod477691e0_93d4_4709_b361_b4313cb14ccc.slice/crio-57a54b1596dae2644099551ce84192308b84f4e69112e73062890e323ff09367 WatchSource:0}: Error finding container 57a54b1596dae2644099551ce84192308b84f4e69112e73062890e323ff09367: Status 404 returned error can't find the container with id 57a54b1596dae2644099551ce84192308b84f4e69112e73062890e323ff09367
Jul 02 23:12:19.595850 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.595826    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:12:19.977687 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:19.977652    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55fc97dffd-nfqhr" event={"ID":"477691e0-93d4-4709-b361-b4313cb14ccc","Type":"ContainerStarted","Data":"57a54b1596dae2644099551ce84192308b84f4e69112e73062890e323ff09367"}
Jul 02 23:12:20.334836 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:20.334796    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:20.428737 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:20.428694    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:21.662150 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:21.662113    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:22.993016 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:22.992980    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55fc97dffd-nfqhr" event={"ID":"477691e0-93d4-4709-b361-b4313cb14ccc","Type":"ContainerStarted","Data":"86903f920fc2bacd4cd9b9ddc698de62c76be67c854a928ed0d800fa7bd93a37"}
Jul 02 23:12:23.024562 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:23.024507    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55fc97dffd-nfqhr" podStartSLOduration=1.459662143 podStartE2EDuration="4.024487365s" totalImagesPullingTime="2.564825222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:12:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:12:23.022641121 +0000 UTC m=+305.986074453" watchObservedRunningTime="2026-07-02 23:12:23.024487365 +0000 UTC m=+305.987920697"
Jul 02 23:12:24.225938 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:24.225902    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:24.358040 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:24.358008    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:24.440167 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:24.440132    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:25.418908 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:25.418856    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:25.728050 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:25.727968    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:25.825506 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:25.825464    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:26.417016 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:26.416982    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:26.493127 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:26.493090    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:26.597045 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:26.597011    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:12:28.974248 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:12:28.974221    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-675f46f85c-nmc4b"
Jul 02 23:13:14.500678 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:14.500586    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:14.615162 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:14.615124    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:14.679520 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:14.679485    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:15.406267 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:15.406236    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:15.616133 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:15.616096    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:37.616514 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:37.616480    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:37.722212 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:37.722183    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:39.904621 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:39.904578    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:40.267265 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:40.267178    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:40.322113 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:40.322081    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:42.299160 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:42.299085    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:45.753110 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:45.753080    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:45.905275 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:45.905245    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:48.373849 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:48.373773    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:48.479119 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:48.479018    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:51.567285 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:51.567223    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:52.674790 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.674757    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d7f6b8d9c-l5tbx"]
Jul 02 23:13:52.677014 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.676997    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.682477 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.682458    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 02 23:13:52.683083 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.683062    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 02 23:13:52.683565 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.683069    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 02 23:13:52.683681 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.683129    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vmc2w\""
Jul 02 23:13:52.683681 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.683306    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 02 23:13:52.683805 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.683332    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 02 23:13:52.686782 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.686764    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 02 23:13:52.687349 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.687332    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-oauth-serving-cert\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.687399 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.687370    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-console-oauth-config\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.687399 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.687386    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-service-ca\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.687472 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.687437    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-console-serving-cert\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.687472 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.687455    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-trusted-ca-bundle\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.687536 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.687476    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbw5v\" (UniqueName: \"kubernetes.io/projected/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-kube-api-access-mbw5v\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.687536 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.687495    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-console-config\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.691824 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.691802    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d7f6b8d9c-l5tbx"]
Jul 02 23:13:52.732623 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.732588    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:52.788558 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.788522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-oauth-serving-cert\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.788741 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.788583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-console-oauth-config\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.788741 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.788603    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-service-ca\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.788741 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.788633    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-console-serving-cert\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.788741 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.788654    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-trusted-ca-bundle\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.788741 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.788685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbw5v\" (UniqueName: \"kubernetes.io/projected/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-kube-api-access-mbw5v\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.789059 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.788754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-console-config\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.789374 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.789340    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-service-ca\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.789480 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.789377    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-oauth-serving-cert\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.789598 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.789581    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-trusted-ca-bundle\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.789675 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.789651    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-console-config\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.791235 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.791208    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-console-serving-cert\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.791235 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.791230    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-console-oauth-config\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.796359 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.796336    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbw5v\" (UniqueName: \"kubernetes.io/projected/1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a-kube-api-access-mbw5v\") pod \"console-d7f6b8d9c-l5tbx\" (UID: \"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a\") " pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:52.986143 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:52.986057    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:13:53.117588 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:53.117558    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d7f6b8d9c-l5tbx"]
Jul 02 23:13:53.120764 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:13:53.120730    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e8ae975_a05d_47eb_b3f0_61a92b1d3c6a.slice/crio-bc679551ed8dc9af74b6df29d36c50b1eae1c9ccc1da39347be840365ee29cd9 WatchSource:0}: Error finding container bc679551ed8dc9af74b6df29d36c50b1eae1c9ccc1da39347be840365ee29cd9: Status 404 returned error can't find the container with id bc679551ed8dc9af74b6df29d36c50b1eae1c9ccc1da39347be840365ee29cd9
Jul 02 23:13:53.384951 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:53.384910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7f6b8d9c-l5tbx" event={"ID":"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a","Type":"ContainerStarted","Data":"4238b2cb45f0a78bab68a1d03c9c5860a58058b36b9512327b4bd4fae92da4ea"}
Jul 02 23:13:53.385262 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:53.384989    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7f6b8d9c-l5tbx" event={"ID":"1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a","Type":"ContainerStarted","Data":"bc679551ed8dc9af74b6df29d36c50b1eae1c9ccc1da39347be840365ee29cd9"}
Jul 02 23:13:53.404308 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:53.404254    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d7f6b8d9c-l5tbx" podStartSLOduration=1.404236824 podStartE2EDuration="1.404236824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:13:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:13:53.40391913 +0000 UTC m=+396.367352495" watchObservedRunningTime="2026-07-02 23:13:53.404236824 +0000 UTC m=+396.367670159"
Jul 02 23:13:53.679701 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:53.679610    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:53.779412 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:53.779378    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:54.099571 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:54.099533    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:54.198753 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:54.198719    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:57.681779 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:57.681737    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:13:57.789635 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:13:57.789600    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:01.898827 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:01.898792    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:01.999237 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:01.999201    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:02.247375 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.247300    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s994r"]
Jul 02 23:14:02.249549 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.249535    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s994r"
Jul 02 23:14:02.251771 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.251748    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 02 23:14:02.251922 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.251784    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 23:14:02.251922 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.251750    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 02 23:14:02.251922 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.251850    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-ccp89\""
Jul 02 23:14:02.252097 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.251998    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:02.252357 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.252340    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 23:14:02.254007 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.253988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzvdj\" (UniqueName: \"kubernetes.io/projected/fc900e75-1809-4c53-bfca-c0512739150b-kube-api-access-bzvdj\") pod \"kuadrant-console-plugin-66b5774985-s994r\" (UID: \"fc900e75-1809-4c53-bfca-c0512739150b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s994r"
Jul 02 23:14:02.254096 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.254028    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc900e75-1809-4c53-bfca-c0512739150b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s994r\" (UID: \"fc900e75-1809-4c53-bfca-c0512739150b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s994r"
Jul 02 23:14:02.254096 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.254050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fc900e75-1809-4c53-bfca-c0512739150b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s994r\" (UID: \"fc900e75-1809-4c53-bfca-c0512739150b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s994r"
Jul 02 23:14:02.260002 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.259982    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s994r"]
Jul 02 23:14:02.354575 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.354540    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzvdj\" (UniqueName: \"kubernetes.io/projected/fc900e75-1809-4c53-bfca-c0512739150b-kube-api-access-bzvdj\") pod \"kuadrant-console-plugin-66b5774985-s994r\" (UID: \"fc900e75-1809-4c53-bfca-c0512739150b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s994r"
Jul 02 23:14:02.354753 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.354589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc900e75-1809-4c53-bfca-c0512739150b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s994r\" (UID: \"fc900e75-1809-4c53-bfca-c0512739150b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s994r"
Jul 02 23:14:02.354753 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:14:02.354665    2581 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 02 23:14:02.354753 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:14:02.354720    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc900e75-1809-4c53-bfca-c0512739150b-plugin-serving-cert podName:fc900e75-1809-4c53-bfca-c0512739150b nodeName:}" failed. No retries permitted until 2026-07-02 23:14:02.85470284 +0000 UTC m=+405.818136151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/fc900e75-1809-4c53-bfca-c0512739150b-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-s994r" (UID: "fc900e75-1809-4c53-bfca-c0512739150b") : secret "plugin-serving-cert" not found
Jul 02 23:14:02.354753 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.354744    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fc900e75-1809-4c53-bfca-c0512739150b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s994r\" (UID: \"fc900e75-1809-4c53-bfca-c0512739150b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s994r"
Jul 02 23:14:02.355354 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.355334    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/fc900e75-1809-4c53-bfca-c0512739150b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-s994r\" (UID: \"fc900e75-1809-4c53-bfca-c0512739150b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s994r"
Jul 02 23:14:02.363199 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.363172    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzvdj\" (UniqueName: \"kubernetes.io/projected/fc900e75-1809-4c53-bfca-c0512739150b-kube-api-access-bzvdj\") pod \"kuadrant-console-plugin-66b5774985-s994r\" (UID: \"fc900e75-1809-4c53-bfca-c0512739150b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s994r"
Jul 02 23:14:02.478704 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.478669    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:02.860259 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.860222    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc900e75-1809-4c53-bfca-c0512739150b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s994r\" (UID: \"fc900e75-1809-4c53-bfca-c0512739150b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s994r"
Jul 02 23:14:02.862826 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.862803    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc900e75-1809-4c53-bfca-c0512739150b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-s994r\" (UID: \"fc900e75-1809-4c53-bfca-c0512739150b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s994r"
Jul 02 23:14:02.871743 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.871705    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s994r"
Jul 02 23:14:02.986499 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.986467    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:14:02.986977 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.986534    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:14:02.991285 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:02.991252    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:14:03.006581 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:03.006560    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-s994r"]
Jul 02 23:14:03.009218 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:14:03.009192    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc900e75_1809_4c53_bfca_c0512739150b.slice/crio-aa483bace8e58ffc0526710d5e230c6f733b6dbda619dbf3f2019bf40f8c7d63 WatchSource:0}: Error finding container aa483bace8e58ffc0526710d5e230c6f733b6dbda619dbf3f2019bf40f8c7d63: Status 404 returned error can't find the container with id aa483bace8e58ffc0526710d5e230c6f733b6dbda619dbf3f2019bf40f8c7d63
Jul 02 23:14:03.431469 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:03.431427    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s994r" event={"ID":"fc900e75-1809-4c53-bfca-c0512739150b","Type":"ContainerStarted","Data":"aa483bace8e58ffc0526710d5e230c6f733b6dbda619dbf3f2019bf40f8c7d63"}
Jul 02 23:14:03.435453 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:03.435429    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d7f6b8d9c-l5tbx"
Jul 02 23:14:03.581312 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:03.581277    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:03.682094 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:03.682011    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:03.739388 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:03.739354    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:05.272349 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:05.272305    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:05.373024 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:05.372980    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:12.697072 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:12.697037    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"]
Jul 02 23:14:12.728806 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:12.728772    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"]
Jul 02 23:14:12.729011 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:12.728898    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"
Jul 02 23:14:12.732604 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:12.732571    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mprfg\""
Jul 02 23:14:12.856685 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:12.856648    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfaae514-6003-49bd-8c31-2e004238fdc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-brfsf\" (UID: \"cfaae514-6003-49bd-8c31-2e004238fdc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"
Jul 02 23:14:12.856891 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:12.856721    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48nh5\" (UniqueName: \"kubernetes.io/projected/cfaae514-6003-49bd-8c31-2e004238fdc6-kube-api-access-48nh5\") pod \"kuadrant-operator-controller-manager-55467d9f7-brfsf\" (UID: \"cfaae514-6003-49bd-8c31-2e004238fdc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"
Jul 02 23:14:12.957627 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:12.957530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48nh5\" (UniqueName: \"kubernetes.io/projected/cfaae514-6003-49bd-8c31-2e004238fdc6-kube-api-access-48nh5\") pod \"kuadrant-operator-controller-manager-55467d9f7-brfsf\" (UID: \"cfaae514-6003-49bd-8c31-2e004238fdc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"
Jul 02 23:14:12.957817 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:12.957661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfaae514-6003-49bd-8c31-2e004238fdc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-brfsf\" (UID: \"cfaae514-6003-49bd-8c31-2e004238fdc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"
Jul 02 23:14:12.958115 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:12.958090    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfaae514-6003-49bd-8c31-2e004238fdc6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-brfsf\" (UID: \"cfaae514-6003-49bd-8c31-2e004238fdc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"
Jul 02 23:14:12.967546 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:12.967510    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48nh5\" (UniqueName: \"kubernetes.io/projected/cfaae514-6003-49bd-8c31-2e004238fdc6-kube-api-access-48nh5\") pod \"kuadrant-operator-controller-manager-55467d9f7-brfsf\" (UID: \"cfaae514-6003-49bd-8c31-2e004238fdc6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"
Jul 02 23:14:13.041709 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:13.041674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"
Jul 02 23:14:13.108380 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:13.108344    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"]
Jul 02 23:14:13.118231 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:13.118193    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"]
Jul 02 23:14:13.130644 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:13.130602    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"]
Jul 02 23:14:13.137967 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:13.137936    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"
Jul 02 23:14:13.153385 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:13.153303    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"]
Jul 02 23:14:13.261376 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:13.261281    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a09228f-81ba-4b3a-826f-cac744e7fc3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-scrhj\" (UID: \"2a09228f-81ba-4b3a-826f-cac744e7fc3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"
Jul 02 23:14:13.261525 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:13.261427    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjqjk\" (UniqueName: \"kubernetes.io/projected/2a09228f-81ba-4b3a-826f-cac744e7fc3d-kube-api-access-cjqjk\") pod \"kuadrant-operator-controller-manager-55467d9f7-scrhj\" (UID: \"2a09228f-81ba-4b3a-826f-cac744e7fc3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"
Jul 02 23:14:13.335116 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:13.335081    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:13.362428 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:13.362020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a09228f-81ba-4b3a-826f-cac744e7fc3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-scrhj\" (UID: \"2a09228f-81ba-4b3a-826f-cac744e7fc3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"
Jul 02 23:14:13.362428 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:13.362154    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjqjk\" (UniqueName: \"kubernetes.io/projected/2a09228f-81ba-4b3a-826f-cac744e7fc3d-kube-api-access-cjqjk\") pod \"kuadrant-operator-controller-manager-55467d9f7-scrhj\" (UID: \"2a09228f-81ba-4b3a-826f-cac744e7fc3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"
Jul 02 23:14:13.362808 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:13.362787    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a09228f-81ba-4b3a-826f-cac744e7fc3d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-scrhj\" (UID: \"2a09228f-81ba-4b3a-826f-cac744e7fc3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"
Jul 02 23:14:13.371592 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:13.371556    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjqjk\" (UniqueName: \"kubernetes.io/projected/2a09228f-81ba-4b3a-826f-cac744e7fc3d-kube-api-access-cjqjk\") pod \"kuadrant-operator-controller-manager-55467d9f7-scrhj\" (UID: \"2a09228f-81ba-4b3a-826f-cac744e7fc3d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"
Jul 02 23:14:13.438848 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:13.438814    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:13.454714 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:13.454681    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"
Jul 02 23:14:13.966709 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:13.966654    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:14.061247 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:14.061210    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:16.915130 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:16.915093    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:16.981888 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:16.981846    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:21.515371 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:21.515334    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:21.615715 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:21.615677    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:24.061714 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:24.061657    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:24.160596 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:24.160544    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:24.258064 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:24.258034    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"]
Jul 02 23:14:24.259475 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:14:24.259444    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a09228f_81ba_4b3a_826f_cac744e7fc3d.slice/crio-f87beea8b0b206cebb97d6ca5f5cec628b234a6dde3f422eb8c8497cce8aaa1a WatchSource:0}: Error finding container f87beea8b0b206cebb97d6ca5f5cec628b234a6dde3f422eb8c8497cce8aaa1a: Status 404 returned error can't find the container with id f87beea8b0b206cebb97d6ca5f5cec628b234a6dde3f422eb8c8497cce8aaa1a
Jul 02 23:14:24.541817 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:24.541783    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj" event={"ID":"2a09228f-81ba-4b3a-826f-cac744e7fc3d","Type":"ContainerStarted","Data":"f87beea8b0b206cebb97d6ca5f5cec628b234a6dde3f422eb8c8497cce8aaa1a"}
Jul 02 23:14:24.543440 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:24.543410    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s994r" event={"ID":"fc900e75-1809-4c53-bfca-c0512739150b","Type":"ContainerStarted","Data":"ad14930d4520e4838b4626e19d048c3619288f60817eea132009fe34111d05b8"}
Jul 02 23:14:24.559868 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:24.559811    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-s994r" podStartSLOduration=1.379875084 podStartE2EDuration="22.559781109s" totalImagesPullingTime="21.179906025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:14:24.556955085 +0000 UTC m=+427.520388417" watchObservedRunningTime="2026-07-02 23:14:24.559781109 +0000 UTC m=+427.523214444"
Jul 02 23:14:26.649278 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:14:26.649232    2581 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-brfsf_kuadrant-system_cfaae514-6003-49bd-8c31-2e004238fdc6_0(8c4f905531d10b8402b482fd19eab5e08c1a3c7059313e13ec8fe1b017329c28): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-brfsf to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 02 23:14:26.649845 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:14:26.649295    2581 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-brfsf_kuadrant-system_cfaae514-6003-49bd-8c31-2e004238fdc6_0(8c4f905531d10b8402b482fd19eab5e08c1a3c7059313e13ec8fe1b017329c28): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-brfsf to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"
Jul 02 23:14:27.557335 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:27.557297    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"
Jul 02 23:14:27.559444 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:14:27.559402    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-brfsf\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" podUID="cfaae514-6003-49bd-8c31-2e004238fdc6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"
Jul 02 23:14:27.570447 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:14:27.570402    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-brfsf\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" podUID="cfaae514-6003-49bd-8c31-2e004238fdc6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"
Jul 02 23:14:27.584331 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:27.584300    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"
Jul 02 23:14:27.586422 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:14:27.586388    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-brfsf\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" podUID="cfaae514-6003-49bd-8c31-2e004238fdc6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"
Jul 02 23:14:27.708169 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:27.708126    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfaae514-6003-49bd-8c31-2e004238fdc6-extensions-socket-volume\") pod \"cfaae514-6003-49bd-8c31-2e004238fdc6\" (UID: \"cfaae514-6003-49bd-8c31-2e004238fdc6\") "
Jul 02 23:14:27.708169 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:27.708172    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48nh5\" (UniqueName: \"kubernetes.io/projected/cfaae514-6003-49bd-8c31-2e004238fdc6-kube-api-access-48nh5\") pod \"cfaae514-6003-49bd-8c31-2e004238fdc6\" (UID: \"cfaae514-6003-49bd-8c31-2e004238fdc6\") "
Jul 02 23:14:27.708614 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:27.708426    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfaae514-6003-49bd-8c31-2e004238fdc6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cfaae514-6003-49bd-8c31-2e004238fdc6" (UID: "cfaae514-6003-49bd-8c31-2e004238fdc6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:14:27.710446 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:27.710420    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfaae514-6003-49bd-8c31-2e004238fdc6-kube-api-access-48nh5" (OuterVolumeSpecName: "kube-api-access-48nh5") pod "cfaae514-6003-49bd-8c31-2e004238fdc6" (UID: "cfaae514-6003-49bd-8c31-2e004238fdc6"). InnerVolumeSpecName "kube-api-access-48nh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:14:27.809123 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:27.809026    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfaae514-6003-49bd-8c31-2e004238fdc6-extensions-socket-volume\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:14:27.809123 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:27.809063    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48nh5\" (UniqueName: \"kubernetes.io/projected/cfaae514-6003-49bd-8c31-2e004238fdc6-kube-api-access-48nh5\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:14:28.568184 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:28.568148    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"
Jul 02 23:14:28.570845 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:14:28.570800    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-brfsf\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" podUID="cfaae514-6003-49bd-8c31-2e004238fdc6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"
Jul 02 23:14:28.577069 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:14:28.577029    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-brfsf\" is forbidden: User \"system:node:ip-10-0-141-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-220.ec2.internal' and this object" podUID="cfaae514-6003-49bd-8c31-2e004238fdc6" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-brfsf"
Jul 02 23:14:29.571750 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:29.571714    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfaae514-6003-49bd-8c31-2e004238fdc6" path="/var/lib/kubelet/pods/cfaae514-6003-49bd-8c31-2e004238fdc6/volumes"
Jul 02 23:14:30.578495 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:30.578458    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj" event={"ID":"2a09228f-81ba-4b3a-826f-cac744e7fc3d","Type":"ContainerStarted","Data":"e49a7485cced99ec1f43f8fb137b602d3e9bc0cfb67dad245aed4b332b829f6a"}
Jul 02 23:14:30.578944 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:30.578542    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"
Jul 02 23:14:30.598014 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:30.597803    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj" podStartSLOduration=12.214888038 podStartE2EDuration="17.597783997s" totalImagesPullingTime="5.382895959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:14:30.596595677 +0000 UTC m=+433.560029020" watchObservedRunningTime="2026-07-02 23:14:30.597783997 +0000 UTC m=+433.561217331"
Jul 02 23:14:41.584602 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:41.584524    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"
Jul 02 23:14:53.619929 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:53.619887    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"]
Jul 02 23:14:53.620496 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:53.620101    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj" podUID="2a09228f-81ba-4b3a-826f-cac744e7fc3d" containerName="manager" containerID="cri-o://e49a7485cced99ec1f43f8fb137b602d3e9bc0cfb67dad245aed4b332b829f6a" gracePeriod=10
Jul 02 23:14:53.864520 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:53.864496    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"
Jul 02 23:14:53.946576 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:53.946491    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a09228f-81ba-4b3a-826f-cac744e7fc3d-extensions-socket-volume\") pod \"2a09228f-81ba-4b3a-826f-cac744e7fc3d\" (UID: \"2a09228f-81ba-4b3a-826f-cac744e7fc3d\") "
Jul 02 23:14:53.946576 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:53.946568    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cjqjk\" (UniqueName: \"kubernetes.io/projected/2a09228f-81ba-4b3a-826f-cac744e7fc3d-kube-api-access-cjqjk\") pod \"2a09228f-81ba-4b3a-826f-cac744e7fc3d\" (UID: \"2a09228f-81ba-4b3a-826f-cac744e7fc3d\") "
Jul 02 23:14:53.947004 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:53.946970    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a09228f-81ba-4b3a-826f-cac744e7fc3d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2a09228f-81ba-4b3a-826f-cac744e7fc3d" (UID: "2a09228f-81ba-4b3a-826f-cac744e7fc3d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:14:53.948809 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:53.948786    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a09228f-81ba-4b3a-826f-cac744e7fc3d-kube-api-access-cjqjk" (OuterVolumeSpecName: "kube-api-access-cjqjk") pod "2a09228f-81ba-4b3a-826f-cac744e7fc3d" (UID: "2a09228f-81ba-4b3a-826f-cac744e7fc3d"). InnerVolumeSpecName "kube-api-access-cjqjk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:14:54.047395 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:54.047344    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cjqjk\" (UniqueName: \"kubernetes.io/projected/2a09228f-81ba-4b3a-826f-cac744e7fc3d-kube-api-access-cjqjk\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:14:54.047395 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:54.047389    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a09228f-81ba-4b3a-826f-cac744e7fc3d-extensions-socket-volume\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:14:54.611106 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:54.611056    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:54.675279 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:54.675244    2581 generic.go:356] "Generic (PLEG): container finished" podID="2a09228f-81ba-4b3a-826f-cac744e7fc3d" containerID="e49a7485cced99ec1f43f8fb137b602d3e9bc0cfb67dad245aed4b332b829f6a" exitCode=0
Jul 02 23:14:54.675698 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:54.675287    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"
Jul 02 23:14:54.675698 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:54.675328    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj" event={"ID":"2a09228f-81ba-4b3a-826f-cac744e7fc3d","Type":"ContainerDied","Data":"e49a7485cced99ec1f43f8fb137b602d3e9bc0cfb67dad245aed4b332b829f6a"}
Jul 02 23:14:54.675698 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:54.675382    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj" event={"ID":"2a09228f-81ba-4b3a-826f-cac744e7fc3d","Type":"ContainerDied","Data":"f87beea8b0b206cebb97d6ca5f5cec628b234a6dde3f422eb8c8497cce8aaa1a"}
Jul 02 23:14:54.675698 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:54.675407    2581 scope.go:117] "RemoveContainer" containerID="e49a7485cced99ec1f43f8fb137b602d3e9bc0cfb67dad245aed4b332b829f6a"
Jul 02 23:14:54.683970 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:54.683953    2581 scope.go:117] "RemoveContainer" containerID="e49a7485cced99ec1f43f8fb137b602d3e9bc0cfb67dad245aed4b332b829f6a"
Jul 02 23:14:54.684212 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:14:54.684195    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e49a7485cced99ec1f43f8fb137b602d3e9bc0cfb67dad245aed4b332b829f6a\": container with ID starting with e49a7485cced99ec1f43f8fb137b602d3e9bc0cfb67dad245aed4b332b829f6a not found: ID does not exist" containerID="e49a7485cced99ec1f43f8fb137b602d3e9bc0cfb67dad245aed4b332b829f6a"
Jul 02 23:14:54.684258 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:54.684221    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e49a7485cced99ec1f43f8fb137b602d3e9bc0cfb67dad245aed4b332b829f6a"} err="failed to get container status \"e49a7485cced99ec1f43f8fb137b602d3e9bc0cfb67dad245aed4b332b829f6a\": rpc error: code = NotFound desc = could not find container \"e49a7485cced99ec1f43f8fb137b602d3e9bc0cfb67dad245aed4b332b829f6a\": container with ID starting with e49a7485cced99ec1f43f8fb137b602d3e9bc0cfb67dad245aed4b332b829f6a not found: ID does not exist"
Jul 02 23:14:54.699164 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:54.699140    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"]
Jul 02 23:14:54.702802 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:54.702781    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-scrhj"]
Jul 02 23:14:55.571829 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:55.571799    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a09228f-81ba-4b3a-826f-cac744e7fc3d" path="/var/lib/kubelet/pods/2a09228f-81ba-4b3a-826f-cac744e7fc3d/volumes"
Jul 02 23:14:57.953026 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:57.952994    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:14:58.328237 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:14:58.328200    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:02.130263 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.130224    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:02.133140 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.133113    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"]
Jul 02 23:15:02.133462 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.133451    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a09228f-81ba-4b3a-826f-cac744e7fc3d" containerName="manager"
Jul 02 23:15:02.133505 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.133464    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a09228f-81ba-4b3a-826f-cac744e7fc3d" containerName="manager"
Jul 02 23:15:02.133539 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.133512    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a09228f-81ba-4b3a-826f-cac744e7fc3d" containerName="manager"
Jul 02 23:15:02.136536 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.136507    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"
Jul 02 23:15:02.138605 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.138586    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 02 23:15:02.146743 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.146718    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"]
Jul 02 23:15:02.226306 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.226275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/83f208b6-b39e-4fe1-b4f8-197c032d8d5b-config-file\") pod \"limitador-limitador-64c94fd64f-tlgh9\" (UID: \"83f208b6-b39e-4fe1-b4f8-197c032d8d5b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"
Jul 02 23:15:02.226462 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.226401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl8r6\" (UniqueName: \"kubernetes.io/projected/83f208b6-b39e-4fe1-b4f8-197c032d8d5b-kube-api-access-jl8r6\") pod \"limitador-limitador-64c94fd64f-tlgh9\" (UID: \"83f208b6-b39e-4fe1-b4f8-197c032d8d5b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"
Jul 02 23:15:02.232233 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.232205    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:02.236539 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.236517    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"]
Jul 02 23:15:02.327108 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.327076    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/83f208b6-b39e-4fe1-b4f8-197c032d8d5b-config-file\") pod \"limitador-limitador-64c94fd64f-tlgh9\" (UID: \"83f208b6-b39e-4fe1-b4f8-197c032d8d5b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"
Jul 02 23:15:02.327276 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.327169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl8r6\" (UniqueName: \"kubernetes.io/projected/83f208b6-b39e-4fe1-b4f8-197c032d8d5b-kube-api-access-jl8r6\") pod \"limitador-limitador-64c94fd64f-tlgh9\" (UID: \"83f208b6-b39e-4fe1-b4f8-197c032d8d5b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"
Jul 02 23:15:02.327712 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.327694    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/83f208b6-b39e-4fe1-b4f8-197c032d8d5b-config-file\") pod \"limitador-limitador-64c94fd64f-tlgh9\" (UID: \"83f208b6-b39e-4fe1-b4f8-197c032d8d5b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"
Jul 02 23:15:02.333417 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.333390    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:02.336245 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.336224    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl8r6\" (UniqueName: \"kubernetes.io/projected/83f208b6-b39e-4fe1-b4f8-197c032d8d5b-kube-api-access-jl8r6\") pod \"limitador-limitador-64c94fd64f-tlgh9\" (UID: \"83f208b6-b39e-4fe1-b4f8-197c032d8d5b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"
Jul 02 23:15:02.447916 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.447822    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"
Jul 02 23:15:02.585242 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.585202    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"]
Jul 02 23:15:02.588801 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:15:02.588765    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83f208b6_b39e_4fe1_b4f8_197c032d8d5b.slice/crio-4280cee0c474118a74ae7ef9c35022ece25aa8c3d78eec997485189e41e3c4ef WatchSource:0}: Error finding container 4280cee0c474118a74ae7ef9c35022ece25aa8c3d78eec997485189e41e3c4ef: Status 404 returned error can't find the container with id 4280cee0c474118a74ae7ef9c35022ece25aa8c3d78eec997485189e41e3c4ef
Jul 02 23:15:02.710299 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.710206    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9" event={"ID":"83f208b6-b39e-4fe1-b4f8-197c032d8d5b","Type":"ContainerStarted","Data":"4280cee0c474118a74ae7ef9c35022ece25aa8c3d78eec997485189e41e3c4ef"}
Jul 02 23:15:02.981965 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:02.981843    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:03.054318 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:03.054286    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:05.727830 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:05.727792    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9" event={"ID":"83f208b6-b39e-4fe1-b4f8-197c032d8d5b","Type":"ContainerStarted","Data":"4af00e79ffd42c701c6ab71325af9ea76873d4ea2213b0296bf5eb88acdeafef"}
Jul 02 23:15:05.728210 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:05.727936    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"
Jul 02 23:15:05.743895 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:05.743830    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9" podStartSLOduration=0.704997111 podStartE2EDuration="3.743812347s" totalImagesPullingTime="3.038815236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:05.742691155 +0000 UTC m=+468.706124492" watchObservedRunningTime="2026-07-02 23:15:05.743812347 +0000 UTC m=+468.707245681"
Jul 02 23:15:16.734312 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:16.734263    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"
Jul 02 23:15:17.425538 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:17.425501    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"]
Jul 02 23:15:17.425785 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:17.425740    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9" podUID="83f208b6-b39e-4fe1-b4f8-197c032d8d5b" containerName="limitador" containerID="cri-o://4af00e79ffd42c701c6ab71325af9ea76873d4ea2213b0296bf5eb88acdeafef" gracePeriod=30
Jul 02 23:15:17.966303 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:17.966281    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"
Jul 02 23:15:18.074893 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:18.074838    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl8r6\" (UniqueName: \"kubernetes.io/projected/83f208b6-b39e-4fe1-b4f8-197c032d8d5b-kube-api-access-jl8r6\") pod \"83f208b6-b39e-4fe1-b4f8-197c032d8d5b\" (UID: \"83f208b6-b39e-4fe1-b4f8-197c032d8d5b\") "
Jul 02 23:15:18.075085 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:18.074929    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/83f208b6-b39e-4fe1-b4f8-197c032d8d5b-config-file\") pod \"83f208b6-b39e-4fe1-b4f8-197c032d8d5b\" (UID: \"83f208b6-b39e-4fe1-b4f8-197c032d8d5b\") "
Jul 02 23:15:18.075319 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:18.075298    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83f208b6-b39e-4fe1-b4f8-197c032d8d5b-config-file" (OuterVolumeSpecName: "config-file") pod "83f208b6-b39e-4fe1-b4f8-197c032d8d5b" (UID: "83f208b6-b39e-4fe1-b4f8-197c032d8d5b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:15:18.077196 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:18.077167    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83f208b6-b39e-4fe1-b4f8-197c032d8d5b-kube-api-access-jl8r6" (OuterVolumeSpecName: "kube-api-access-jl8r6") pod "83f208b6-b39e-4fe1-b4f8-197c032d8d5b" (UID: "83f208b6-b39e-4fe1-b4f8-197c032d8d5b"). InnerVolumeSpecName "kube-api-access-jl8r6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:15:18.176514 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:18.176484    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl8r6\" (UniqueName: \"kubernetes.io/projected/83f208b6-b39e-4fe1-b4f8-197c032d8d5b-kube-api-access-jl8r6\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:15:18.176514 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:18.176512    2581 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/83f208b6-b39e-4fe1-b4f8-197c032d8d5b-config-file\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:15:18.784939 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:18.784908    2581 generic.go:356] "Generic (PLEG): container finished" podID="83f208b6-b39e-4fe1-b4f8-197c032d8d5b" containerID="4af00e79ffd42c701c6ab71325af9ea76873d4ea2213b0296bf5eb88acdeafef" exitCode=0
Jul 02 23:15:18.785140 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:18.784953    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"
Jul 02 23:15:18.785140 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:18.784961    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9" event={"ID":"83f208b6-b39e-4fe1-b4f8-197c032d8d5b","Type":"ContainerDied","Data":"4af00e79ffd42c701c6ab71325af9ea76873d4ea2213b0296bf5eb88acdeafef"}
Jul 02 23:15:18.785140 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:18.785013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tlgh9" event={"ID":"83f208b6-b39e-4fe1-b4f8-197c032d8d5b","Type":"ContainerDied","Data":"4280cee0c474118a74ae7ef9c35022ece25aa8c3d78eec997485189e41e3c4ef"}
Jul 02 23:15:18.785140 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:18.785042    2581 scope.go:117] "RemoveContainer" containerID="4af00e79ffd42c701c6ab71325af9ea76873d4ea2213b0296bf5eb88acdeafef"
Jul 02 23:15:18.793520 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:18.793502    2581 scope.go:117] "RemoveContainer" containerID="4af00e79ffd42c701c6ab71325af9ea76873d4ea2213b0296bf5eb88acdeafef"
Jul 02 23:15:18.793770 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:15:18.793749    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4af00e79ffd42c701c6ab71325af9ea76873d4ea2213b0296bf5eb88acdeafef\": container with ID starting with 4af00e79ffd42c701c6ab71325af9ea76873d4ea2213b0296bf5eb88acdeafef not found: ID does not exist" containerID="4af00e79ffd42c701c6ab71325af9ea76873d4ea2213b0296bf5eb88acdeafef"
Jul 02 23:15:18.793826 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:18.793782    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4af00e79ffd42c701c6ab71325af9ea76873d4ea2213b0296bf5eb88acdeafef"} err="failed to get container status \"4af00e79ffd42c701c6ab71325af9ea76873d4ea2213b0296bf5eb88acdeafef\": rpc error: code = NotFound desc = could not find container \"4af00e79ffd42c701c6ab71325af9ea76873d4ea2213b0296bf5eb88acdeafef\": container with ID starting with 4af00e79ffd42c701c6ab71325af9ea76873d4ea2213b0296bf5eb88acdeafef not found: ID does not exist"
Jul 02 23:15:18.804832 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:18.804805    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"]
Jul 02 23:15:18.808343 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:18.808322    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tlgh9"]
Jul 02 23:15:19.570807 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:19.570771    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83f208b6-b39e-4fe1-b4f8-197c032d8d5b" path="/var/lib/kubelet/pods/83f208b6-b39e-4fe1-b4f8-197c032d8d5b/volumes"
Jul 02 23:15:21.180470 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.180440    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-q8mt2"]
Jul 02 23:15:21.180867 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.180753    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83f208b6-b39e-4fe1-b4f8-197c032d8d5b" containerName="limitador"
Jul 02 23:15:21.180867 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.180763    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="83f208b6-b39e-4fe1-b4f8-197c032d8d5b" containerName="limitador"
Jul 02 23:15:21.180867 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.180812    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="83f208b6-b39e-4fe1-b4f8-197c032d8d5b" containerName="limitador"
Jul 02 23:15:21.183196 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.183174    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-q8mt2"
Jul 02 23:15:21.185523 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.185495    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 02 23:15:21.185668 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.185647    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-cn5z2\""
Jul 02 23:15:21.191263 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.191238    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-q8mt2"]
Jul 02 23:15:21.200114 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.200086    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4bxv\" (UniqueName: \"kubernetes.io/projected/dc5980eb-8a9f-4762-a731-8a3d2d7c2d14-kube-api-access-z4bxv\") pod \"postgres-69fb4594cf-q8mt2\" (UID: \"dc5980eb-8a9f-4762-a731-8a3d2d7c2d14\") " pod="opendatahub/postgres-69fb4594cf-q8mt2"
Jul 02 23:15:21.200276 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.200123    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dc5980eb-8a9f-4762-a731-8a3d2d7c2d14-data\") pod \"postgres-69fb4594cf-q8mt2\" (UID: \"dc5980eb-8a9f-4762-a731-8a3d2d7c2d14\") " pod="opendatahub/postgres-69fb4594cf-q8mt2"
Jul 02 23:15:21.217863 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.217834    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:21.301352 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.301307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4bxv\" (UniqueName: \"kubernetes.io/projected/dc5980eb-8a9f-4762-a731-8a3d2d7c2d14-kube-api-access-z4bxv\") pod \"postgres-69fb4594cf-q8mt2\" (UID: \"dc5980eb-8a9f-4762-a731-8a3d2d7c2d14\") " pod="opendatahub/postgres-69fb4594cf-q8mt2"
Jul 02 23:15:21.301352 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.301357    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dc5980eb-8a9f-4762-a731-8a3d2d7c2d14-data\") pod \"postgres-69fb4594cf-q8mt2\" (UID: \"dc5980eb-8a9f-4762-a731-8a3d2d7c2d14\") " pod="opendatahub/postgres-69fb4594cf-q8mt2"
Jul 02 23:15:21.301734 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.301718    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/dc5980eb-8a9f-4762-a731-8a3d2d7c2d14-data\") pod \"postgres-69fb4594cf-q8mt2\" (UID: \"dc5980eb-8a9f-4762-a731-8a3d2d7c2d14\") " pod="opendatahub/postgres-69fb4594cf-q8mt2"
Jul 02 23:15:21.310405 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.310373    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4bxv\" (UniqueName: \"kubernetes.io/projected/dc5980eb-8a9f-4762-a731-8a3d2d7c2d14-kube-api-access-z4bxv\") pod \"postgres-69fb4594cf-q8mt2\" (UID: \"dc5980eb-8a9f-4762-a731-8a3d2d7c2d14\") " pod="opendatahub/postgres-69fb4594cf-q8mt2"
Jul 02 23:15:21.495397 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.495281    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-q8mt2"
Jul 02 23:15:21.623244 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.623220    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-q8mt2"]
Jul 02 23:15:21.625438 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:15:21.625403    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5980eb_8a9f_4762_a731_8a3d2d7c2d14.slice/crio-1ba6d40bf7772e3d2af61999dee91b86f6d08d36416d0de0d24cb2803974f2bf WatchSource:0}: Error finding container 1ba6d40bf7772e3d2af61999dee91b86f6d08d36416d0de0d24cb2803974f2bf: Status 404 returned error can't find the container with id 1ba6d40bf7772e3d2af61999dee91b86f6d08d36416d0de0d24cb2803974f2bf
Jul 02 23:15:21.799677 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:21.799644    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-q8mt2" event={"ID":"dc5980eb-8a9f-4762-a731-8a3d2d7c2d14","Type":"ContainerStarted","Data":"1ba6d40bf7772e3d2af61999dee91b86f6d08d36416d0de0d24cb2803974f2bf"}
Jul 02 23:15:26.824119 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:26.824078    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-q8mt2" event={"ID":"dc5980eb-8a9f-4762-a731-8a3d2d7c2d14","Type":"ContainerStarted","Data":"147603707e68623be17c9266cbbdf600fd7d6b0dba949869bd14015c9a6ef362"}
Jul 02 23:15:26.824508 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:26.824185    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-q8mt2"
Jul 02 23:15:26.839991 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:26.839818    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-q8mt2" podStartSLOduration=1.077744044 podStartE2EDuration="5.839801923s" totalImagesPullingTime="4.762057879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:26.839254153 +0000 UTC m=+489.802687485" watchObservedRunningTime="2026-07-02 23:15:26.839801923 +0000 UTC m=+489.803235257"
Jul 02 23:15:32.864511 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:32.864481    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-q8mt2"
Jul 02 23:15:33.172594 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:33.172507    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:33.272472 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:33.272436    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:39.011828 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.011792    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:39.015948 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.015921    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f6fb947fd-p49hs"]
Jul 02 23:15:39.018521 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.018503    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f6fb947fd-p49hs"
Jul 02 23:15:39.022236 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.022212    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 23:15:39.022236 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.022224    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 23:15:39.022541 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.022515    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bh578\""
Jul 02 23:15:39.029454 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.029431    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f6fb947fd-p49hs"]
Jul 02 23:15:39.081906 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.081845    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:39.133123 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.133088    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8de2cb18-30c7-4008-a64f-c0fa2c19769b-webhook-cert\") pod \"maas-controller-f6fb947fd-p49hs\" (UID: \"8de2cb18-30c7-4008-a64f-c0fa2c19769b\") " pod="opendatahub/maas-controller-f6fb947fd-p49hs"
Jul 02 23:15:39.133245 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.133207    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzvb8\" (UniqueName: \"kubernetes.io/projected/8de2cb18-30c7-4008-a64f-c0fa2c19769b-kube-api-access-wzvb8\") pod \"maas-controller-f6fb947fd-p49hs\" (UID: \"8de2cb18-30c7-4008-a64f-c0fa2c19769b\") " pod="opendatahub/maas-controller-f6fb947fd-p49hs"
Jul 02 23:15:39.137228 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.137195    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:39.175660 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.175624    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54f69f846c-r4llq"]
Jul 02 23:15:39.177800 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.177773    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f69f846c-r4llq"
Jul 02 23:15:39.188040 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.188014    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54f69f846c-r4llq"]
Jul 02 23:15:39.234145 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.234107    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzvb8\" (UniqueName: \"kubernetes.io/projected/8de2cb18-30c7-4008-a64f-c0fa2c19769b-kube-api-access-wzvb8\") pod \"maas-controller-f6fb947fd-p49hs\" (UID: \"8de2cb18-30c7-4008-a64f-c0fa2c19769b\") " pod="opendatahub/maas-controller-f6fb947fd-p49hs"
Jul 02 23:15:39.234326 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.234169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8de2cb18-30c7-4008-a64f-c0fa2c19769b-webhook-cert\") pod \"maas-controller-f6fb947fd-p49hs\" (UID: \"8de2cb18-30c7-4008-a64f-c0fa2c19769b\") " pod="opendatahub/maas-controller-f6fb947fd-p49hs"
Jul 02 23:15:39.234326 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:15:39.234276    2581 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 02 23:15:39.234407 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:15:39.234331    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8de2cb18-30c7-4008-a64f-c0fa2c19769b-webhook-cert podName:8de2cb18-30c7-4008-a64f-c0fa2c19769b nodeName:}" failed. No retries permitted until 2026-07-02 23:15:39.734313543 +0000 UTC m=+502.697746855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/8de2cb18-30c7-4008-a64f-c0fa2c19769b-webhook-cert") pod "maas-controller-f6fb947fd-p49hs" (UID: "8de2cb18-30c7-4008-a64f-c0fa2c19769b") : secret "maas-controller-webhook-cert" not found
Jul 02 23:15:39.242756 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.242719    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzvb8\" (UniqueName: \"kubernetes.io/projected/8de2cb18-30c7-4008-a64f-c0fa2c19769b-kube-api-access-wzvb8\") pod \"maas-controller-f6fb947fd-p49hs\" (UID: \"8de2cb18-30c7-4008-a64f-c0fa2c19769b\") " pod="opendatahub/maas-controller-f6fb947fd-p49hs"
Jul 02 23:15:39.335412 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.335370    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b1442fbc-9fa2-4caa-851d-de8355cac174-webhook-cert\") pod \"maas-controller-54f69f846c-r4llq\" (UID: \"b1442fbc-9fa2-4caa-851d-de8355cac174\") " pod="opendatahub/maas-controller-54f69f846c-r4llq"
Jul 02 23:15:39.335589 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.335441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f86cj\" (UniqueName: \"kubernetes.io/projected/b1442fbc-9fa2-4caa-851d-de8355cac174-kube-api-access-f86cj\") pod \"maas-controller-54f69f846c-r4llq\" (UID: \"b1442fbc-9fa2-4caa-851d-de8355cac174\") " pod="opendatahub/maas-controller-54f69f846c-r4llq"
Jul 02 23:15:39.384144 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.384106    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:39.436290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.436250    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b1442fbc-9fa2-4caa-851d-de8355cac174-webhook-cert\") pod \"maas-controller-54f69f846c-r4llq\" (UID: \"b1442fbc-9fa2-4caa-851d-de8355cac174\") " pod="opendatahub/maas-controller-54f69f846c-r4llq"
Jul 02 23:15:39.436506 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.436319    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f86cj\" (UniqueName: \"kubernetes.io/projected/b1442fbc-9fa2-4caa-851d-de8355cac174-kube-api-access-f86cj\") pod \"maas-controller-54f69f846c-r4llq\" (UID: \"b1442fbc-9fa2-4caa-851d-de8355cac174\") " pod="opendatahub/maas-controller-54f69f846c-r4llq"
Jul 02 23:15:39.439027 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.439000    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b1442fbc-9fa2-4caa-851d-de8355cac174-webhook-cert\") pod \"maas-controller-54f69f846c-r4llq\" (UID: \"b1442fbc-9fa2-4caa-851d-de8355cac174\") " pod="opendatahub/maas-controller-54f69f846c-r4llq"
Jul 02 23:15:39.444333 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.444298    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f86cj\" (UniqueName: \"kubernetes.io/projected/b1442fbc-9fa2-4caa-851d-de8355cac174-kube-api-access-f86cj\") pod \"maas-controller-54f69f846c-r4llq\" (UID: \"b1442fbc-9fa2-4caa-851d-de8355cac174\") " pod="opendatahub/maas-controller-54f69f846c-r4llq"
Jul 02 23:15:39.488001 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.487945    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f69f846c-r4llq"
Jul 02 23:15:39.620410 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.620355    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54f69f846c-r4llq"]
Jul 02 23:15:39.622491 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:15:39.622462    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1442fbc_9fa2_4caa_851d_de8355cac174.slice/crio-2c993d8d516e399ac529f4e56d1a9d22a56c151fd60c06c130f5f3f6ac3e4902 WatchSource:0}: Error finding container 2c993d8d516e399ac529f4e56d1a9d22a56c151fd60c06c130f5f3f6ac3e4902: Status 404 returned error can't find the container with id 2c993d8d516e399ac529f4e56d1a9d22a56c151fd60c06c130f5f3f6ac3e4902
Jul 02 23:15:39.739613 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.739570    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8de2cb18-30c7-4008-a64f-c0fa2c19769b-webhook-cert\") pod \"maas-controller-f6fb947fd-p49hs\" (UID: \"8de2cb18-30c7-4008-a64f-c0fa2c19769b\") " pod="opendatahub/maas-controller-f6fb947fd-p49hs"
Jul 02 23:15:39.742047 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.742017    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8de2cb18-30c7-4008-a64f-c0fa2c19769b-webhook-cert\") pod \"maas-controller-f6fb947fd-p49hs\" (UID: \"8de2cb18-30c7-4008-a64f-c0fa2c19769b\") " pod="opendatahub/maas-controller-f6fb947fd-p49hs"
Jul 02 23:15:39.878778 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.878690    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f69f846c-r4llq" event={"ID":"b1442fbc-9fa2-4caa-851d-de8355cac174","Type":"ContainerStarted","Data":"2c993d8d516e399ac529f4e56d1a9d22a56c151fd60c06c130f5f3f6ac3e4902"}
Jul 02 23:15:39.930076 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:39.930040    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f6fb947fd-p49hs"
Jul 02 23:15:40.060395 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:40.060370    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f6fb947fd-p49hs"]
Jul 02 23:15:40.062751 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:15:40.062723    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8de2cb18_30c7_4008_a64f_c0fa2c19769b.slice/crio-a28ee499d03f93bd9b7b9725bb0d332bde74542e890766b0772dc834f5137d20 WatchSource:0}: Error finding container a28ee499d03f93bd9b7b9725bb0d332bde74542e890766b0772dc834f5137d20: Status 404 returned error can't find the container with id a28ee499d03f93bd9b7b9725bb0d332bde74542e890766b0772dc834f5137d20
Jul 02 23:15:40.896162 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:40.896124    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f6fb947fd-p49hs" event={"ID":"8de2cb18-30c7-4008-a64f-c0fa2c19769b","Type":"ContainerStarted","Data":"a28ee499d03f93bd9b7b9725bb0d332bde74542e890766b0772dc834f5137d20"}
Jul 02 23:15:42.454135 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:42.454091    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:42.550478 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:42.550429    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:15:42.906733 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:42.906648    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f6fb947fd-p49hs" event={"ID":"8de2cb18-30c7-4008-a64f-c0fa2c19769b","Type":"ContainerStarted","Data":"f430c1cc07af9b749681f217d791df1f8c55062eaf102656083f7b738128f830"}
Jul 02 23:15:42.906935 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:42.906754    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f6fb947fd-p49hs"
Jul 02 23:15:42.908231 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:42.908206    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f69f846c-r4llq" event={"ID":"b1442fbc-9fa2-4caa-851d-de8355cac174","Type":"ContainerStarted","Data":"afa60fb7ad7bba003aa674d6117130bdfd0477bb32054189ad95f1e6a4b1bed6"}
Jul 02 23:15:42.908359 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:42.908345    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54f69f846c-r4llq"
Jul 02 23:15:42.925844 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:42.925802    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f6fb947fd-p49hs" podStartSLOduration=2.7666180369999998 podStartE2EDuration="4.925788811s" totalImagesPullingTime="2.159170774s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:42.924681317 +0000 UTC m=+505.888114650" watchObservedRunningTime="2026-07-02 23:15:42.925788811 +0000 UTC m=+505.889222144"
Jul 02 23:15:42.945062 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:42.945018    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54f69f846c-r4llq" podStartSLOduration=1.349888497 podStartE2EDuration="3.945004877s" totalImagesPullingTime="2.59511638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:15:42.944111507 +0000 UTC m=+505.907544837" watchObservedRunningTime="2026-07-02 23:15:42.945004877 +0000 UTC m=+505.908438209"
Jul 02 23:15:53.918430 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:53.918398    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54f69f846c-r4llq"
Jul 02 23:15:53.919024 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:53.918619    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f6fb947fd-p49hs"
Jul 02 23:15:53.980444 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:53.980410    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f6fb947fd-p49hs"]
Jul 02 23:15:53.980717 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:53.980670    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-f6fb947fd-p49hs" podUID="8de2cb18-30c7-4008-a64f-c0fa2c19769b" containerName="manager" containerID="cri-o://f430c1cc07af9b749681f217d791df1f8c55062eaf102656083f7b738128f830" gracePeriod=30
Jul 02 23:15:54.226611 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:54.226586    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f6fb947fd-p49hs"
Jul 02 23:15:54.272179 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:54.272131    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzvb8\" (UniqueName: \"kubernetes.io/projected/8de2cb18-30c7-4008-a64f-c0fa2c19769b-kube-api-access-wzvb8\") pod \"8de2cb18-30c7-4008-a64f-c0fa2c19769b\" (UID: \"8de2cb18-30c7-4008-a64f-c0fa2c19769b\") "
Jul 02 23:15:54.272374 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:54.272203    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8de2cb18-30c7-4008-a64f-c0fa2c19769b-webhook-cert\") pod \"8de2cb18-30c7-4008-a64f-c0fa2c19769b\" (UID: \"8de2cb18-30c7-4008-a64f-c0fa2c19769b\") "
Jul 02 23:15:54.274488 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:54.274463    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8de2cb18-30c7-4008-a64f-c0fa2c19769b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8de2cb18-30c7-4008-a64f-c0fa2c19769b" (UID: "8de2cb18-30c7-4008-a64f-c0fa2c19769b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:15:54.274576 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:54.274463    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8de2cb18-30c7-4008-a64f-c0fa2c19769b-kube-api-access-wzvb8" (OuterVolumeSpecName: "kube-api-access-wzvb8") pod "8de2cb18-30c7-4008-a64f-c0fa2c19769b" (UID: "8de2cb18-30c7-4008-a64f-c0fa2c19769b"). InnerVolumeSpecName "kube-api-access-wzvb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:15:54.373152 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:54.373108    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8de2cb18-30c7-4008-a64f-c0fa2c19769b-webhook-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:15:54.373152 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:54.373145    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzvb8\" (UniqueName: \"kubernetes.io/projected/8de2cb18-30c7-4008-a64f-c0fa2c19769b-kube-api-access-wzvb8\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:15:54.961654 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:54.961621    2581 generic.go:356] "Generic (PLEG): container finished" podID="8de2cb18-30c7-4008-a64f-c0fa2c19769b" containerID="f430c1cc07af9b749681f217d791df1f8c55062eaf102656083f7b738128f830" exitCode=0
Jul 02 23:15:54.962135 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:54.961669    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f6fb947fd-p49hs"
Jul 02 23:15:54.962135 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:54.961702    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f6fb947fd-p49hs" event={"ID":"8de2cb18-30c7-4008-a64f-c0fa2c19769b","Type":"ContainerDied","Data":"f430c1cc07af9b749681f217d791df1f8c55062eaf102656083f7b738128f830"}
Jul 02 23:15:54.962135 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:54.961755    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f6fb947fd-p49hs" event={"ID":"8de2cb18-30c7-4008-a64f-c0fa2c19769b","Type":"ContainerDied","Data":"a28ee499d03f93bd9b7b9725bb0d332bde74542e890766b0772dc834f5137d20"}
Jul 02 23:15:54.962135 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:54.961779    2581 scope.go:117] "RemoveContainer" containerID="f430c1cc07af9b749681f217d791df1f8c55062eaf102656083f7b738128f830"
Jul 02 23:15:54.971089 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:54.971071    2581 scope.go:117] "RemoveContainer" containerID="f430c1cc07af9b749681f217d791df1f8c55062eaf102656083f7b738128f830"
Jul 02 23:15:54.971406 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:15:54.971386    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f430c1cc07af9b749681f217d791df1f8c55062eaf102656083f7b738128f830\": container with ID starting with f430c1cc07af9b749681f217d791df1f8c55062eaf102656083f7b738128f830 not found: ID does not exist" containerID="f430c1cc07af9b749681f217d791df1f8c55062eaf102656083f7b738128f830"
Jul 02 23:15:54.971469 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:54.971415    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f430c1cc07af9b749681f217d791df1f8c55062eaf102656083f7b738128f830"} err="failed to get container status \"f430c1cc07af9b749681f217d791df1f8c55062eaf102656083f7b738128f830\": rpc error: code = NotFound desc = could not find container \"f430c1cc07af9b749681f217d791df1f8c55062eaf102656083f7b738128f830\": container with ID starting with f430c1cc07af9b749681f217d791df1f8c55062eaf102656083f7b738128f830 not found: ID does not exist"
Jul 02 23:15:54.984083 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:54.984061    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f6fb947fd-p49hs"]
Jul 02 23:15:54.987286 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:54.987265    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f6fb947fd-p49hs"]
Jul 02 23:15:55.571095 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:15:55.571060    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8de2cb18-30c7-4008-a64f-c0fa2c19769b" path="/var/lib/kubelet/pods/8de2cb18-30c7-4008-a64f-c0fa2c19769b/volumes"
Jul 02 23:16:13.362711 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:13.362601    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:13.764572 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:13.764481    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:13.816889 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:13.816839    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-58b7999567-25htw"]
Jul 02 23:16:13.817223 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:13.817208    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8de2cb18-30c7-4008-a64f-c0fa2c19769b" containerName="manager"
Jul 02 23:16:13.817265 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:13.817226    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8de2cb18-30c7-4008-a64f-c0fa2c19769b" containerName="manager"
Jul 02 23:16:13.817299 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:13.817294    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8de2cb18-30c7-4008-a64f-c0fa2c19769b" containerName="manager"
Jul 02 23:16:13.819091 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:13.819077    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-58b7999567-25htw"
Jul 02 23:16:13.821389 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:13.821367    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 02 23:16:13.821530 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:13.821398    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-c9hnp\""
Jul 02 23:16:13.832333 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:13.832308    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-58b7999567-25htw"]
Jul 02 23:16:13.945248 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:13.945211    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f421f72-9544-476e-bfcf-1b8931a2c51f-maas-api-tls\") pod \"maas-api-58b7999567-25htw\" (UID: \"2f421f72-9544-476e-bfcf-1b8931a2c51f\") " pod="opendatahub/maas-api-58b7999567-25htw"
Jul 02 23:16:13.945413 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:13.945262    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f421f72-9544-476e-bfcf-1b8931a2c51f-openshift-service-ca\") pod \"maas-api-58b7999567-25htw\" (UID: \"2f421f72-9544-476e-bfcf-1b8931a2c51f\") " pod="opendatahub/maas-api-58b7999567-25htw"
Jul 02 23:16:13.945413 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:13.945332    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkzcd\" (UniqueName: \"kubernetes.io/projected/2f421f72-9544-476e-bfcf-1b8931a2c51f-kube-api-access-lkzcd\") pod \"maas-api-58b7999567-25htw\" (UID: \"2f421f72-9544-476e-bfcf-1b8931a2c51f\") " pod="opendatahub/maas-api-58b7999567-25htw"
Jul 02 23:16:14.038863 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.038829    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:14.046199 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.046171    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f421f72-9544-476e-bfcf-1b8931a2c51f-openshift-service-ca\") pod \"maas-api-58b7999567-25htw\" (UID: \"2f421f72-9544-476e-bfcf-1b8931a2c51f\") " pod="opendatahub/maas-api-58b7999567-25htw"
Jul 02 23:16:14.046365 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.046225    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkzcd\" (UniqueName: \"kubernetes.io/projected/2f421f72-9544-476e-bfcf-1b8931a2c51f-kube-api-access-lkzcd\") pod \"maas-api-58b7999567-25htw\" (UID: \"2f421f72-9544-476e-bfcf-1b8931a2c51f\") " pod="opendatahub/maas-api-58b7999567-25htw"
Jul 02 23:16:14.046365 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.046313    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f421f72-9544-476e-bfcf-1b8931a2c51f-maas-api-tls\") pod \"maas-api-58b7999567-25htw\" (UID: \"2f421f72-9544-476e-bfcf-1b8931a2c51f\") " pod="opendatahub/maas-api-58b7999567-25htw"
Jul 02 23:16:14.046819 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.046797    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f421f72-9544-476e-bfcf-1b8931a2c51f-openshift-service-ca\") pod \"maas-api-58b7999567-25htw\" (UID: \"2f421f72-9544-476e-bfcf-1b8931a2c51f\") " pod="opendatahub/maas-api-58b7999567-25htw"
Jul 02 23:16:14.049005 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.048976    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2f421f72-9544-476e-bfcf-1b8931a2c51f-maas-api-tls\") pod \"maas-api-58b7999567-25htw\" (UID: \"2f421f72-9544-476e-bfcf-1b8931a2c51f\") " pod="opendatahub/maas-api-58b7999567-25htw"
Jul 02 23:16:14.057008 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.056987    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkzcd\" (UniqueName: \"kubernetes.io/projected/2f421f72-9544-476e-bfcf-1b8931a2c51f-kube-api-access-lkzcd\") pod \"maas-api-58b7999567-25htw\" (UID: \"2f421f72-9544-476e-bfcf-1b8931a2c51f\") " pod="opendatahub/maas-api-58b7999567-25htw"
Jul 02 23:16:14.128661 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.128632    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-58b7999567-25htw"
Jul 02 23:16:14.192310 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.192271    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:14.277174 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.277141    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-58b7999567-25htw"]
Jul 02 23:16:14.279421 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:16:14.279165    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f421f72_9544_476e_bfcf_1b8931a2c51f.slice/crio-499cfa6cea708278d69bf6d8eaf4c6fe0448ff60d63960cea50b5e03b07c1a67 WatchSource:0}: Error finding container 499cfa6cea708278d69bf6d8eaf4c6fe0448ff60d63960cea50b5e03b07c1a67: Status 404 returned error can't find the container with id 499cfa6cea708278d69bf6d8eaf4c6fe0448ff60d63960cea50b5e03b07c1a67
Jul 02 23:16:14.279850 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.279826    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:14.298336 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.298271    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rm8z9"]
Jul 02 23:16:14.304254 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.304239    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-rm8z9"
Jul 02 23:16:14.306618 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.306599    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 02 23:16:14.306733 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.306637    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2j24m\""
Jul 02 23:16:14.309814 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.309794    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rm8z9"]
Jul 02 23:16:14.336158 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.336130    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zc8qq"]
Jul 02 23:16:14.338584 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.338570    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zc8qq"
Jul 02 23:16:14.352100 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.352078    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zc8qq"]
Jul 02 23:16:14.450596 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.450553    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8ct6\" (UniqueName: \"kubernetes.io/projected/4aacec4b-e326-4fca-8dd7-25406abbe385-kube-api-access-x8ct6\") pod \"payload-processing-58f86c7798-zc8qq\" (UID: \"4aacec4b-e326-4fca-8dd7-25406abbe385\") " pod="openshift-ingress/payload-processing-58f86c7798-zc8qq"
Jul 02 23:16:14.451053 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.450606    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bb751ee-b9c1-4218-a907-d48742ad3838-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rm8z9\" (UID: \"4bb751ee-b9c1-4218-a907-d48742ad3838\") " pod="openshift-ingress/payload-pre-processing-7964457696-rm8z9"
Jul 02 23:16:14.451053 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.450684    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2twsx\" (UniqueName: \"kubernetes.io/projected/4bb751ee-b9c1-4218-a907-d48742ad3838-kube-api-access-2twsx\") pod \"payload-pre-processing-7964457696-rm8z9\" (UID: \"4bb751ee-b9c1-4218-a907-d48742ad3838\") " pod="openshift-ingress/payload-pre-processing-7964457696-rm8z9"
Jul 02 23:16:14.451053 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.450722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4aacec4b-e326-4fca-8dd7-25406abbe385-plugins-config-volume\") pod \"payload-processing-58f86c7798-zc8qq\" (UID: \"4aacec4b-e326-4fca-8dd7-25406abbe385\") " pod="openshift-ingress/payload-processing-58f86c7798-zc8qq"
Jul 02 23:16:14.551332 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.551216    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8ct6\" (UniqueName: \"kubernetes.io/projected/4aacec4b-e326-4fca-8dd7-25406abbe385-kube-api-access-x8ct6\") pod \"payload-processing-58f86c7798-zc8qq\" (UID: \"4aacec4b-e326-4fca-8dd7-25406abbe385\") " pod="openshift-ingress/payload-processing-58f86c7798-zc8qq"
Jul 02 23:16:14.551332 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.551259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bb751ee-b9c1-4218-a907-d48742ad3838-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rm8z9\" (UID: \"4bb751ee-b9c1-4218-a907-d48742ad3838\") " pod="openshift-ingress/payload-pre-processing-7964457696-rm8z9"
Jul 02 23:16:14.551332 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.551312    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2twsx\" (UniqueName: \"kubernetes.io/projected/4bb751ee-b9c1-4218-a907-d48742ad3838-kube-api-access-2twsx\") pod \"payload-pre-processing-7964457696-rm8z9\" (UID: \"4bb751ee-b9c1-4218-a907-d48742ad3838\") " pod="openshift-ingress/payload-pre-processing-7964457696-rm8z9"
Jul 02 23:16:14.551332 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.551335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4aacec4b-e326-4fca-8dd7-25406abbe385-plugins-config-volume\") pod \"payload-processing-58f86c7798-zc8qq\" (UID: \"4aacec4b-e326-4fca-8dd7-25406abbe385\") " pod="openshift-ingress/payload-processing-58f86c7798-zc8qq"
Jul 02 23:16:14.552264 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.552240    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4aacec4b-e326-4fca-8dd7-25406abbe385-plugins-config-volume\") pod \"payload-processing-58f86c7798-zc8qq\" (UID: \"4aacec4b-e326-4fca-8dd7-25406abbe385\") " pod="openshift-ingress/payload-processing-58f86c7798-zc8qq"
Jul 02 23:16:14.552348 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.552240    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4bb751ee-b9c1-4218-a907-d48742ad3838-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rm8z9\" (UID: \"4bb751ee-b9c1-4218-a907-d48742ad3838\") " pod="openshift-ingress/payload-pre-processing-7964457696-rm8z9"
Jul 02 23:16:14.559825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.559790    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2twsx\" (UniqueName: \"kubernetes.io/projected/4bb751ee-b9c1-4218-a907-d48742ad3838-kube-api-access-2twsx\") pod \"payload-pre-processing-7964457696-rm8z9\" (UID: \"4bb751ee-b9c1-4218-a907-d48742ad3838\") " pod="openshift-ingress/payload-pre-processing-7964457696-rm8z9"
Jul 02 23:16:14.559973 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.559910    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8ct6\" (UniqueName: \"kubernetes.io/projected/4aacec4b-e326-4fca-8dd7-25406abbe385-kube-api-access-x8ct6\") pod \"payload-processing-58f86c7798-zc8qq\" (UID: \"4aacec4b-e326-4fca-8dd7-25406abbe385\") " pod="openshift-ingress/payload-processing-58f86c7798-zc8qq"
Jul 02 23:16:14.617256 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.617226    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-rm8z9"
Jul 02 23:16:14.647355 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.647328    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-zc8qq"
Jul 02 23:16:14.757993 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.757754    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rm8z9"]
Jul 02 23:16:14.761479 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:16:14.761411    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb751ee_b9c1_4218_a907_d48742ad3838.slice/crio-14c1d747d342c38d5ada8b6116a6ebae431bdcbc8df04178922def89e9e6c08c WatchSource:0}: Error finding container 14c1d747d342c38d5ada8b6116a6ebae431bdcbc8df04178922def89e9e6c08c: Status 404 returned error can't find the container with id 14c1d747d342c38d5ada8b6116a6ebae431bdcbc8df04178922def89e9e6c08c
Jul 02 23:16:14.788503 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:14.788398    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-zc8qq"]
Jul 02 23:16:14.791042 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:16:14.791015    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aacec4b_e326_4fca_8dd7_25406abbe385.slice/crio-d45353f94521390d2b3ce0c35e4589536fd869d2cc4074d2b84a9ed774ff41a0 WatchSource:0}: Error finding container d45353f94521390d2b3ce0c35e4589536fd869d2cc4074d2b84a9ed774ff41a0: Status 404 returned error can't find the container with id d45353f94521390d2b3ce0c35e4589536fd869d2cc4074d2b84a9ed774ff41a0
Jul 02 23:16:15.052780 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:15.052738    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zc8qq" event={"ID":"4aacec4b-e326-4fca-8dd7-25406abbe385","Type":"ContainerStarted","Data":"d45353f94521390d2b3ce0c35e4589536fd869d2cc4074d2b84a9ed774ff41a0"}
Jul 02 23:16:15.054365 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:15.054299    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-rm8z9" event={"ID":"4bb751ee-b9c1-4218-a907-d48742ad3838","Type":"ContainerStarted","Data":"14c1d747d342c38d5ada8b6116a6ebae431bdcbc8df04178922def89e9e6c08c"}
Jul 02 23:16:15.055554 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:15.055532    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-58b7999567-25htw" event={"ID":"2f421f72-9544-476e-bfcf-1b8931a2c51f","Type":"ContainerStarted","Data":"499cfa6cea708278d69bf6d8eaf4c6fe0448ff60d63960cea50b5e03b07c1a67"}
Jul 02 23:16:16.063986 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:16.063868    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-58b7999567-25htw" event={"ID":"2f421f72-9544-476e-bfcf-1b8931a2c51f","Type":"ContainerStarted","Data":"d104935e52102535a5867a822d969fb65ec24f8e42f28fb0dc525a1f305a0bfd"}
Jul 02 23:16:16.064323 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:16.063989    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-58b7999567-25htw"
Jul 02 23:16:16.079560 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:16.079418    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-58b7999567-25htw" podStartSLOduration=1.5610192729999999 podStartE2EDuration="3.079395461s" totalImagesPullingTime="1.518376188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:16:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:16:16.079128435 +0000 UTC m=+539.042561770" watchObservedRunningTime="2026-07-02 23:16:16.079395461 +0000 UTC m=+539.042828797"
Jul 02 23:16:17.070949 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:17.070911    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-zc8qq" event={"ID":"4aacec4b-e326-4fca-8dd7-25406abbe385","Type":"ContainerStarted","Data":"0de58139e30199d0dacde747ad27747f52e6ddb66d8f4fcc9a8474ef0e6bff05"}
Jul 02 23:16:17.071441 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:17.071026    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-zc8qq"
Jul 02 23:16:17.072852 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:17.072825    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-rm8z9" event={"ID":"4bb751ee-b9c1-4218-a907-d48742ad3838","Type":"ContainerStarted","Data":"ba00c0f287a20591c6cfa89fc4ed4b69c7b87e72c96f4317346a1e06e8112089"}
Jul 02 23:16:17.073002 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:17.072986    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-rm8z9"
Jul 02 23:16:17.087310 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:17.087262    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-zc8qq" podStartSLOduration=1.673938749 podStartE2EDuration="3.087244867s" totalImagesPullingTime="1.413306118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:16:17.084892773 +0000 UTC m=+540.048326105" watchObservedRunningTime="2026-07-02 23:16:17.087244867 +0000 UTC m=+540.050678183"
Jul 02 23:16:17.101564 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:17.101527    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-rm8z9" podStartSLOduration=1.6563109200000001 podStartE2EDuration="3.101513178s" totalImagesPullingTime="1.445202258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:16:17.100510571 +0000 UTC m=+540.063943903" watchObservedRunningTime="2026-07-02 23:16:17.101513178 +0000 UTC m=+540.064946511"
Jul 02 23:16:22.079241 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:22.079215    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-58b7999567-25htw"
Jul 02 23:16:23.041503 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:23.041465    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:23.141409 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:23.141378    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:26.445396 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:26.445357    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:26.546580 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:26.546549    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:28.079100 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:28.079069    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-zc8qq"
Jul 02 23:16:28.079518 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:28.079137    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-rm8z9"
Jul 02 23:16:35.218488 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.218453    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"]
Jul 02 23:16:35.223564 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.223533    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.226636 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.226607    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n58qc\""
Jul 02 23:16:35.226811 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.226645    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 23:16:35.226811 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.226607    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 02 23:16:35.226811 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.226721    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 23:16:35.232602 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.232578    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"]
Jul 02 23:16:35.256480 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.256451    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:35.345062 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.345026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.345245 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.345150    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.345245 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.345188    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.345364 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.345239    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zxs6\" (UniqueName: \"kubernetes.io/projected/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-kube-api-access-5zxs6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.345364 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.345299    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.345364 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.345331    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.446399 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.446359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.446399 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.446405    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.446638 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.446434    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zxs6\" (UniqueName: \"kubernetes.io/projected/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-kube-api-access-5zxs6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.446638 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.446485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.446638 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.446512    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.446638 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.446544    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.446974 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.446948    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.447067 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.446986    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.447067 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.447011    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.448916 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.448898    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.449165 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.449147    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.454835 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.454810    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zxs6\" (UniqueName: \"kubernetes.io/projected/34d1b628-ad0d-40f0-b373-cafafc7d5f1f-kube-api-access-5zxs6\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v\" (UID: \"34d1b628-ad0d-40f0-b373-cafafc7d5f1f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.535638 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.535613    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:35.670315 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:35.670282    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"]
Jul 02 23:16:35.672153 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:16:35.672119    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d1b628_ad0d_40f0_b373_cafafc7d5f1f.slice/crio-07f49c19da746c7b1dc68056a06de84815539335ec2d0d19d1ff63538ceebbf3 WatchSource:0}: Error finding container 07f49c19da746c7b1dc68056a06de84815539335ec2d0d19d1ff63538ceebbf3: Status 404 returned error can't find the container with id 07f49c19da746c7b1dc68056a06de84815539335ec2d0d19d1ff63538ceebbf3
Jul 02 23:16:36.163735 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:36.163694    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v" event={"ID":"34d1b628-ad0d-40f0-b373-cafafc7d5f1f","Type":"ContainerStarted","Data":"07f49c19da746c7b1dc68056a06de84815539335ec2d0d19d1ff63538ceebbf3"}
Jul 02 23:16:36.173607 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:36.173573    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:16:37.170453 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:37.170348    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v" event={"ID":"34d1b628-ad0d-40f0-b373-cafafc7d5f1f","Type":"ContainerStarted","Data":"380771f18b211ac209b9959d4706e35cfb95513b6e962fdac323b078613affd8"}
Jul 02 23:16:37.188226 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:37.188178    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v" podStartSLOduration=1.002843987 podStartE2EDuration="2.188162885s" totalImagesPullingTime="1.185318898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:16:37.186902101 +0000 UTC m=+560.150335428" watchObservedRunningTime="2026-07-02 23:16:37.188162885 +0000 UTC m=+560.151596218"
Jul 02 23:16:45.536543 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:45.536503    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:45.536998 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:45.536569    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:45.549410 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:45.549380    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:46.220100 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:46.220074    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v"
Jul 02 23:16:47.387438 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:16:47.387402    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:02.059845 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:17:02.059810    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:08.561982 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:17:08.561945    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:18.069163 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:17:18.069126    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:22.052330 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:17:22.052293    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:25.982974 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:17:25.982934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:17:39.263445 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:17:39.263365    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:27.970420 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:18:27.970385    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:48.257275 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:18:48.257212    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:48.308134 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:18:48.308077    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:50.605363 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:18:50.605327    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:50.677318 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:18:50.677289    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:51.711219 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:18:51.711180    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:18:51.791203 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:18:51.791167    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:01.789945 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:01.789907    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:01.886332 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:01.886298    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54f69f846c-r4llq"]
Jul 02 23:20:01.886603 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:01.886547    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-54f69f846c-r4llq" podUID="b1442fbc-9fa2-4caa-851d-de8355cac174" containerName="manager" containerID="cri-o://afa60fb7ad7bba003aa674d6117130bdfd0477bb32054189ad95f1e6a4b1bed6" gracePeriod=30
Jul 02 23:20:02.081686 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:02.081641    2581 generic.go:356] "Generic (PLEG): container finished" podID="b1442fbc-9fa2-4caa-851d-de8355cac174" containerID="afa60fb7ad7bba003aa674d6117130bdfd0477bb32054189ad95f1e6a4b1bed6" exitCode=0
Jul 02 23:20:02.081838 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:02.081723    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f69f846c-r4llq" event={"ID":"b1442fbc-9fa2-4caa-851d-de8355cac174","Type":"ContainerDied","Data":"afa60fb7ad7bba003aa674d6117130bdfd0477bb32054189ad95f1e6a4b1bed6"}
Jul 02 23:20:02.137384 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:02.137359    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f69f846c-r4llq"
Jul 02 23:20:02.154962 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:02.154929    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f86cj\" (UniqueName: \"kubernetes.io/projected/b1442fbc-9fa2-4caa-851d-de8355cac174-kube-api-access-f86cj\") pod \"b1442fbc-9fa2-4caa-851d-de8355cac174\" (UID: \"b1442fbc-9fa2-4caa-851d-de8355cac174\") "
Jul 02 23:20:02.155115 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:02.155000    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b1442fbc-9fa2-4caa-851d-de8355cac174-webhook-cert\") pod \"b1442fbc-9fa2-4caa-851d-de8355cac174\" (UID: \"b1442fbc-9fa2-4caa-851d-de8355cac174\") "
Jul 02 23:20:02.157626 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:02.157594    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1442fbc-9fa2-4caa-851d-de8355cac174-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b1442fbc-9fa2-4caa-851d-de8355cac174" (UID: "b1442fbc-9fa2-4caa-851d-de8355cac174"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:20:02.157782 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:02.157672    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1442fbc-9fa2-4caa-851d-de8355cac174-kube-api-access-f86cj" (OuterVolumeSpecName: "kube-api-access-f86cj") pod "b1442fbc-9fa2-4caa-851d-de8355cac174" (UID: "b1442fbc-9fa2-4caa-851d-de8355cac174"). InnerVolumeSpecName "kube-api-access-f86cj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:20:02.256581 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:02.256544    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f86cj\" (UniqueName: \"kubernetes.io/projected/b1442fbc-9fa2-4caa-851d-de8355cac174-kube-api-access-f86cj\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:20:02.256581 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:02.256575    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b1442fbc-9fa2-4caa-851d-de8355cac174-webhook-cert\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:20:03.087714 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.087684    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f69f846c-r4llq"
Jul 02 23:20:03.087714 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.087703    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f69f846c-r4llq" event={"ID":"b1442fbc-9fa2-4caa-851d-de8355cac174","Type":"ContainerDied","Data":"2c993d8d516e399ac529f4e56d1a9d22a56c151fd60c06c130f5f3f6ac3e4902"}
Jul 02 23:20:03.088214 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.087766    2581 scope.go:117] "RemoveContainer" containerID="afa60fb7ad7bba003aa674d6117130bdfd0477bb32054189ad95f1e6a4b1bed6"
Jul 02 23:20:03.107023 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.106994    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54f69f846c-r4llq"]
Jul 02 23:20:03.108584 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.108563    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54f69f846c-r4llq"]
Jul 02 23:20:03.571767 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.571732    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1442fbc-9fa2-4caa-851d-de8355cac174" path="/var/lib/kubelet/pods/b1442fbc-9fa2-4caa-851d-de8355cac174/volumes"
Jul 02 23:20:03.736985 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.736946    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:03.844391 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.844298    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54f69f846c-hpsgv"]
Jul 02 23:20:03.844730 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.844712    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1442fbc-9fa2-4caa-851d-de8355cac174" containerName="manager"
Jul 02 23:20:03.844812 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.844734    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1442fbc-9fa2-4caa-851d-de8355cac174" containerName="manager"
Jul 02 23:20:03.844867 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.844843    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1442fbc-9fa2-4caa-851d-de8355cac174" containerName="manager"
Jul 02 23:20:03.849187 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.849166    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f69f846c-hpsgv"
Jul 02 23:20:03.853342 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.853316    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54f69f846c-hpsgv"]
Jul 02 23:20:03.853513 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.853455    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 02 23:20:03.853513 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.853466    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 02 23:20:03.854322 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.854302    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bh578\""
Jul 02 23:20:03.871439 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.871413    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq46p\" (UniqueName: \"kubernetes.io/projected/ad953538-ed65-4b38-8bf8-18d01bfcf60f-kube-api-access-nq46p\") pod \"maas-controller-54f69f846c-hpsgv\" (UID: \"ad953538-ed65-4b38-8bf8-18d01bfcf60f\") " pod="opendatahub/maas-controller-54f69f846c-hpsgv"
Jul 02 23:20:03.871556 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.871492    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad953538-ed65-4b38-8bf8-18d01bfcf60f-webhook-cert\") pod \"maas-controller-54f69f846c-hpsgv\" (UID: \"ad953538-ed65-4b38-8bf8-18d01bfcf60f\") " pod="opendatahub/maas-controller-54f69f846c-hpsgv"
Jul 02 23:20:03.972904 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.972833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad953538-ed65-4b38-8bf8-18d01bfcf60f-webhook-cert\") pod \"maas-controller-54f69f846c-hpsgv\" (UID: \"ad953538-ed65-4b38-8bf8-18d01bfcf60f\") " pod="opendatahub/maas-controller-54f69f846c-hpsgv"
Jul 02 23:20:03.973090 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.972932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq46p\" (UniqueName: \"kubernetes.io/projected/ad953538-ed65-4b38-8bf8-18d01bfcf60f-kube-api-access-nq46p\") pod \"maas-controller-54f69f846c-hpsgv\" (UID: \"ad953538-ed65-4b38-8bf8-18d01bfcf60f\") " pod="opendatahub/maas-controller-54f69f846c-hpsgv"
Jul 02 23:20:03.975538 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.975508    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ad953538-ed65-4b38-8bf8-18d01bfcf60f-webhook-cert\") pod \"maas-controller-54f69f846c-hpsgv\" (UID: \"ad953538-ed65-4b38-8bf8-18d01bfcf60f\") " pod="opendatahub/maas-controller-54f69f846c-hpsgv"
Jul 02 23:20:03.980737 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:03.980712    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq46p\" (UniqueName: \"kubernetes.io/projected/ad953538-ed65-4b38-8bf8-18d01bfcf60f-kube-api-access-nq46p\") pod \"maas-controller-54f69f846c-hpsgv\" (UID: \"ad953538-ed65-4b38-8bf8-18d01bfcf60f\") " pod="opendatahub/maas-controller-54f69f846c-hpsgv"
Jul 02 23:20:04.160988 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:04.160866    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54f69f846c-hpsgv"
Jul 02 23:20:04.294503 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:04.294471    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54f69f846c-hpsgv"]
Jul 02 23:20:04.296646 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:20:04.296615    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad953538_ed65_4b38_8bf8_18d01bfcf60f.slice/crio-4bc2fd10540202de7e4d36260184bc35e6601d4a3f18a8a87a60a2f4ccfd562c WatchSource:0}: Error finding container 4bc2fd10540202de7e4d36260184bc35e6601d4a3f18a8a87a60a2f4ccfd562c: Status 404 returned error can't find the container with id 4bc2fd10540202de7e4d36260184bc35e6601d4a3f18a8a87a60a2f4ccfd562c
Jul 02 23:20:04.297866 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:04.297848    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:20:05.100197 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:05.100160    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f69f846c-hpsgv" event={"ID":"ad953538-ed65-4b38-8bf8-18d01bfcf60f","Type":"ContainerStarted","Data":"e0bcbf8cb47b3a310e2dbca8ad20420d983e1ab8511c0fd419e81f9ae9f3443b"}
Jul 02 23:20:05.100373 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:05.100217    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54f69f846c-hpsgv" event={"ID":"ad953538-ed65-4b38-8bf8-18d01bfcf60f","Type":"ContainerStarted","Data":"4bc2fd10540202de7e4d36260184bc35e6601d4a3f18a8a87a60a2f4ccfd562c"}
Jul 02 23:20:05.100373 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:05.100281    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54f69f846c-hpsgv"
Jul 02 23:20:05.114654 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:05.114597    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54f69f846c-hpsgv" podStartSLOduration=1.750282423 podStartE2EDuration="2.114577783s" totalImagesPullingTime="364.29536ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:20:05.114464256 +0000 UTC m=+768.077897588" watchObservedRunningTime="2026-07-02 23:20:05.114577783 +0000 UTC m=+768.078011117"
Jul 02 23:20:16.109546 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:16.109514    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54f69f846c-hpsgv"
Jul 02 23:20:37.047809 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:37.047766    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:37.147762 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:37.147725    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:37.270777 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:37.270729    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:43.004558 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:43.004449    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:43.060450 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:43.060420    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:43.144990 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:43.144955    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:43.244240 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:43.244192    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:43.344194 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:43.344139    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:48.971857 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:48.971814    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:20:49.072216 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:20:49.072180    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:22:25.109869 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:22:25.109832    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:23:45.635107 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:23:45.635017    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:25:28.725107 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:28.725028    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:25:38.899163 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:38.899125    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:25:44.821080 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:44.821046    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvq5v"]
Jul 02 23:25:44.824399 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:44.824383    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvq5v"
Jul 02 23:25:44.826742 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:44.826718    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mprfg\""
Jul 02 23:25:44.836348 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:44.836326    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvq5v"]
Jul 02 23:25:44.881278 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:44.881240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmgh6\" (UniqueName: \"kubernetes.io/projected/903fdf41-bdd2-4809-8095-52ed79ef900f-kube-api-access-mmgh6\") pod \"kuadrant-operator-controller-manager-86878c769f-dvq5v\" (UID: \"903fdf41-bdd2-4809-8095-52ed79ef900f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvq5v"
Jul 02 23:25:44.881433 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:44.881340    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/903fdf41-bdd2-4809-8095-52ed79ef900f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dvq5v\" (UID: \"903fdf41-bdd2-4809-8095-52ed79ef900f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvq5v"
Jul 02 23:25:44.982501 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:44.982454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/903fdf41-bdd2-4809-8095-52ed79ef900f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dvq5v\" (UID: \"903fdf41-bdd2-4809-8095-52ed79ef900f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvq5v"
Jul 02 23:25:44.982648 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:44.982524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmgh6\" (UniqueName: \"kubernetes.io/projected/903fdf41-bdd2-4809-8095-52ed79ef900f-kube-api-access-mmgh6\") pod \"kuadrant-operator-controller-manager-86878c769f-dvq5v\" (UID: \"903fdf41-bdd2-4809-8095-52ed79ef900f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvq5v"
Jul 02 23:25:44.982980 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:44.982963    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/903fdf41-bdd2-4809-8095-52ed79ef900f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-dvq5v\" (UID: \"903fdf41-bdd2-4809-8095-52ed79ef900f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvq5v"
Jul 02 23:25:44.992123 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:44.992095    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmgh6\" (UniqueName: \"kubernetes.io/projected/903fdf41-bdd2-4809-8095-52ed79ef900f-kube-api-access-mmgh6\") pod \"kuadrant-operator-controller-manager-86878c769f-dvq5v\" (UID: \"903fdf41-bdd2-4809-8095-52ed79ef900f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvq5v"
Jul 02 23:25:45.134867 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:45.134783    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvq5v"
Jul 02 23:25:45.274276 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:45.274248    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvq5v"]
Jul 02 23:25:45.276724 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:25:45.276688    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903fdf41_bdd2_4809_8095_52ed79ef900f.slice/crio-ad5286a302c4de5a7245e7561e72d610cce2e64afae59a6e8fff3986495d91a6 WatchSource:0}: Error finding container ad5286a302c4de5a7245e7561e72d610cce2e64afae59a6e8fff3986495d91a6: Status 404 returned error can't find the container with id ad5286a302c4de5a7245e7561e72d610cce2e64afae59a6e8fff3986495d91a6
Jul 02 23:25:45.632946 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:45.632909    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvq5v" event={"ID":"903fdf41-bdd2-4809-8095-52ed79ef900f","Type":"ContainerStarted","Data":"5f025c16ab87a69861f9b62505511b14a207496406faa272f4ca8f25577210f7"}
Jul 02 23:25:45.633126 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:45.632960    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvq5v" event={"ID":"903fdf41-bdd2-4809-8095-52ed79ef900f","Type":"ContainerStarted","Data":"ad5286a302c4de5a7245e7561e72d610cce2e64afae59a6e8fff3986495d91a6"}
Jul 02 23:25:45.633126 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:45.633047    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvq5v"
Jul 02 23:25:45.653853 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:45.653806    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvq5v" podStartSLOduration=1.653790117 podStartE2EDuration="1.653790117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:25:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:25:45.652410635 +0000 UTC m=+1108.615843972" watchObservedRunningTime="2026-07-02 23:25:45.653790117 +0000 UTC m=+1108.617223449"
Jul 02 23:25:56.640214 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:25:56.640182    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-dvq5v"
Jul 02 23:28:22.641342 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:28:22.641257    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:30:58.054006 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:30:58.053960    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:29.529538 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:31:29.529445    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:34.879929 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:31:34.879889    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:43.120101 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:31:43.120044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:48.191403 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:31:48.191369    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:52.300410 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:31:52.300373    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:52.401508 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:31:52.401471    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:56.942065 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:31:56.942028    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:57.009221 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:31:57.009185    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:57.147050 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:31:57.147014    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:57.233462 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:31:57.233362    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:58.322038 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:31:58.321991    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:58.402050 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:31:58.402012    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:58.459320 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:31:58.459291    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:58.565349 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:31:58.565312    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:58.996256 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:31:58.996217    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:31:59.101838 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:31:59.101801    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:00.646792 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:00.646767    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:03.488315 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:03.488282    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:03.632095 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:03.632056    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:03.730173 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:03.730137    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:03.872989 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:03.872960    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:05.966641 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:05.966607    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:06.022126 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:06.022089    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:06.985063 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:06.985031    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:09.560264 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:09.560224    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:09.625669 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:09.625631    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:09.750571 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:09.750532    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:09.862172 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:09.862066    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:10.963526 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:10.963478    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:11.028538 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.028506    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"]
Jul 02 23:32:11.032220 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.032194    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"
Jul 02 23:32:11.034375 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.034352    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-7dd7cae8-serving-cert\""
Jul 02 23:32:11.046164 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.046136    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"]
Jul 02 23:32:11.048544 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.048522    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:11.119845 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.119809    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:11.175228 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.175187    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77543e5b-7401-455b-9387-fca46aea4bd8-maas-api-tls\") pod \"maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg\" (UID: \"77543e5b-7401-455b-9387-fca46aea4bd8\") " pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"
Jul 02 23:32:11.175416 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.175235    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs2nc\" (UniqueName: \"kubernetes.io/projected/77543e5b-7401-455b-9387-fca46aea4bd8-kube-api-access-qs2nc\") pod \"maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg\" (UID: \"77543e5b-7401-455b-9387-fca46aea4bd8\") " pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"
Jul 02 23:32:11.175416 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.175348    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77543e5b-7401-455b-9387-fca46aea4bd8-openshift-service-ca\") pod \"maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg\" (UID: \"77543e5b-7401-455b-9387-fca46aea4bd8\") " pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"
Jul 02 23:32:11.276190 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.276156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77543e5b-7401-455b-9387-fca46aea4bd8-openshift-service-ca\") pod \"maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg\" (UID: \"77543e5b-7401-455b-9387-fca46aea4bd8\") " pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"
Jul 02 23:32:11.276349 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.276234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77543e5b-7401-455b-9387-fca46aea4bd8-maas-api-tls\") pod \"maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg\" (UID: \"77543e5b-7401-455b-9387-fca46aea4bd8\") " pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"
Jul 02 23:32:11.276349 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.276257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs2nc\" (UniqueName: \"kubernetes.io/projected/77543e5b-7401-455b-9387-fca46aea4bd8-kube-api-access-qs2nc\") pod \"maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg\" (UID: \"77543e5b-7401-455b-9387-fca46aea4bd8\") " pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"
Jul 02 23:32:11.276451 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:32:11.276385    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-7dd7cae8-serving-cert: secret "maas-api-e2e-ait-7dd7cae8-serving-cert" not found
Jul 02 23:32:11.276451 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:32:11.276446    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77543e5b-7401-455b-9387-fca46aea4bd8-maas-api-tls podName:77543e5b-7401-455b-9387-fca46aea4bd8 nodeName:}" failed. No retries permitted until 2026-07-02 23:32:11.776430899 +0000 UTC m=+1494.739864213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/77543e5b-7401-455b-9387-fca46aea4bd8-maas-api-tls") pod "maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg" (UID: "77543e5b-7401-455b-9387-fca46aea4bd8") : secret "maas-api-e2e-ait-7dd7cae8-serving-cert" not found
Jul 02 23:32:11.276825 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.276807    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77543e5b-7401-455b-9387-fca46aea4bd8-openshift-service-ca\") pod \"maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg\" (UID: \"77543e5b-7401-455b-9387-fca46aea4bd8\") " pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"
Jul 02 23:32:11.285990 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.285963    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs2nc\" (UniqueName: \"kubernetes.io/projected/77543e5b-7401-455b-9387-fca46aea4bd8-kube-api-access-qs2nc\") pod \"maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg\" (UID: \"77543e5b-7401-455b-9387-fca46aea4bd8\") " pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"
Jul 02 23:32:11.519957 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.519924    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:11.579285 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.579202    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:11.781742 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.781705    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77543e5b-7401-455b-9387-fca46aea4bd8-maas-api-tls\") pod \"maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg\" (UID: \"77543e5b-7401-455b-9387-fca46aea4bd8\") " pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"
Jul 02 23:32:11.784361 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.784335    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77543e5b-7401-455b-9387-fca46aea4bd8-maas-api-tls\") pod \"maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg\" (UID: \"77543e5b-7401-455b-9387-fca46aea4bd8\") " pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"
Jul 02 23:32:11.943217 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:11.943103    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"
Jul 02 23:32:12.081376 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:12.081312    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"]
Jul 02 23:32:12.083926 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:32:12.083898    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77543e5b_7401_455b_9387_fca46aea4bd8.slice/crio-e85ce4b3615fb2b0ecbe6c5ec271f88b0cf1c16f74e4bcbb4599dd6c3c6d0b39 WatchSource:0}: Error finding container e85ce4b3615fb2b0ecbe6c5ec271f88b0cf1c16f74e4bcbb4599dd6c3c6d0b39: Status 404 returned error can't find the container with id e85ce4b3615fb2b0ecbe6c5ec271f88b0cf1c16f74e4bcbb4599dd6c3c6d0b39
Jul 02 23:32:12.085138 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:12.085116    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:32:12.424485 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:12.424454    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg" event={"ID":"77543e5b-7401-455b-9387-fca46aea4bd8","Type":"ContainerStarted","Data":"e85ce4b3615fb2b0ecbe6c5ec271f88b0cf1c16f74e4bcbb4599dd6c3c6d0b39"}
Jul 02 23:32:12.976007 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:12.975978    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:13.430301 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:13.430266    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg" event={"ID":"77543e5b-7401-455b-9387-fca46aea4bd8","Type":"ContainerStarted","Data":"5b1d68d291c60bbc18c9a20132d8a50e58a345c93a7c230ebcecd8f3b55528a5"}
Jul 02 23:32:13.430685 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:13.430393    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"
Jul 02 23:32:13.446670 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:13.446600    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg" podStartSLOduration=2.041746447 podStartE2EDuration="2.446583215s" totalImagesPullingTime="404.836768ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:32:13.445395337 +0000 UTC m=+1496.408828670" watchObservedRunningTime="2026-07-02 23:32:13.446583215 +0000 UTC m=+1496.410016593"
Jul 02 23:32:16.126313 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:16.126279    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:16.464053 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:16.463963    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"]
Jul 02 23:32:16.464223 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:16.464197    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg" podUID="77543e5b-7401-455b-9387-fca46aea4bd8" containerName="maas-api" containerID="cri-o://5b1d68d291c60bbc18c9a20132d8a50e58a345c93a7c230ebcecd8f3b55528a5" gracePeriod=30
Jul 02 23:32:16.489848 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:16.489817    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:16.711763 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:16.711736    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"
Jul 02 23:32:16.830865 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:16.830829    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77543e5b-7401-455b-9387-fca46aea4bd8-openshift-service-ca\") pod \"77543e5b-7401-455b-9387-fca46aea4bd8\" (UID: \"77543e5b-7401-455b-9387-fca46aea4bd8\") "
Jul 02 23:32:16.831105 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:16.830962    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qs2nc\" (UniqueName: \"kubernetes.io/projected/77543e5b-7401-455b-9387-fca46aea4bd8-kube-api-access-qs2nc\") pod \"77543e5b-7401-455b-9387-fca46aea4bd8\" (UID: \"77543e5b-7401-455b-9387-fca46aea4bd8\") "
Jul 02 23:32:16.831105 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:16.831029    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77543e5b-7401-455b-9387-fca46aea4bd8-maas-api-tls\") pod \"77543e5b-7401-455b-9387-fca46aea4bd8\" (UID: \"77543e5b-7401-455b-9387-fca46aea4bd8\") "
Jul 02 23:32:16.831299 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:16.831275    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77543e5b-7401-455b-9387-fca46aea4bd8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "77543e5b-7401-455b-9387-fca46aea4bd8" (UID: "77543e5b-7401-455b-9387-fca46aea4bd8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:32:16.833207 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:16.833182    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77543e5b-7401-455b-9387-fca46aea4bd8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "77543e5b-7401-455b-9387-fca46aea4bd8" (UID: "77543e5b-7401-455b-9387-fca46aea4bd8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:32:16.833323 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:16.833236    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77543e5b-7401-455b-9387-fca46aea4bd8-kube-api-access-qs2nc" (OuterVolumeSpecName: "kube-api-access-qs2nc") pod "77543e5b-7401-455b-9387-fca46aea4bd8" (UID: "77543e5b-7401-455b-9387-fca46aea4bd8"). InnerVolumeSpecName "kube-api-access-qs2nc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:32:16.931912 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:16.931856    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qs2nc\" (UniqueName: \"kubernetes.io/projected/77543e5b-7401-455b-9387-fca46aea4bd8-kube-api-access-qs2nc\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:32:16.931912 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:16.931912    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/77543e5b-7401-455b-9387-fca46aea4bd8-maas-api-tls\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:32:16.931912 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:16.931923    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/77543e5b-7401-455b-9387-fca46aea4bd8-openshift-service-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:32:17.455460 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:17.455423    2581 generic.go:356] "Generic (PLEG): container finished" podID="77543e5b-7401-455b-9387-fca46aea4bd8" containerID="5b1d68d291c60bbc18c9a20132d8a50e58a345c93a7c230ebcecd8f3b55528a5" exitCode=0
Jul 02 23:32:17.455917 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:17.455478    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"
Jul 02 23:32:17.455917 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:17.455517    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg" event={"ID":"77543e5b-7401-455b-9387-fca46aea4bd8","Type":"ContainerDied","Data":"5b1d68d291c60bbc18c9a20132d8a50e58a345c93a7c230ebcecd8f3b55528a5"}
Jul 02 23:32:17.455917 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:17.455609    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg" event={"ID":"77543e5b-7401-455b-9387-fca46aea4bd8","Type":"ContainerDied","Data":"e85ce4b3615fb2b0ecbe6c5ec271f88b0cf1c16f74e4bcbb4599dd6c3c6d0b39"}
Jul 02 23:32:17.455917 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:17.455640    2581 scope.go:117] "RemoveContainer" containerID="5b1d68d291c60bbc18c9a20132d8a50e58a345c93a7c230ebcecd8f3b55528a5"
Jul 02 23:32:17.468047 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:17.467865    2581 scope.go:117] "RemoveContainer" containerID="5b1d68d291c60bbc18c9a20132d8a50e58a345c93a7c230ebcecd8f3b55528a5"
Jul 02 23:32:17.468202 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:32:17.468184    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b1d68d291c60bbc18c9a20132d8a50e58a345c93a7c230ebcecd8f3b55528a5\": container with ID starting with 5b1d68d291c60bbc18c9a20132d8a50e58a345c93a7c230ebcecd8f3b55528a5 not found: ID does not exist" containerID="5b1d68d291c60bbc18c9a20132d8a50e58a345c93a7c230ebcecd8f3b55528a5"
Jul 02 23:32:17.468248 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:17.468210    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b1d68d291c60bbc18c9a20132d8a50e58a345c93a7c230ebcecd8f3b55528a5"} err="failed to get container status \"5b1d68d291c60bbc18c9a20132d8a50e58a345c93a7c230ebcecd8f3b55528a5\": rpc error: code = NotFound desc = could not find container \"5b1d68d291c60bbc18c9a20132d8a50e58a345c93a7c230ebcecd8f3b55528a5\": container with ID starting with 5b1d68d291c60bbc18c9a20132d8a50e58a345c93a7c230ebcecd8f3b55528a5 not found: ID does not exist"
Jul 02 23:32:17.478773 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:17.478740    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"]
Jul 02 23:32:17.482317 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:17.482295    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-7dd7cae8-5c98d5d8dc-8q4wg"]
Jul 02 23:32:17.572306 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:17.572275    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77543e5b-7401-455b-9387-fca46aea4bd8" path="/var/lib/kubelet/pods/77543e5b-7401-455b-9387-fca46aea4bd8/volumes"
Jul 02 23:32:22.445060 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:22.445013    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:22.544512 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:22.544481    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:26.757715 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:26.757671    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:28.163314 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:28.163282    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:28.263680 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:28.263632    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:28.359245 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:28.359210    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:28.417342 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:28.417254    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:29.539468 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.539438    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:29.600919 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.600885    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"]
Jul 02 23:32:29.601256 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.601243    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77543e5b-7401-455b-9387-fca46aea4bd8" containerName="maas-api"
Jul 02 23:32:29.601309 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.601258    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="77543e5b-7401-455b-9387-fca46aea4bd8" containerName="maas-api"
Jul 02 23:32:29.601352 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.601334    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="77543e5b-7401-455b-9387-fca46aea4bd8" containerName="maas-api"
Jul 02 23:32:29.611647 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.611621    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"
Jul 02 23:32:29.615072 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.615046    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-4d528601-serving-cert\""
Jul 02 23:32:29.615752 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.615723    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"]
Jul 02 23:32:29.617927 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.617899    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:29.653840 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.653806    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/944648b0-3bda-4b97-b14d-4ac61534ef91-openshift-service-ca\") pod \"maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr\" (UID: \"944648b0-3bda-4b97-b14d-4ac61534ef91\") " pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"
Jul 02 23:32:29.654043 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.653863    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/944648b0-3bda-4b97-b14d-4ac61534ef91-maas-api-tls\") pod \"maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr\" (UID: \"944648b0-3bda-4b97-b14d-4ac61534ef91\") " pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"
Jul 02 23:32:29.654043 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.653980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg96j\" (UniqueName: \"kubernetes.io/projected/944648b0-3bda-4b97-b14d-4ac61534ef91-kube-api-access-tg96j\") pod \"maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr\" (UID: \"944648b0-3bda-4b97-b14d-4ac61534ef91\") " pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"
Jul 02 23:32:29.690026 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.689962    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:29.754975 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.754927    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/944648b0-3bda-4b97-b14d-4ac61534ef91-maas-api-tls\") pod \"maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr\" (UID: \"944648b0-3bda-4b97-b14d-4ac61534ef91\") " pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"
Jul 02 23:32:29.755189 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.755025    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg96j\" (UniqueName: \"kubernetes.io/projected/944648b0-3bda-4b97-b14d-4ac61534ef91-kube-api-access-tg96j\") pod \"maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr\" (UID: \"944648b0-3bda-4b97-b14d-4ac61534ef91\") " pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"
Jul 02 23:32:29.755189 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.755075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/944648b0-3bda-4b97-b14d-4ac61534ef91-openshift-service-ca\") pod \"maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr\" (UID: \"944648b0-3bda-4b97-b14d-4ac61534ef91\") " pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"
Jul 02 23:32:29.755706 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.755684    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/944648b0-3bda-4b97-b14d-4ac61534ef91-openshift-service-ca\") pod \"maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr\" (UID: \"944648b0-3bda-4b97-b14d-4ac61534ef91\") " pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"
Jul 02 23:32:29.757724 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.757697    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/944648b0-3bda-4b97-b14d-4ac61534ef91-maas-api-tls\") pod \"maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr\" (UID: \"944648b0-3bda-4b97-b14d-4ac61534ef91\") " pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"
Jul 02 23:32:29.763551 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.763526    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg96j\" (UniqueName: \"kubernetes.io/projected/944648b0-3bda-4b97-b14d-4ac61534ef91-kube-api-access-tg96j\") pod \"maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr\" (UID: \"944648b0-3bda-4b97-b14d-4ac61534ef91\") " pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"
Jul 02 23:32:29.787020 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.786983    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:29.924952 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:29.924856    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"
Jul 02 23:32:30.073412 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:30.073388    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"]
Jul 02 23:32:30.075721 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:32:30.075693    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod944648b0_3bda_4b97_b14d_4ac61534ef91.slice/crio-d392f372b6e19ccfcd57c807b64a34d1de0d29856680e291f7ef7a092f8a5839 WatchSource:0}: Error finding container d392f372b6e19ccfcd57c807b64a34d1de0d29856680e291f7ef7a092f8a5839: Status 404 returned error can't find the container with id d392f372b6e19ccfcd57c807b64a34d1de0d29856680e291f7ef7a092f8a5839
Jul 02 23:32:30.095646 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:30.095608    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:30.195461 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:30.195375    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:30.518869 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:30.518823    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr" event={"ID":"944648b0-3bda-4b97-b14d-4ac61534ef91","Type":"ContainerStarted","Data":"0f5b4c15e56c3dd12ce2bdd45cbb14b81e30133f3e1ebcf3498dcb06f9456cee"}
Jul 02 23:32:30.519065 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:30.518910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr" event={"ID":"944648b0-3bda-4b97-b14d-4ac61534ef91","Type":"ContainerStarted","Data":"d392f372b6e19ccfcd57c807b64a34d1de0d29856680e291f7ef7a092f8a5839"}
Jul 02 23:32:30.519065 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:30.518937    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"
Jul 02 23:32:30.534680 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:30.534629    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr" podStartSLOduration=1.213295745 podStartE2EDuration="1.534613298s" totalImagesPullingTime="321.317553ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:32:30.533518137 +0000 UTC m=+1513.496951469" watchObservedRunningTime="2026-07-02 23:32:30.534613298 +0000 UTC m=+1513.498046633"
Jul 02 23:32:31.516658 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:31.516630    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:33.979211 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:33.979174    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:34.171482 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.171452    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:34.258504 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.258404    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"]
Jul 02 23:32:34.258747 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.258718    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr" podUID="944648b0-3bda-4b97-b14d-4ac61534ef91" containerName="maas-api" containerID="cri-o://0f5b4c15e56c3dd12ce2bdd45cbb14b81e30133f3e1ebcf3498dcb06f9456cee" gracePeriod=30
Jul 02 23:32:34.271079 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.271054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:34.372254 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.372221    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:34.510111 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.510049    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"
Jul 02 23:32:34.541140 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.541102    2581 generic.go:356] "Generic (PLEG): container finished" podID="944648b0-3bda-4b97-b14d-4ac61534ef91" containerID="0f5b4c15e56c3dd12ce2bdd45cbb14b81e30133f3e1ebcf3498dcb06f9456cee" exitCode=0
Jul 02 23:32:34.541289 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.541148    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"
Jul 02 23:32:34.541289 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.541194    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr" event={"ID":"944648b0-3bda-4b97-b14d-4ac61534ef91","Type":"ContainerDied","Data":"0f5b4c15e56c3dd12ce2bdd45cbb14b81e30133f3e1ebcf3498dcb06f9456cee"}
Jul 02 23:32:34.541289 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.541255    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr" event={"ID":"944648b0-3bda-4b97-b14d-4ac61534ef91","Type":"ContainerDied","Data":"d392f372b6e19ccfcd57c807b64a34d1de0d29856680e291f7ef7a092f8a5839"}
Jul 02 23:32:34.541397 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.541289    2581 scope.go:117] "RemoveContainer" containerID="0f5b4c15e56c3dd12ce2bdd45cbb14b81e30133f3e1ebcf3498dcb06f9456cee"
Jul 02 23:32:34.551656 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.551633    2581 scope.go:117] "RemoveContainer" containerID="0f5b4c15e56c3dd12ce2bdd45cbb14b81e30133f3e1ebcf3498dcb06f9456cee"
Jul 02 23:32:34.552016 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:32:34.551993    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f5b4c15e56c3dd12ce2bdd45cbb14b81e30133f3e1ebcf3498dcb06f9456cee\": container with ID starting with 0f5b4c15e56c3dd12ce2bdd45cbb14b81e30133f3e1ebcf3498dcb06f9456cee not found: ID does not exist" containerID="0f5b4c15e56c3dd12ce2bdd45cbb14b81e30133f3e1ebcf3498dcb06f9456cee"
Jul 02 23:32:34.552096 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.552030    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f5b4c15e56c3dd12ce2bdd45cbb14b81e30133f3e1ebcf3498dcb06f9456cee"} err="failed to get container status \"0f5b4c15e56c3dd12ce2bdd45cbb14b81e30133f3e1ebcf3498dcb06f9456cee\": rpc error: code = NotFound desc = could not find container \"0f5b4c15e56c3dd12ce2bdd45cbb14b81e30133f3e1ebcf3498dcb06f9456cee\": container with ID starting with 0f5b4c15e56c3dd12ce2bdd45cbb14b81e30133f3e1ebcf3498dcb06f9456cee not found: ID does not exist"
Jul 02 23:32:34.600139 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.600114    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/944648b0-3bda-4b97-b14d-4ac61534ef91-openshift-service-ca\") pod \"944648b0-3bda-4b97-b14d-4ac61534ef91\" (UID: \"944648b0-3bda-4b97-b14d-4ac61534ef91\") "
Jul 02 23:32:34.600300 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.600148    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/944648b0-3bda-4b97-b14d-4ac61534ef91-maas-api-tls\") pod \"944648b0-3bda-4b97-b14d-4ac61534ef91\" (UID: \"944648b0-3bda-4b97-b14d-4ac61534ef91\") "
Jul 02 23:32:34.600300 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.600200    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg96j\" (UniqueName: \"kubernetes.io/projected/944648b0-3bda-4b97-b14d-4ac61534ef91-kube-api-access-tg96j\") pod \"944648b0-3bda-4b97-b14d-4ac61534ef91\" (UID: \"944648b0-3bda-4b97-b14d-4ac61534ef91\") "
Jul 02 23:32:34.600554 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.600529    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/944648b0-3bda-4b97-b14d-4ac61534ef91-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "944648b0-3bda-4b97-b14d-4ac61534ef91" (UID: "944648b0-3bda-4b97-b14d-4ac61534ef91"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:32:34.602347 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.602325    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/944648b0-3bda-4b97-b14d-4ac61534ef91-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "944648b0-3bda-4b97-b14d-4ac61534ef91" (UID: "944648b0-3bda-4b97-b14d-4ac61534ef91"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:32:34.602476 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.602456    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/944648b0-3bda-4b97-b14d-4ac61534ef91-kube-api-access-tg96j" (OuterVolumeSpecName: "kube-api-access-tg96j") pod "944648b0-3bda-4b97-b14d-4ac61534ef91" (UID: "944648b0-3bda-4b97-b14d-4ac61534ef91"). InnerVolumeSpecName "kube-api-access-tg96j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:32:34.701978 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.701944    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/944648b0-3bda-4b97-b14d-4ac61534ef91-openshift-service-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:32:34.701978 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.701969    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/944648b0-3bda-4b97-b14d-4ac61534ef91-maas-api-tls\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:32:34.701978 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.701979    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg96j\" (UniqueName: \"kubernetes.io/projected/944648b0-3bda-4b97-b14d-4ac61534ef91-kube-api-access-tg96j\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:32:34.863484 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.863454    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"]
Jul 02 23:32:34.866558 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:34.866535    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-4d528601-7844dfbc87-dvzdr"]
Jul 02 23:32:35.572645 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:35.572611    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="944648b0-3bda-4b97-b14d-4ac61534ef91" path="/var/lib/kubelet/pods/944648b0-3bda-4b97-b14d-4ac61534ef91/volumes"
Jul 02 23:32:36.181846 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:36.181805    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:39.787451 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:39.787371    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:39.848323 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:39.848292    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:40.243322 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:40.243228    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:40.343180 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:40.343146    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:40.442782 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:40.442749    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:41.785344 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:41.785309    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:47.555918 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:47.555859    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:47.614500 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:47.614464    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:47.698693 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:47.698658    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:47.792159 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:47.792129    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:47.894534 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:47.894443    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:32:48.218752 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:32:48.218663    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:33:14.171275 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:33:14.171240    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:33:20.027071 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:33:20.027025    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:33:20.132729 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:33:20.132690    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:33:20.228078 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:33:20.228043    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:33:36.100093 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:33:36.100061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:33:41.651109 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:33:41.651073    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:33:41.755358 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:33:41.755324    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:33:41.854176 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:33:41.854140    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:33:52.362402 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:33:52.362369    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:33:53.128375 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:33:53.128338    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:33:59.119400 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:33:59.119362    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:33:59.223890 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:33:59.223830    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:33:59.319317 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:33:59.319283    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:33:59.423445 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:33:59.423362    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:00.177198 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:00.177168    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:00.283814 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:00.283761    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:00.377038 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:00.377006    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:01.935492 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:01.935460    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:07.589339 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:07.589307    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:07.644075 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:07.644047    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:08.240726 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:08.240690    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:13.871361 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:13.871329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:13.933567 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:13.933534    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:14.112253 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:14.112215    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:14.436206 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:14.436172    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:14.717350 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:14.717254    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:17.198264 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:17.198231    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:17.280971 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:17.280931    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:17.347798 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:17.347762    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:17.444189 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:17.444146    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:17.847840 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:17.847808    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:17.950044 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:17.950008    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:21.700242 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:21.700208    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:22.329782 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:22.329743    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:22.429795 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:22.429762    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:22.766071 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:22.765952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:28.378122 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:28.378089    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:28.486965 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:28.486908    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:28.910356 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:28.910317    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:29.208017 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:29.207943    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:29.308889 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:29.308854    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:34.912068 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:34.912026    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:34.969996 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:34.969965    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:35.165150 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:35.165061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:35.397386 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:35.397350    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:35.500302 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:35.500228    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:35.604829 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:35.604797    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:35.699491 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:35.699452    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:41.251861 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:41.251821    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:41.353297 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:41.353259    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:41.471726 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:41.471687    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:41.621496 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:41.621459    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:47.356581 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:47.356543    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:47.415854 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:47.415814    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:53.733177 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:53.733145    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:54.019895 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:54.019788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:54.332767 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:54.332736    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:57.366712 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.366680    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:57.422999 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.422958    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"]
Jul 02 23:34:57.423367 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.423351    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="944648b0-3bda-4b97-b14d-4ac61534ef91" containerName="maas-api"
Jul 02 23:34:57.423367 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.423367    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="944648b0-3bda-4b97-b14d-4ac61534ef91" containerName="maas-api"
Jul 02 23:34:57.423542 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.423431    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="944648b0-3bda-4b97-b14d-4ac61534ef91" containerName="maas-api"
Jul 02 23:34:57.426599 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.426578    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"
Jul 02 23:34:57.428923 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.428904    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-4cfb54d6-serving-cert\""
Jul 02 23:34:57.436444 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.436425    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"]
Jul 02 23:34:57.441982 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.441962    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:57.498037 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.497989    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:57.520002 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.519972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04b1484e-9391-431d-8a37-82c0d3a3e4bf-maas-api-tls\") pod \"maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl\" (UID: \"04b1484e-9391-431d-8a37-82c0d3a3e4bf\") " pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"
Jul 02 23:34:57.520129 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.520014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04b1484e-9391-431d-8a37-82c0d3a3e4bf-openshift-service-ca\") pod \"maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl\" (UID: \"04b1484e-9391-431d-8a37-82c0d3a3e4bf\") " pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"
Jul 02 23:34:57.520129 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.520036    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr4nr\" (UniqueName: \"kubernetes.io/projected/04b1484e-9391-431d-8a37-82c0d3a3e4bf-kube-api-access-dr4nr\") pod \"maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl\" (UID: \"04b1484e-9391-431d-8a37-82c0d3a3e4bf\") " pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"
Jul 02 23:34:57.620537 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.620446    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04b1484e-9391-431d-8a37-82c0d3a3e4bf-maas-api-tls\") pod \"maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl\" (UID: \"04b1484e-9391-431d-8a37-82c0d3a3e4bf\") " pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"
Jul 02 23:34:57.620537 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.620492    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04b1484e-9391-431d-8a37-82c0d3a3e4bf-openshift-service-ca\") pod \"maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl\" (UID: \"04b1484e-9391-431d-8a37-82c0d3a3e4bf\") " pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"
Jul 02 23:34:57.620537 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.620509    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr4nr\" (UniqueName: \"kubernetes.io/projected/04b1484e-9391-431d-8a37-82c0d3a3e4bf-kube-api-access-dr4nr\") pod \"maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl\" (UID: \"04b1484e-9391-431d-8a37-82c0d3a3e4bf\") " pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"
Jul 02 23:34:57.620765 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:34:57.620592    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-4cfb54d6-serving-cert: secret "maas-api-e2e-mt-4cfb54d6-serving-cert" not found
Jul 02 23:34:57.620765 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:34:57.620667    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04b1484e-9391-431d-8a37-82c0d3a3e4bf-maas-api-tls podName:04b1484e-9391-431d-8a37-82c0d3a3e4bf nodeName:}" failed. No retries permitted until 2026-07-02 23:34:58.120648614 +0000 UTC m=+1661.084081928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/04b1484e-9391-431d-8a37-82c0d3a3e4bf-maas-api-tls") pod "maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl" (UID: "04b1484e-9391-431d-8a37-82c0d3a3e4bf") : secret "maas-api-e2e-mt-4cfb54d6-serving-cert" not found
Jul 02 23:34:57.621134 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.621118    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04b1484e-9391-431d-8a37-82c0d3a3e4bf-openshift-service-ca\") pod \"maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl\" (UID: \"04b1484e-9391-431d-8a37-82c0d3a3e4bf\") " pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"
Jul 02 23:34:57.628534 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.628508    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr4nr\" (UniqueName: \"kubernetes.io/projected/04b1484e-9391-431d-8a37-82c0d3a3e4bf-kube-api-access-dr4nr\") pod \"maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl\" (UID: \"04b1484e-9391-431d-8a37-82c0d3a3e4bf\") " pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"
Jul 02 23:34:57.715955 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.715917    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:57.897805 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.897723    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:57.999840 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:57.999806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:34:58.124944 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:58.124901    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04b1484e-9391-431d-8a37-82c0d3a3e4bf-maas-api-tls\") pod \"maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl\" (UID: \"04b1484e-9391-431d-8a37-82c0d3a3e4bf\") " pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"
Jul 02 23:34:58.127447 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:58.127427    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04b1484e-9391-431d-8a37-82c0d3a3e4bf-maas-api-tls\") pod \"maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl\" (UID: \"04b1484e-9391-431d-8a37-82c0d3a3e4bf\") " pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"
Jul 02 23:34:58.338202 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:58.338174    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"
Jul 02 23:34:58.474217 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:58.474193    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"]
Jul 02 23:34:58.476994 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:34:58.476968    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b1484e_9391_431d_8a37_82c0d3a3e4bf.slice/crio-64d1143643811f9d47dc3a745f875627588e176fbe071a36f2233d22c352d0e4 WatchSource:0}: Error finding container 64d1143643811f9d47dc3a745f875627588e176fbe071a36f2233d22c352d0e4: Status 404 returned error can't find the container with id 64d1143643811f9d47dc3a745f875627588e176fbe071a36f2233d22c352d0e4
Jul 02 23:34:59.226056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:59.226018    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl" event={"ID":"04b1484e-9391-431d-8a37-82c0d3a3e4bf","Type":"ContainerStarted","Data":"79df6fccef6bf5ce56477e36a2a2545e302bd99fc9c11187c3d2f24769dbcef4"}
Jul 02 23:34:59.226253 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:59.226072    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl" event={"ID":"04b1484e-9391-431d-8a37-82c0d3a3e4bf","Type":"ContainerStarted","Data":"64d1143643811f9d47dc3a745f875627588e176fbe071a36f2233d22c352d0e4"}
Jul 02 23:34:59.226253 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:59.226113    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"
Jul 02 23:34:59.242201 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:34:59.242150    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl" podStartSLOduration=1.957384945 podStartE2EDuration="2.242131715s" totalImagesPullingTime="284.74677ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:34:59.240258195 +0000 UTC m=+1662.203691529" watchObservedRunningTime="2026-07-02 23:34:59.242131715 +0000 UTC m=+1662.205565047"
Jul 02 23:35:01.840136 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:01.840096    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:05.236267 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:05.236239    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"
Jul 02 23:35:12.537046 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.537013    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"]
Jul 02 23:35:12.540845 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.540824    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.543991 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.543957    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4cfb54d6\"/\"kube-root-ca.crt\""
Jul 02 23:35:12.544109 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.543997    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4cfb54d6\"/\"e2e-lifecycle-model-4cfb54d6-kserve-self-signed-certs\""
Jul 02 23:35:12.544109 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.543963    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-4cfb54d6\"/\"openshift-service-ca.crt\""
Jul 02 23:35:12.544109 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.543959    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-4cfb54d6\"/\"default-dockercfg-rbr54\""
Jul 02 23:35:12.551154 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.551136    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"]
Jul 02 23:35:12.561865 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.561838    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:12.659550 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.659515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40600efe-ba9e-4b9d-831f-f7a66b611544-tls-certs\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.659715 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.659570    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-tmp-dir\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.659715 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.659651    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqm9k\" (UniqueName: \"kubernetes.io/projected/40600efe-ba9e-4b9d-831f-f7a66b611544-kube-api-access-wqm9k\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.659715 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.659685    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-dshm\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.659847 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.659737    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-home\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.659847 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.659771    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-model-cache\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.760507 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.760471    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40600efe-ba9e-4b9d-831f-f7a66b611544-tls-certs\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.760665 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.760526    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-tmp-dir\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.760665 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.760566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqm9k\" (UniqueName: \"kubernetes.io/projected/40600efe-ba9e-4b9d-831f-f7a66b611544-kube-api-access-wqm9k\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.760665 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.760587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-dshm\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.760928 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.760906    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-home\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.761028 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.760957    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-model-cache\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.761028 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.761005    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-tmp-dir\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.761235 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.761215    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-home\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.761321 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.761303    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-model-cache\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.763107 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.763088    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-dshm\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.763277 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.763261    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40600efe-ba9e-4b9d-831f-f7a66b611544-tls-certs\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.768019 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.767999    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqm9k\" (UniqueName: \"kubernetes.io/projected/40600efe-ba9e-4b9d-831f-f7a66b611544-kube-api-access-wqm9k\") pod \"e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") " pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.850738 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.850654    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:12.987636 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:12.987608    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"]
Jul 02 23:35:12.989323 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:35:12.989299    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40600efe_ba9e_4b9d_831f_f7a66b611544.slice/crio-d872a5a73704e8ba2aada9458a653fc15f9e5354d3514c7c006f1c1c0ae5b6e1 WatchSource:0}: Error finding container d872a5a73704e8ba2aada9458a653fc15f9e5354d3514c7c006f1c1c0ae5b6e1: Status 404 returned error can't find the container with id d872a5a73704e8ba2aada9458a653fc15f9e5354d3514c7c006f1c1c0ae5b6e1
Jul 02 23:35:13.303273 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:13.303234    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2" event={"ID":"40600efe-ba9e-4b9d-831f-f7a66b611544","Type":"ContainerStarted","Data":"4ca3cc20414d36edd7fdd19954826f0d9430215ddb975abeb52b0a9185c9171e"}
Jul 02 23:35:13.303273 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:13.303279    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2" event={"ID":"40600efe-ba9e-4b9d-831f-f7a66b611544","Type":"ContainerStarted","Data":"d872a5a73704e8ba2aada9458a653fc15f9e5354d3514c7c006f1c1c0ae5b6e1"}
Jul 02 23:35:13.319943 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:13.319898    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2" podStartSLOduration=1.31986326 podStartE2EDuration="1.31986326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:35:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:35:13.317556216 +0000 UTC m=+1676.280989544" watchObservedRunningTime="2026-07-02 23:35:13.31986326 +0000 UTC m=+1676.283296593"
Jul 02 23:35:22.850788 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:22.850742    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:22.850788 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:22.850790    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:22.863630 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:22.863601    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:23.360525 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:23.360493    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:35:24.628795 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:24.628764    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:24.728142 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:24.728061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:39.298933 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:39.298806    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:39.778356 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:39.778321    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:39.880694 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:39.880662    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:39.988456 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:39.988415    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"]
Jul 02 23:35:39.988657 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:39.988635    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl" podUID="04b1484e-9391-431d-8a37-82c0d3a3e4bf" containerName="maas-api" containerID="cri-o://79df6fccef6bf5ce56477e36a2a2545e302bd99fc9c11187c3d2f24769dbcef4" gracePeriod=30
Jul 02 23:35:40.015325 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.015274    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:40.239734 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.239706    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"
Jul 02 23:35:40.305596 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.305564    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr4nr\" (UniqueName: \"kubernetes.io/projected/04b1484e-9391-431d-8a37-82c0d3a3e4bf-kube-api-access-dr4nr\") pod \"04b1484e-9391-431d-8a37-82c0d3a3e4bf\" (UID: \"04b1484e-9391-431d-8a37-82c0d3a3e4bf\") "
Jul 02 23:35:40.306079 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.305614    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04b1484e-9391-431d-8a37-82c0d3a3e4bf-maas-api-tls\") pod \"04b1484e-9391-431d-8a37-82c0d3a3e4bf\" (UID: \"04b1484e-9391-431d-8a37-82c0d3a3e4bf\") "
Jul 02 23:35:40.306079 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.305665    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04b1484e-9391-431d-8a37-82c0d3a3e4bf-openshift-service-ca\") pod \"04b1484e-9391-431d-8a37-82c0d3a3e4bf\" (UID: \"04b1484e-9391-431d-8a37-82c0d3a3e4bf\") "
Jul 02 23:35:40.306079 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.306041    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04b1484e-9391-431d-8a37-82c0d3a3e4bf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "04b1484e-9391-431d-8a37-82c0d3a3e4bf" (UID: "04b1484e-9391-431d-8a37-82c0d3a3e4bf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:35:40.307643 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.307624    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04b1484e-9391-431d-8a37-82c0d3a3e4bf-kube-api-access-dr4nr" (OuterVolumeSpecName: "kube-api-access-dr4nr") pod "04b1484e-9391-431d-8a37-82c0d3a3e4bf" (UID: "04b1484e-9391-431d-8a37-82c0d3a3e4bf"). InnerVolumeSpecName "kube-api-access-dr4nr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:35:40.307809 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.307783    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04b1484e-9391-431d-8a37-82c0d3a3e4bf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "04b1484e-9391-431d-8a37-82c0d3a3e4bf" (UID: "04b1484e-9391-431d-8a37-82c0d3a3e4bf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:35:40.407478 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.407387    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr4nr\" (UniqueName: \"kubernetes.io/projected/04b1484e-9391-431d-8a37-82c0d3a3e4bf-kube-api-access-dr4nr\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:35:40.407478 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.407418    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04b1484e-9391-431d-8a37-82c0d3a3e4bf-maas-api-tls\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:35:40.407478 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.407427    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04b1484e-9391-431d-8a37-82c0d3a3e4bf-openshift-service-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:35:40.426431 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.426397    2581 generic.go:356] "Generic (PLEG): container finished" podID="04b1484e-9391-431d-8a37-82c0d3a3e4bf" containerID="79df6fccef6bf5ce56477e36a2a2545e302bd99fc9c11187c3d2f24769dbcef4" exitCode=0
Jul 02 23:35:40.426569 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.426447    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"
Jul 02 23:35:40.426569 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.426484    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl" event={"ID":"04b1484e-9391-431d-8a37-82c0d3a3e4bf","Type":"ContainerDied","Data":"79df6fccef6bf5ce56477e36a2a2545e302bd99fc9c11187c3d2f24769dbcef4"}
Jul 02 23:35:40.426569 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.426541    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl" event={"ID":"04b1484e-9391-431d-8a37-82c0d3a3e4bf","Type":"ContainerDied","Data":"64d1143643811f9d47dc3a745f875627588e176fbe071a36f2233d22c352d0e4"}
Jul 02 23:35:40.426569 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.426563    2581 scope.go:117] "RemoveContainer" containerID="79df6fccef6bf5ce56477e36a2a2545e302bd99fc9c11187c3d2f24769dbcef4"
Jul 02 23:35:40.435640 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.435624    2581 scope.go:117] "RemoveContainer" containerID="79df6fccef6bf5ce56477e36a2a2545e302bd99fc9c11187c3d2f24769dbcef4"
Jul 02 23:35:40.435903 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:35:40.435865    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79df6fccef6bf5ce56477e36a2a2545e302bd99fc9c11187c3d2f24769dbcef4\": container with ID starting with 79df6fccef6bf5ce56477e36a2a2545e302bd99fc9c11187c3d2f24769dbcef4 not found: ID does not exist" containerID="79df6fccef6bf5ce56477e36a2a2545e302bd99fc9c11187c3d2f24769dbcef4"
Jul 02 23:35:40.435954 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.435912    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79df6fccef6bf5ce56477e36a2a2545e302bd99fc9c11187c3d2f24769dbcef4"} err="failed to get container status \"79df6fccef6bf5ce56477e36a2a2545e302bd99fc9c11187c3d2f24769dbcef4\": rpc error: code = NotFound desc = could not find container \"79df6fccef6bf5ce56477e36a2a2545e302bd99fc9c11187c3d2f24769dbcef4\": container with ID starting with 79df6fccef6bf5ce56477e36a2a2545e302bd99fc9c11187c3d2f24769dbcef4 not found: ID does not exist"
Jul 02 23:35:40.445863 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.445842    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"]
Jul 02 23:35:40.450732 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:40.450704    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl"]
Jul 02 23:35:41.571586 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:41.571541    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04b1484e-9391-431d-8a37-82c0d3a3e4bf" path="/var/lib/kubelet/pods/04b1484e-9391-431d-8a37-82c0d3a3e4bf/volumes"
Jul 02 23:35:43.232857 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:43.232810    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-mt-4cfb54d6-b7f88985-qxmfl" podUID="04b1484e-9391-431d-8a37-82c0d3a3e4bf" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.43:8443/health\": context deadline exceeded"
Jul 02 23:35:45.320161 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:45.320128    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:35:50.305190 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:50.305151    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"]
Jul 02 23:35:50.350596 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:35:50.350561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:05.326714 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.326673    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2" podUID="40600efe-ba9e-4b9d-831f-f7a66b611544" containerName="main" containerID="cri-o://4ca3cc20414d36edd7fdd19954826f0d9430215ddb975abeb52b0a9185c9171e" gracePeriod=45
Jul 02 23:36:05.550214 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.550178    2581 generic.go:356] "Generic (PLEG): container finished" podID="40600efe-ba9e-4b9d-831f-f7a66b611544" containerID="4ca3cc20414d36edd7fdd19954826f0d9430215ddb975abeb52b0a9185c9171e" exitCode=0
Jul 02 23:36:05.550379 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.550260    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2" event={"ID":"40600efe-ba9e-4b9d-831f-f7a66b611544","Type":"ContainerDied","Data":"4ca3cc20414d36edd7fdd19954826f0d9430215ddb975abeb52b0a9185c9171e"}
Jul 02 23:36:05.585257 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.585199    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:36:05.662977 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.662949    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-dshm\") pod \"40600efe-ba9e-4b9d-831f-f7a66b611544\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") "
Jul 02 23:36:05.663155 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.662993    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-home\") pod \"40600efe-ba9e-4b9d-831f-f7a66b611544\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") "
Jul 02 23:36:05.663155 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.663016    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40600efe-ba9e-4b9d-831f-f7a66b611544-tls-certs\") pod \"40600efe-ba9e-4b9d-831f-f7a66b611544\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") "
Jul 02 23:36:05.663155 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.663041    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-model-cache\") pod \"40600efe-ba9e-4b9d-831f-f7a66b611544\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") "
Jul 02 23:36:05.663155 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.663102    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-tmp-dir\") pod \"40600efe-ba9e-4b9d-831f-f7a66b611544\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") "
Jul 02 23:36:05.663155 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.663127    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqm9k\" (UniqueName: \"kubernetes.io/projected/40600efe-ba9e-4b9d-831f-f7a66b611544-kube-api-access-wqm9k\") pod \"40600efe-ba9e-4b9d-831f-f7a66b611544\" (UID: \"40600efe-ba9e-4b9d-831f-f7a66b611544\") "
Jul 02 23:36:05.663427 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.663266    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-home" (OuterVolumeSpecName: "home") pod "40600efe-ba9e-4b9d-831f-f7a66b611544" (UID: "40600efe-ba9e-4b9d-831f-f7a66b611544"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:36:05.663427 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.663304    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-model-cache" (OuterVolumeSpecName: "model-cache") pod "40600efe-ba9e-4b9d-831f-f7a66b611544" (UID: "40600efe-ba9e-4b9d-831f-f7a66b611544"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:36:05.663427 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.663400    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "40600efe-ba9e-4b9d-831f-f7a66b611544" (UID: "40600efe-ba9e-4b9d-831f-f7a66b611544"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:36:05.663621 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.663596    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-home\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:36:05.663698 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.663620    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-model-cache\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:36:05.663698 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.663637    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-tmp-dir\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:36:05.665527 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.665501    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-dshm" (OuterVolumeSpecName: "dshm") pod "40600efe-ba9e-4b9d-831f-f7a66b611544" (UID: "40600efe-ba9e-4b9d-831f-f7a66b611544"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:36:05.665838 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.665823    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40600efe-ba9e-4b9d-831f-f7a66b611544-kube-api-access-wqm9k" (OuterVolumeSpecName: "kube-api-access-wqm9k") pod "40600efe-ba9e-4b9d-831f-f7a66b611544" (UID: "40600efe-ba9e-4b9d-831f-f7a66b611544"). InnerVolumeSpecName "kube-api-access-wqm9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:36:05.665940 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.665843    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40600efe-ba9e-4b9d-831f-f7a66b611544-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "40600efe-ba9e-4b9d-831f-f7a66b611544" (UID: "40600efe-ba9e-4b9d-831f-f7a66b611544"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:36:05.765093 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.765063    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/40600efe-ba9e-4b9d-831f-f7a66b611544-dshm\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:36:05.765093 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.765089    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/40600efe-ba9e-4b9d-831f-f7a66b611544-tls-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:36:05.765093 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:05.765101    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqm9k\" (UniqueName: \"kubernetes.io/projected/40600efe-ba9e-4b9d-831f-f7a66b611544-kube-api-access-wqm9k\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:36:06.555739 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:06.555713    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"
Jul 02 23:36:06.555739 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:06.555723    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2" event={"ID":"40600efe-ba9e-4b9d-831f-f7a66b611544","Type":"ContainerDied","Data":"d872a5a73704e8ba2aada9458a653fc15f9e5354d3514c7c006f1c1c0ae5b6e1"}
Jul 02 23:36:06.556305 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:06.555769    2581 scope.go:117] "RemoveContainer" containerID="4ca3cc20414d36edd7fdd19954826f0d9430215ddb975abeb52b0a9185c9171e"
Jul 02 23:36:06.574480 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:06.574456    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"]
Jul 02 23:36:06.579791 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:06.579769    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-4cfb54d6/e2e-lifecycle-model-4cfb54d6-kserve-54fb95c4f5-pdbg2"]
Jul 02 23:36:07.577768 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:07.577735    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40600efe-ba9e-4b9d-831f-f7a66b611544" path="/var/lib/kubelet/pods/40600efe-ba9e-4b9d-831f-f7a66b611544/volumes"
Jul 02 23:36:26.536241 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:26.536206    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:27.215230 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:27.215199    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:32.613929 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:32.613868    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:32.673856 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:32.673817    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:32.889651 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:32.889569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:33.164206 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:33.164114    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:34.157246 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:34.157215    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:34.257060 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:34.257021    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:34.359832 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:34.359800    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:35.058712 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:35.058673    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:35.158479 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:35.158439    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:35.259350 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:35.259317    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:36.591120 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:36.591086    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:42.204150 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:42.204108    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:42.305913 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:42.305863    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:42.854635 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:42.854603    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:48.692974 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:48.692940    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:48.749111 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:48.749083    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:48.829670 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:48.829615    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:48.926198 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:48.926171    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:59.384401 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:59.384369    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:36:59.713516 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:36:59.713431    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:20.673676 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:20.673640    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:26.196070 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:26.196023    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:26.255026 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:26.254976    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:26.533271 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:26.533235    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:26.834936 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:26.834837    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:27.097680 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:27.097596    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:30.091313 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:30.091274    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:30.175556 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:30.175520    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:30.240999 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:30.240965    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:30.341735 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:30.341634    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:30.776831 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:30.776798    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:30.876511 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:30.876474    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:34.002294 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:34.002236    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:34.053672 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:34.053638    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:34.585012 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:34.584981    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:34.920580 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:34.920489    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:35.220109 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:35.220030    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:35.344751 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:35.344716    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:38.093146 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.093110    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:38.198194 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.198159    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:38.198805 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.198785    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"]
Jul 02 23:37:38.199325 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.199303    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40600efe-ba9e-4b9d-831f-f7a66b611544" containerName="main"
Jul 02 23:37:38.199325 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.199325    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="40600efe-ba9e-4b9d-831f-f7a66b611544" containerName="main"
Jul 02 23:37:38.199485 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.199346    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04b1484e-9391-431d-8a37-82c0d3a3e4bf" containerName="maas-api"
Jul 02 23:37:38.199485 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.199355    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="04b1484e-9391-431d-8a37-82c0d3a3e4bf" containerName="maas-api"
Jul 02 23:37:38.199485 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.199443    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="40600efe-ba9e-4b9d-831f-f7a66b611544" containerName="main"
Jul 02 23:37:38.199485 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.199456    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="04b1484e-9391-431d-8a37-82c0d3a3e4bf" containerName="maas-api"
Jul 02 23:37:38.202594 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.202569    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"
Jul 02 23:37:38.204848 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.204828    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-2998a4-serving-cert\""
Jul 02 23:37:38.214770 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.214746    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"]
Jul 02 23:37:38.300131 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.300097    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:38.309324 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.309303    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb6vb\" (UniqueName: \"kubernetes.io/projected/4a1e389f-78ef-4289-935a-d2278d54024a-kube-api-access-sb6vb\") pod \"maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z\" (UID: \"4a1e389f-78ef-4289-935a-d2278d54024a\") " pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"
Jul 02 23:37:38.309407 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.309398    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a1e389f-78ef-4289-935a-d2278d54024a-maas-api-tls\") pod \"maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z\" (UID: \"4a1e389f-78ef-4289-935a-d2278d54024a\") " pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"
Jul 02 23:37:38.309449 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.309420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1e389f-78ef-4289-935a-d2278d54024a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z\" (UID: \"4a1e389f-78ef-4289-935a-d2278d54024a\") " pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"
Jul 02 23:37:38.410655 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.410564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a1e389f-78ef-4289-935a-d2278d54024a-maas-api-tls\") pod \"maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z\" (UID: \"4a1e389f-78ef-4289-935a-d2278d54024a\") " pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"
Jul 02 23:37:38.410655 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.410599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1e389f-78ef-4289-935a-d2278d54024a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z\" (UID: \"4a1e389f-78ef-4289-935a-d2278d54024a\") " pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"
Jul 02 23:37:38.410655 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.410628    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb6vb\" (UniqueName: \"kubernetes.io/projected/4a1e389f-78ef-4289-935a-d2278d54024a-kube-api-access-sb6vb\") pod \"maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z\" (UID: \"4a1e389f-78ef-4289-935a-d2278d54024a\") " pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"
Jul 02 23:37:38.411235 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.411209    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1e389f-78ef-4289-935a-d2278d54024a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z\" (UID: \"4a1e389f-78ef-4289-935a-d2278d54024a\") " pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"
Jul 02 23:37:38.413180 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.413163    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a1e389f-78ef-4289-935a-d2278d54024a-maas-api-tls\") pod \"maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z\" (UID: \"4a1e389f-78ef-4289-935a-d2278d54024a\") " pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"
Jul 02 23:37:38.421486 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.421461    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb6vb\" (UniqueName: \"kubernetes.io/projected/4a1e389f-78ef-4289-935a-d2278d54024a-kube-api-access-sb6vb\") pod \"maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z\" (UID: \"4a1e389f-78ef-4289-935a-d2278d54024a\") " pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"
Jul 02 23:37:38.457064 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.457029    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:38.514582 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.514543    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"
Jul 02 23:37:38.659285 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.659253    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"]
Jul 02 23:37:38.661078 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:37:38.661024    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a1e389f_78ef_4289_935a_d2278d54024a.slice/crio-28c96c71c49157d32e55300961b8924f49bf6bdd8a054a33a893294e40597687 WatchSource:0}: Error finding container 28c96c71c49157d32e55300961b8924f49bf6bdd8a054a33a893294e40597687: Status 404 returned error can't find the container with id 28c96c71c49157d32e55300961b8924f49bf6bdd8a054a33a893294e40597687
Jul 02 23:37:38.662407 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.662390    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 23:37:38.779286 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.779259    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:38.874507 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.874476    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:38.976113 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:38.976037    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z" event={"ID":"4a1e389f-78ef-4289-935a-d2278d54024a","Type":"ContainerStarted","Data":"28c96c71c49157d32e55300961b8924f49bf6bdd8a054a33a893294e40597687"}
Jul 02 23:37:39.982808 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:39.982770    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z" event={"ID":"4a1e389f-78ef-4289-935a-d2278d54024a","Type":"ContainerStarted","Data":"be2da70a6cfbc1df89dd34ceead79a37ef6d25a519525b921a4f573a9746f2f8"}
Jul 02 23:37:39.983202 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:39.982847    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"
Jul 02 23:37:39.999407 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:39.999355    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z" podStartSLOduration=1.684369287 podStartE2EDuration="1.999336863s" totalImagesPullingTime="314.967576ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:37:39.998408959 +0000 UTC m=+1822.961842292" watchObservedRunningTime="2026-07-02 23:37:39.999336863 +0000 UTC m=+1822.962770193"
Jul 02 23:37:42.563678 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:42.563638    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:45.993072 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:45.993042    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"
Jul 02 23:37:48.221380 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:48.221345    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:52.240529 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:52.240491    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:52.346087 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:52.346051    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:59.430128 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:59.430094    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:37:59.530413 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:37:59.530377    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:38:08.335584 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.335544    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"]
Jul 02 23:38:08.339361 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.339340    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.341554 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.341535    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-dbb152\"/\"kube-root-ca.crt\""
Jul 02 23:38:08.342331 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.342313    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-dbb152\"/\"default-dockercfg-f7jcf\""
Jul 02 23:38:08.342389 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.342341    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-dbb152\"/\"test-model-dbb152-kserve-self-signed-certs\""
Jul 02 23:38:08.342389 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.342360    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-dbb152\"/\"openshift-service-ca.crt\""
Jul 02 23:38:08.345235 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.345213    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"]
Jul 02 23:38:08.405612 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.405554    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-home\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.405612 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.405598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx22l\" (UniqueName: \"kubernetes.io/projected/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-kube-api-access-hx22l\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.405904 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.405639    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-dshm\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.405904 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.405680    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-tls-certs\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.405904 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.405729    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-tmp-dir\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.405904 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.405768    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-model-cache\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.427080 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.427052    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:38:08.506667 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.506628    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-home\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.506667 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.506667    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx22l\" (UniqueName: \"kubernetes.io/projected/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-kube-api-access-hx22l\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.507019 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.506691    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-dshm\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.507019 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.506720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-tls-certs\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.507019 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.506756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-tmp-dir\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.507019 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.506784    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-model-cache\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.507257 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.507170    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-home\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.507257 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.507228    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-model-cache\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.507339 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.507261    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-tmp-dir\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.509289 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.509263    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-dshm\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.509480 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.509461    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-tls-certs\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.514029 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.514000    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx22l\" (UniqueName: \"kubernetes.io/projected/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-kube-api-access-hx22l\") pod \"test-model-dbb152-kserve-775668f7b5-ks7vl\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") " pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.650468 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.650377    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:08.792226 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:08.792144    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"]
Jul 02 23:38:08.796621 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:38:08.796165    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poded6d8b49_1cb4_4e24_b2ff_f7373b03be7a.slice/crio-0013fd3d5081652fa13305eb1d0b4e0565d65b91c4861aa2c6231c992bce8cd6 WatchSource:0}: Error finding container 0013fd3d5081652fa13305eb1d0b4e0565d65b91c4861aa2c6231c992bce8cd6: Status 404 returned error can't find the container with id 0013fd3d5081652fa13305eb1d0b4e0565d65b91c4861aa2c6231c992bce8cd6
Jul 02 23:38:09.117660 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:09.117616    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl" event={"ID":"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a","Type":"ContainerStarted","Data":"7f0b5e4a4633791e6efb5037df60215c9b477c9ac073a240d9a919f6a0116392"}
Jul 02 23:38:09.117869 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:09.117669    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl" event={"ID":"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a","Type":"ContainerStarted","Data":"0013fd3d5081652fa13305eb1d0b4e0565d65b91c4861aa2c6231c992bce8cd6"}
Jul 02 23:38:09.134033 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:09.133974    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl" podStartSLOduration=1.133957278 podStartE2EDuration="1.133957278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:38:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:38:09.132568684 +0000 UTC m=+1852.096002019" watchObservedRunningTime="2026-07-02 23:38:09.133957278 +0000 UTC m=+1852.097390614"
Jul 02 23:38:18.651159 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:18.651115    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:18.651656 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:18.651175    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:18.664571 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:18.664542    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:19.175824 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:19.175796    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:38:36.869298 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:38:36.869261    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:01.345689 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:01.345657    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"]
Jul 02 23:39:01.367237 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:01.367201    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:02.702595 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:02.702565    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:02.907417 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:02.907374    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:03.010869 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:03.010783    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:03.108562 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:03.108531    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:03.208652 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:03.208615    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:07.987857 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:07.987821    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:16.366447 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.366407    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl" podUID="ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a" containerName="main" containerID="cri-o://7f0b5e4a4633791e6efb5037df60215c9b477c9ac073a240d9a919f6a0116392" gracePeriod=45
Jul 02 23:39:16.616985 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.616929    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:39:16.760437 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.760411    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-dshm\") pod \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") "
Jul 02 23:39:16.760627 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.760457    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-model-cache\") pod \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") "
Jul 02 23:39:16.760627 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.760487    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-home\") pod \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") "
Jul 02 23:39:16.760627 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.760508    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-tls-certs\") pod \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") "
Jul 02 23:39:16.760627 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.760562    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-tmp-dir\") pod \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") "
Jul 02 23:39:16.760627 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.760594    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx22l\" (UniqueName: \"kubernetes.io/projected/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-kube-api-access-hx22l\") pod \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\" (UID: \"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a\") "
Jul 02 23:39:16.760895 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.760726    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-model-cache" (OuterVolumeSpecName: "model-cache") pod "ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a" (UID: "ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:39:16.760895 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.760754    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-home" (OuterVolumeSpecName: "home") pod "ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a" (UID: "ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:39:16.760895 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.760840    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a" (UID: "ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:39:16.761053 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.760926    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-model-cache\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:39:16.761053 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.760939    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-home\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:39:16.761053 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.760947    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-tmp-dir\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:39:16.762690 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.762660    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-dshm" (OuterVolumeSpecName: "dshm") pod "ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a" (UID: "ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 23:39:16.762690 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.762660    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a" (UID: "ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:39:16.762841 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.762746    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-kube-api-access-hx22l" (OuterVolumeSpecName: "kube-api-access-hx22l") pod "ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a" (UID: "ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a"). InnerVolumeSpecName "kube-api-access-hx22l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:39:16.862205 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.862170    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-tls-certs\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:39:16.862205 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.862198    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx22l\" (UniqueName: \"kubernetes.io/projected/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-kube-api-access-hx22l\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:39:16.862205 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:16.862208    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a-dshm\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:39:17.444204 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:17.444170    2581 generic.go:356] "Generic (PLEG): container finished" podID="ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a" containerID="7f0b5e4a4633791e6efb5037df60215c9b477c9ac073a240d9a919f6a0116392" exitCode=0
Jul 02 23:39:17.444677 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:17.444218    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"
Jul 02 23:39:17.444677 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:17.444252    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl" event={"ID":"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a","Type":"ContainerDied","Data":"7f0b5e4a4633791e6efb5037df60215c9b477c9ac073a240d9a919f6a0116392"}
Jul 02 23:39:17.444677 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:17.444299    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl" event={"ID":"ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a","Type":"ContainerDied","Data":"0013fd3d5081652fa13305eb1d0b4e0565d65b91c4861aa2c6231c992bce8cd6"}
Jul 02 23:39:17.444677 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:17.444321    2581 scope.go:117] "RemoveContainer" containerID="7f0b5e4a4633791e6efb5037df60215c9b477c9ac073a240d9a919f6a0116392"
Jul 02 23:39:17.460281 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:17.460263    2581 scope.go:117] "RemoveContainer" containerID="7f0b5e4a4633791e6efb5037df60215c9b477c9ac073a240d9a919f6a0116392"
Jul 02 23:39:17.460560 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:39:17.460541    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f0b5e4a4633791e6efb5037df60215c9b477c9ac073a240d9a919f6a0116392\": container with ID starting with 7f0b5e4a4633791e6efb5037df60215c9b477c9ac073a240d9a919f6a0116392 not found: ID does not exist" containerID="7f0b5e4a4633791e6efb5037df60215c9b477c9ac073a240d9a919f6a0116392"
Jul 02 23:39:17.460608 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:17.460570    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f0b5e4a4633791e6efb5037df60215c9b477c9ac073a240d9a919f6a0116392"} err="failed to get container status \"7f0b5e4a4633791e6efb5037df60215c9b477c9ac073a240d9a919f6a0116392\": rpc error: code = NotFound desc = could not find container \"7f0b5e4a4633791e6efb5037df60215c9b477c9ac073a240d9a919f6a0116392\": container with ID starting with 7f0b5e4a4633791e6efb5037df60215c9b477c9ac073a240d9a919f6a0116392 not found: ID does not exist"
Jul 02 23:39:17.464801 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:17.464778    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"]
Jul 02 23:39:17.468803 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:17.468767    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-dbb152/test-model-dbb152-kserve-775668f7b5-ks7vl"]
Jul 02 23:39:17.571675 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:17.571643    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a" path="/var/lib/kubelet/pods/ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a/volumes"
Jul 02 23:39:24.110368 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:24.110322    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:44.543412 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:44.543330    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:44.880544 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:44.880447    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:45.044151 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:45.044118    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:45.212963 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:45.212846    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:45.619256 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:45.619224    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:45.718188 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:45.718156    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:45.832127 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:45.832092    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"]
Jul 02 23:39:45.837205 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:45.837172    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z" podUID="4a1e389f-78ef-4289-935a-d2278d54024a" containerName="maas-api" containerID="cri-o://be2da70a6cfbc1df89dd34ceead79a37ef6d25a519525b921a4f573a9746f2f8" gracePeriod=30
Jul 02 23:39:45.856026 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:45.856000    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:45.987785 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:45.987740    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z" podUID="4a1e389f-78ef-4289-935a-d2278d54024a" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.45:8443/health\": dial tcp 10.134.0.45:8443: connect: connection refused"
Jul 02 23:39:46.084843 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.084820    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"
Jul 02 23:39:46.118771 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.118740    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1e389f-78ef-4289-935a-d2278d54024a-openshift-service-ca\") pod \"4a1e389f-78ef-4289-935a-d2278d54024a\" (UID: \"4a1e389f-78ef-4289-935a-d2278d54024a\") "
Jul 02 23:39:46.118935 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.118842    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sb6vb\" (UniqueName: \"kubernetes.io/projected/4a1e389f-78ef-4289-935a-d2278d54024a-kube-api-access-sb6vb\") pod \"4a1e389f-78ef-4289-935a-d2278d54024a\" (UID: \"4a1e389f-78ef-4289-935a-d2278d54024a\") "
Jul 02 23:39:46.119008 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.118973    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a1e389f-78ef-4289-935a-d2278d54024a-maas-api-tls\") pod \"4a1e389f-78ef-4289-935a-d2278d54024a\" (UID: \"4a1e389f-78ef-4289-935a-d2278d54024a\") "
Jul 02 23:39:46.119126 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.119097    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a1e389f-78ef-4289-935a-d2278d54024a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4a1e389f-78ef-4289-935a-d2278d54024a" (UID: "4a1e389f-78ef-4289-935a-d2278d54024a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:39:46.119284 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.119264    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a1e389f-78ef-4289-935a-d2278d54024a-openshift-service-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:39:46.121076 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.121042    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a1e389f-78ef-4289-935a-d2278d54024a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4a1e389f-78ef-4289-935a-d2278d54024a" (UID: "4a1e389f-78ef-4289-935a-d2278d54024a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:39:46.121208 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.121187    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a1e389f-78ef-4289-935a-d2278d54024a-kube-api-access-sb6vb" (OuterVolumeSpecName: "kube-api-access-sb6vb") pod "4a1e389f-78ef-4289-935a-d2278d54024a" (UID: "4a1e389f-78ef-4289-935a-d2278d54024a"). InnerVolumeSpecName "kube-api-access-sb6vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:39:46.220400 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.220324    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a1e389f-78ef-4289-935a-d2278d54024a-maas-api-tls\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:39:46.220400 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.220351    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sb6vb\" (UniqueName: \"kubernetes.io/projected/4a1e389f-78ef-4289-935a-d2278d54024a-kube-api-access-sb6vb\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:39:46.577857 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.577821    2581 generic.go:356] "Generic (PLEG): container finished" podID="4a1e389f-78ef-4289-935a-d2278d54024a" containerID="be2da70a6cfbc1df89dd34ceead79a37ef6d25a519525b921a4f573a9746f2f8" exitCode=0
Jul 02 23:39:46.577857 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.577858    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"
Jul 02 23:39:46.578103 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.577911    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z" event={"ID":"4a1e389f-78ef-4289-935a-d2278d54024a","Type":"ContainerDied","Data":"be2da70a6cfbc1df89dd34ceead79a37ef6d25a519525b921a4f573a9746f2f8"}
Jul 02 23:39:46.578103 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.577961    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z" event={"ID":"4a1e389f-78ef-4289-935a-d2278d54024a","Type":"ContainerDied","Data":"28c96c71c49157d32e55300961b8924f49bf6bdd8a054a33a893294e40597687"}
Jul 02 23:39:46.578103 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.577986    2581 scope.go:117] "RemoveContainer" containerID="be2da70a6cfbc1df89dd34ceead79a37ef6d25a519525b921a4f573a9746f2f8"
Jul 02 23:39:46.590237 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.590212    2581 scope.go:117] "RemoveContainer" containerID="be2da70a6cfbc1df89dd34ceead79a37ef6d25a519525b921a4f573a9746f2f8"
Jul 02 23:39:46.590535 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:39:46.590515    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be2da70a6cfbc1df89dd34ceead79a37ef6d25a519525b921a4f573a9746f2f8\": container with ID starting with be2da70a6cfbc1df89dd34ceead79a37ef6d25a519525b921a4f573a9746f2f8 not found: ID does not exist" containerID="be2da70a6cfbc1df89dd34ceead79a37ef6d25a519525b921a4f573a9746f2f8"
Jul 02 23:39:46.590622 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.590545    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be2da70a6cfbc1df89dd34ceead79a37ef6d25a519525b921a4f573a9746f2f8"} err="failed to get container status \"be2da70a6cfbc1df89dd34ceead79a37ef6d25a519525b921a4f573a9746f2f8\": rpc error: code = NotFound desc = could not find container \"be2da70a6cfbc1df89dd34ceead79a37ef6d25a519525b921a4f573a9746f2f8\": container with ID starting with be2da70a6cfbc1df89dd34ceead79a37ef6d25a519525b921a4f573a9746f2f8 not found: ID does not exist"
Jul 02 23:39:46.600343 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.600310    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"]
Jul 02 23:39:46.602556 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:46.602531    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-2998a4-6ccbc4d567-qp62z"]
Jul 02 23:39:47.571958 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:47.571923    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a1e389f-78ef-4289-935a-d2278d54024a" path="/var/lib/kubelet/pods/4a1e389f-78ef-4289-935a-d2278d54024a/volumes"
Jul 02 23:39:51.422016 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:51.421978    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:51.480892 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:51.480846    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:51.673310 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:51.673230    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:51.904290 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:51.904255    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:52.228214 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:52.228181    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:52.532928 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:52.532894    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:52.891546 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:52.891442    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:55.825888 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:55.825849    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:55.914137 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:55.914102    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:55.977805 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:55.977769    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:56.079921 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:56.079822    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:56.453385 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:56.453284    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:39:56.554083 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:39:56.554048    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:00.300055 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:00.300017    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:00.721110 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:00.721021    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:01.014208 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:01.014121    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:01.210917 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:01.210859    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:03.885180 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:03.885145    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:03.987991 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:03.987953    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:04.158110 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.158024    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"]
Jul 02 23:40:04.158481 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.158462    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a" containerName="main"
Jul 02 23:40:04.158481 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.158480    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a" containerName="main"
Jul 02 23:40:04.158672 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.158500    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a1e389f-78ef-4289-935a-d2278d54024a" containerName="maas-api"
Jul 02 23:40:04.158672 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.158505    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a1e389f-78ef-4289-935a-d2278d54024a" containerName="maas-api"
Jul 02 23:40:04.158672 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.158562    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a1e389f-78ef-4289-935a-d2278d54024a" containerName="maas-api"
Jul 02 23:40:04.158672 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.158573    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed6d8b49-1cb4-4e24-b2ff-f7373b03be7a" containerName="main"
Jul 02 23:40:04.161734 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.161710    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"
Jul 02 23:40:04.164720 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.164700    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-6c2ab8-serving-cert\""
Jul 02 23:40:04.177713 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.177688    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"]
Jul 02 23:40:04.228942 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.228908    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:04.289157 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.289114    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8l5w\" (UniqueName: \"kubernetes.io/projected/55f8496c-eb71-403e-a7bb-2c2da6561d3f-kube-api-access-k8l5w\") pod \"maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67\" (UID: \"55f8496c-eb71-403e-a7bb-2c2da6561d3f\") " pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"
Jul 02 23:40:04.289333 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.289176    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55f8496c-eb71-403e-a7bb-2c2da6561d3f-openshift-service-ca\") pod \"maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67\" (UID: \"55f8496c-eb71-403e-a7bb-2c2da6561d3f\") " pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"
Jul 02 23:40:04.289333 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.289230    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55f8496c-eb71-403e-a7bb-2c2da6561d3f-maas-api-tls\") pod \"maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67\" (UID: \"55f8496c-eb71-403e-a7bb-2c2da6561d3f\") " pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"
Jul 02 23:40:04.390487 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.390449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55f8496c-eb71-403e-a7bb-2c2da6561d3f-maas-api-tls\") pod \"maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67\" (UID: \"55f8496c-eb71-403e-a7bb-2c2da6561d3f\") " pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"
Jul 02 23:40:04.390661 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.390516    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8l5w\" (UniqueName: \"kubernetes.io/projected/55f8496c-eb71-403e-a7bb-2c2da6561d3f-kube-api-access-k8l5w\") pod \"maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67\" (UID: \"55f8496c-eb71-403e-a7bb-2c2da6561d3f\") " pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"
Jul 02 23:40:04.390661 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.390555    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55f8496c-eb71-403e-a7bb-2c2da6561d3f-openshift-service-ca\") pod \"maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67\" (UID: \"55f8496c-eb71-403e-a7bb-2c2da6561d3f\") " pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"
Jul 02 23:40:04.390661 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:40:04.390618    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-6c2ab8-serving-cert: secret "maas-api-e2e-api-b-6c2ab8-serving-cert" not found
Jul 02 23:40:04.390765 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:40:04.390716    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55f8496c-eb71-403e-a7bb-2c2da6561d3f-maas-api-tls podName:55f8496c-eb71-403e-a7bb-2c2da6561d3f nodeName:}" failed. No retries permitted until 2026-07-02 23:40:04.890697183 +0000 UTC m=+1967.854130510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/55f8496c-eb71-403e-a7bb-2c2da6561d3f-maas-api-tls") pod "maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67" (UID: "55f8496c-eb71-403e-a7bb-2c2da6561d3f") : secret "maas-api-e2e-api-b-6c2ab8-serving-cert" not found
Jul 02 23:40:04.391309 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.391292    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55f8496c-eb71-403e-a7bb-2c2da6561d3f-openshift-service-ca\") pod \"maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67\" (UID: \"55f8496c-eb71-403e-a7bb-2c2da6561d3f\") " pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"
Jul 02 23:40:04.398802 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.398779    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8l5w\" (UniqueName: \"kubernetes.io/projected/55f8496c-eb71-403e-a7bb-2c2da6561d3f-kube-api-access-k8l5w\") pod \"maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67\" (UID: \"55f8496c-eb71-403e-a7bb-2c2da6561d3f\") " pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"
Jul 02 23:40:04.498415 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.498323    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:04.729548 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.729495    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:04.830263 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.830225    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:04.895495 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.895460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55f8496c-eb71-403e-a7bb-2c2da6561d3f-maas-api-tls\") pod \"maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67\" (UID: \"55f8496c-eb71-403e-a7bb-2c2da6561d3f\") " pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"
Jul 02 23:40:04.898037 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:04.898009    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55f8496c-eb71-403e-a7bb-2c2da6561d3f-maas-api-tls\") pod \"maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67\" (UID: \"55f8496c-eb71-403e-a7bb-2c2da6561d3f\") " pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"
Jul 02 23:40:05.071757 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:05.071720    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"
Jul 02 23:40:05.217244 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:05.217177    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"]
Jul 02 23:40:05.219613 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:40:05.219585    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55f8496c_eb71_403e_a7bb_2c2da6561d3f.slice/crio-d8733418228ed94946c491f864eb57b31695541b3e99826636cc4b876bfc8546 WatchSource:0}: Error finding container d8733418228ed94946c491f864eb57b31695541b3e99826636cc4b876bfc8546: Status 404 returned error can't find the container with id d8733418228ed94946c491f864eb57b31695541b3e99826636cc4b876bfc8546
Jul 02 23:40:05.671069 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:05.671036    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67" event={"ID":"55f8496c-eb71-403e-a7bb-2c2da6561d3f","Type":"ContainerStarted","Data":"d8733418228ed94946c491f864eb57b31695541b3e99826636cc4b876bfc8546"}
Jul 02 23:40:06.677087 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:06.677043    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67" event={"ID":"55f8496c-eb71-403e-a7bb-2c2da6561d3f","Type":"ContainerStarted","Data":"739e97dec769f868fb160bd73c8d982a03b168829628c2719ffd4ce5d8d287ff"}
Jul 02 23:40:06.677467 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:06.677196    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"
Jul 02 23:40:06.692984 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:06.692929    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67" podStartSLOduration=2.297552959 podStartE2EDuration="2.692912579s" totalImagesPullingTime="395.35962ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:40:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:40:06.690671132 +0000 UTC m=+1969.654104465" watchObservedRunningTime="2026-07-02 23:40:06.692912579 +0000 UTC m=+1969.656345911"
Jul 02 23:40:08.346341 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:08.346248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:12.686686 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:12.686655    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"
Jul 02 23:40:14.294002 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:14.293966    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:16.369739 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:16.369697    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:16.752055 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:16.751972    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:16.871102 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:16.871072    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:16.971224 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:16.971172    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:17.112323 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:17.112293    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:22.345691 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:22.345653    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:22.413390 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:22.413360    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:22.596299 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:22.596220    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:22.813966 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:22.813934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:22.963009 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:22.962930    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:23.355373 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:23.355332    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:23.452761 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:23.452724    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:23.593140 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:23.593107    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"]
Jul 02 23:40:23.593389 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:23.593361    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67" podUID="55f8496c-eb71-403e-a7bb-2c2da6561d3f" containerName="maas-api" containerID="cri-o://739e97dec769f868fb160bd73c8d982a03b168829628c2719ffd4ce5d8d287ff" gracePeriod=30
Jul 02 23:40:23.623867 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:23.623834    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:23.756567 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:23.756530    2581 generic.go:356] "Generic (PLEG): container finished" podID="55f8496c-eb71-403e-a7bb-2c2da6561d3f" containerID="739e97dec769f868fb160bd73c8d982a03b168829628c2719ffd4ce5d8d287ff" exitCode=0
Jul 02 23:40:23.756789 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:23.756610    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67" event={"ID":"55f8496c-eb71-403e-a7bb-2c2da6561d3f","Type":"ContainerDied","Data":"739e97dec769f868fb160bd73c8d982a03b168829628c2719ffd4ce5d8d287ff"}
Jul 02 23:40:23.845398 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:23.845372    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"
Jul 02 23:40:23.968401 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:23.968306    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55f8496c-eb71-403e-a7bb-2c2da6561d3f-openshift-service-ca\") pod \"55f8496c-eb71-403e-a7bb-2c2da6561d3f\" (UID: \"55f8496c-eb71-403e-a7bb-2c2da6561d3f\") "
Jul 02 23:40:23.968401 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:23.968400    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55f8496c-eb71-403e-a7bb-2c2da6561d3f-maas-api-tls\") pod \"55f8496c-eb71-403e-a7bb-2c2da6561d3f\" (UID: \"55f8496c-eb71-403e-a7bb-2c2da6561d3f\") "
Jul 02 23:40:23.968641 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:23.968435    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8l5w\" (UniqueName: \"kubernetes.io/projected/55f8496c-eb71-403e-a7bb-2c2da6561d3f-kube-api-access-k8l5w\") pod \"55f8496c-eb71-403e-a7bb-2c2da6561d3f\" (UID: \"55f8496c-eb71-403e-a7bb-2c2da6561d3f\") "
Jul 02 23:40:23.968752 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:23.968728    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55f8496c-eb71-403e-a7bb-2c2da6561d3f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "55f8496c-eb71-403e-a7bb-2c2da6561d3f" (UID: "55f8496c-eb71-403e-a7bb-2c2da6561d3f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:40:23.970697 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:23.970668    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55f8496c-eb71-403e-a7bb-2c2da6561d3f-kube-api-access-k8l5w" (OuterVolumeSpecName: "kube-api-access-k8l5w") pod "55f8496c-eb71-403e-a7bb-2c2da6561d3f" (UID: "55f8496c-eb71-403e-a7bb-2c2da6561d3f"). InnerVolumeSpecName "kube-api-access-k8l5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:40:23.970798 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:23.970782    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55f8496c-eb71-403e-a7bb-2c2da6561d3f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "55f8496c-eb71-403e-a7bb-2c2da6561d3f" (UID: "55f8496c-eb71-403e-a7bb-2c2da6561d3f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:40:24.069106 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:24.069070    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55f8496c-eb71-403e-a7bb-2c2da6561d3f-openshift-service-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:40:24.069106 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:24.069097    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55f8496c-eb71-403e-a7bb-2c2da6561d3f-maas-api-tls\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:40:24.069106 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:24.069106    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8l5w\" (UniqueName: \"kubernetes.io/projected/55f8496c-eb71-403e-a7bb-2c2da6561d3f-kube-api-access-k8l5w\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:40:24.763205 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:24.763109    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67" event={"ID":"55f8496c-eb71-403e-a7bb-2c2da6561d3f","Type":"ContainerDied","Data":"d8733418228ed94946c491f864eb57b31695541b3e99826636cc4b876bfc8546"}
Jul 02 23:40:24.763205 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:24.763164    2581 scope.go:117] "RemoveContainer" containerID="739e97dec769f868fb160bd73c8d982a03b168829628c2719ffd4ce5d8d287ff"
Jul 02 23:40:24.763205 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:24.763123    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"
Jul 02 23:40:24.783928 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:24.783903    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"]
Jul 02 23:40:24.787438 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:24.787418    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-6c2ab8-6f7c97c995-zbq67"]
Jul 02 23:40:25.274088 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:25.274049    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:25.326971 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:25.326939    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:25.577679 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:25.572891    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55f8496c-eb71-403e-a7bb-2c2da6561d3f" path="/var/lib/kubelet/pods/55f8496c-eb71-403e-a7bb-2c2da6561d3f/volumes"
Jul 02 23:40:29.034393 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:29.034356    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:29.096509 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:29.096470    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:29.287072 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:29.286979    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:29.499372 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:29.499341    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:29.833102 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:29.833071    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:30.141509 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:30.141429    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:30.483371 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:30.483270    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:33.042306 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:33.042236    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:33.121978 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:33.121946    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:33.185605 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:33.185571    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:33.304800 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:33.304705    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:33.593169 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:33.593092    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:33.692435 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:33.692403    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:37.545088 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:37.545058    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:37.865205 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:37.865125    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:38.160640 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:38.160547    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:38.291991 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:38.291959    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:41.110341 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.110308    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:41.207454 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.207407    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:41.399091 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.399012    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"]
Jul 02 23:40:41.399502 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.399460    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55f8496c-eb71-403e-a7bb-2c2da6561d3f" containerName="maas-api"
Jul 02 23:40:41.399502 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.399481    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="55f8496c-eb71-403e-a7bb-2c2da6561d3f" containerName="maas-api"
Jul 02 23:40:41.399648 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.399598    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="55f8496c-eb71-403e-a7bb-2c2da6561d3f" containerName="maas-api"
Jul 02 23:40:41.403027 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.403004    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"
Jul 02 23:40:41.405126 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.405104    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-f1cae1-serving-cert\""
Jul 02 23:40:41.418441 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.418414    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"]
Jul 02 23:40:41.449101 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.449064    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:41.530712 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.530676    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-maas-api-tls\") pod \"maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r\" (UID: \"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4\") " pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"
Jul 02 23:40:41.530919 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.530766    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r\" (UID: \"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4\") " pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"
Jul 02 23:40:41.530919 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.530791    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56psc\" (UniqueName: \"kubernetes.io/projected/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-kube-api-access-56psc\") pod \"maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r\" (UID: \"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4\") " pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"
Jul 02 23:40:41.631258 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.631232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r\" (UID: \"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4\") " pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"
Jul 02 23:40:41.631472 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.631286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56psc\" (UniqueName: \"kubernetes.io/projected/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-kube-api-access-56psc\") pod \"maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r\" (UID: \"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4\") " pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"
Jul 02 23:40:41.631472 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.631362    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-maas-api-tls\") pod \"maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r\" (UID: \"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4\") " pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"
Jul 02 23:40:41.631606 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:40:41.631534    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-f1cae1-serving-cert: secret "maas-api-e2e-shared-b-f1cae1-serving-cert" not found
Jul 02 23:40:41.631673 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:40:41.631624    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-maas-api-tls podName:b86e2078-a2e1-4bd4-bdad-6cad970fd8f4 nodeName:}" failed. No retries permitted until 2026-07-02 23:40:42.131591294 +0000 UTC m=+2005.095024605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-maas-api-tls") pod "maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r" (UID: "b86e2078-a2e1-4bd4-bdad-6cad970fd8f4") : secret "maas-api-e2e-shared-b-f1cae1-serving-cert" not found
Jul 02 23:40:41.632162 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.632137    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r\" (UID: \"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4\") " pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"
Jul 02 23:40:41.648967 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.648939    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56psc\" (UniqueName: \"kubernetes.io/projected/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-kube-api-access-56psc\") pod \"maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r\" (UID: \"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4\") " pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"
Jul 02 23:40:41.719998 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.719898    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:41.996357 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:41.996270    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:42.096246 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:42.096215    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:42.135429 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:42.135400    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-maas-api-tls\") pod \"maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r\" (UID: \"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4\") " pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"
Jul 02 23:40:42.137939 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:42.137914    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-maas-api-tls\") pod \"maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r\" (UID: \"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4\") " pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"
Jul 02 23:40:42.313811 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:42.313776    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"
Jul 02 23:40:42.455286 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:42.455249    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"]
Jul 02 23:40:42.458186 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:40:42.458162    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb86e2078_a2e1_4bd4_bdad_6cad970fd8f4.slice/crio-25012985f1116c060b15f59c02e7459a38c0074bb00b53ca5edefe09dc097585 WatchSource:0}: Error finding container 25012985f1116c060b15f59c02e7459a38c0074bb00b53ca5edefe09dc097585: Status 404 returned error can't find the container with id 25012985f1116c060b15f59c02e7459a38c0074bb00b53ca5edefe09dc097585
Jul 02 23:40:42.844667 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:42.844637    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r" event={"ID":"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4","Type":"ContainerStarted","Data":"cf32d8c7936e8e2cfb129ea93e9603bdc224acd29c4b56f362ba528f87b412ee"}
Jul 02 23:40:42.844798 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:42.844690    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r" event={"ID":"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4","Type":"ContainerStarted","Data":"25012985f1116c060b15f59c02e7459a38c0074bb00b53ca5edefe09dc097585"}
Jul 02 23:40:42.844798 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:42.844761    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"
Jul 02 23:40:42.859551 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:42.859501    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r" podStartSLOduration=1.569330888 podStartE2EDuration="1.859484245s" totalImagesPullingTime="290.153357ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 23:40:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:40:42.85836859 +0000 UTC m=+2005.821801925" watchObservedRunningTime="2026-07-02 23:40:42.859484245 +0000 UTC m=+2005.822917627"
Jul 02 23:40:45.604099 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:45.604070    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:48.855357 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:48.855328    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"
Jul 02 23:40:55.086361 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:55.086323    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:40:55.187213 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:40:55.187180    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:03.495336 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:41:03.495301    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:03.595618 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:41:03.595587    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:41:54.133093 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:41:54.133059    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:40.781376 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:40.781334    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:50.363454 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:50.363397    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:50.764347 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:50.764251    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:50.869376 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:50.869333    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:50.970839 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:50.970788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:51.101939 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:51.101907    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:56.330513 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:56.330475    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:56.401847 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:56.401802    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:56.595280 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:56.595190    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:56.813024 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:56.812993    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:57.057976 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:57.057934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:57.409659 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:57.409564    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:57.510797 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:57.510758    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:57.563839 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:57.563805    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:57.638215 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:57.638176    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"]
Jul 02 23:43:57.638721 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:57.638686    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r" podUID="b86e2078-a2e1-4bd4-bdad-6cad970fd8f4" containerName="maas-api" containerID="cri-o://cf32d8c7936e8e2cfb129ea93e9603bdc224acd29c4b56f362ba528f87b412ee" gracePeriod=30
Jul 02 23:43:57.668261 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:57.668190    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:43:57.891815 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:57.891786    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"
Jul 02 23:43:57.938147 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:57.938063    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-openshift-service-ca\") pod \"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4\" (UID: \"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4\") "
Jul 02 23:43:57.938304 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:57.938198    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-maas-api-tls\") pod \"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4\" (UID: \"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4\") "
Jul 02 23:43:57.938304 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:57.938264    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56psc\" (UniqueName: \"kubernetes.io/projected/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-kube-api-access-56psc\") pod \"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4\" (UID: \"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4\") "
Jul 02 23:43:57.938488 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:57.938466    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b86e2078-a2e1-4bd4-bdad-6cad970fd8f4" (UID: "b86e2078-a2e1-4bd4-bdad-6cad970fd8f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 23:43:57.938568 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:57.938549    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-openshift-service-ca\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:43:57.940413 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:57.940386    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-kube-api-access-56psc" (OuterVolumeSpecName: "kube-api-access-56psc") pod "b86e2078-a2e1-4bd4-bdad-6cad970fd8f4" (UID: "b86e2078-a2e1-4bd4-bdad-6cad970fd8f4"). InnerVolumeSpecName "kube-api-access-56psc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 23:43:57.940513 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:57.940419    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b86e2078-a2e1-4bd4-bdad-6cad970fd8f4" (UID: "b86e2078-a2e1-4bd4-bdad-6cad970fd8f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 23:43:58.039114 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:58.039083    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-maas-api-tls\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:43:58.039114 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:58.039116    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56psc\" (UniqueName: \"kubernetes.io/projected/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4-kube-api-access-56psc\") on node \"ip-10-0-141-220.ec2.internal\" DevicePath \"\""
Jul 02 23:43:58.745708 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:58.745669    2581 generic.go:356] "Generic (PLEG): container finished" podID="b86e2078-a2e1-4bd4-bdad-6cad970fd8f4" containerID="cf32d8c7936e8e2cfb129ea93e9603bdc224acd29c4b56f362ba528f87b412ee" exitCode=0
Jul 02 23:43:58.746187 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:58.745720    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"
Jul 02 23:43:58.746187 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:58.745752    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r" event={"ID":"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4","Type":"ContainerDied","Data":"cf32d8c7936e8e2cfb129ea93e9603bdc224acd29c4b56f362ba528f87b412ee"}
Jul 02 23:43:58.746187 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:58.745797    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r" event={"ID":"b86e2078-a2e1-4bd4-bdad-6cad970fd8f4","Type":"ContainerDied","Data":"25012985f1116c060b15f59c02e7459a38c0074bb00b53ca5edefe09dc097585"}
Jul 02 23:43:58.746187 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:58.745819    2581 scope.go:117] "RemoveContainer" containerID="cf32d8c7936e8e2cfb129ea93e9603bdc224acd29c4b56f362ba528f87b412ee"
Jul 02 23:43:58.755317 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:58.755290    2581 scope.go:117] "RemoveContainer" containerID="cf32d8c7936e8e2cfb129ea93e9603bdc224acd29c4b56f362ba528f87b412ee"
Jul 02 23:43:58.755581 ip-10-0-141-220 kubenswrapper[2581]: E0702 23:43:58.755558    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf32d8c7936e8e2cfb129ea93e9603bdc224acd29c4b56f362ba528f87b412ee\": container with ID starting with cf32d8c7936e8e2cfb129ea93e9603bdc224acd29c4b56f362ba528f87b412ee not found: ID does not exist" containerID="cf32d8c7936e8e2cfb129ea93e9603bdc224acd29c4b56f362ba528f87b412ee"
Jul 02 23:43:58.755650 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:58.755590    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf32d8c7936e8e2cfb129ea93e9603bdc224acd29c4b56f362ba528f87b412ee"} err="failed to get container status \"cf32d8c7936e8e2cfb129ea93e9603bdc224acd29c4b56f362ba528f87b412ee\": rpc error: code = NotFound desc = could not find container \"cf32d8c7936e8e2cfb129ea93e9603bdc224acd29c4b56f362ba528f87b412ee\": container with ID starting with cf32d8c7936e8e2cfb129ea93e9603bdc224acd29c4b56f362ba528f87b412ee not found: ID does not exist"
Jul 02 23:43:58.767077 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:58.767050    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"]
Jul 02 23:43:58.771139 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:58.771117    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f1cae1-6c69b4d6f-hgt8r"]
Jul 02 23:43:59.571448 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:43:59.571412    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b86e2078-a2e1-4bd4-bdad-6cad970fd8f4" path="/var/lib/kubelet/pods/b86e2078-a2e1-4bd4-bdad-6cad970fd8f4/volumes"
Jul 02 23:44:03.161890 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:03.161843    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:04.434325 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:04.434295    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:08.858703 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:08.858675    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-58b7999567-25htw_2f421f72-9544-476e-bfcf-1b8931a2c51f/maas-api/0.log"
Jul 02 23:44:09.079429 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:09.079398    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54f69f846c-hpsgv_ad953538-ed65-4b38-8bf8-18d01bfcf60f/manager/0.log"
Jul 02 23:44:09.654606 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:09.654576    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fb7747bfc-xsmq2_3a8eff66-6136-4c0d-a860-13d9f48f6a3c/copy-manifests/0.log"
Jul 02 23:44:09.666787 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:09.666755    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fb7747bfc-xsmq2_3a8eff66-6136-4c0d-a860-13d9f48f6a3c/manager/0.log"
Jul 02 23:44:09.783540 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:09.783510    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-q8mt2_dc5980eb-8a9f-4762-a731-8a3d2d7c2d14/postgres/0.log"
Jul 02 23:44:11.375077 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:11.375046    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-s994r_fc900e75-1809-4c53-bfca-c0512739150b/kuadrant-console-plugin/0.log"
Jul 02 23:44:11.613421 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:11.613390    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dvq5v_903fdf41-bdd2-4809-8095-52ed79ef900f/manager/0.log"
Jul 02 23:44:12.526444 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:12.526418    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55fc97dffd-nfqhr_477691e0-93d4-4709-b361-b4313cb14ccc/kube-auth-proxy/0.log"
Jul 02 23:44:12.753552 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:12.753510    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rm8z9_4bb751ee-b9c1-4218-a907-d48742ad3838/payload-pre-processing/0.log"
Jul 02 23:44:12.865072 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:12.864997    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zc8qq_4aacec4b-e326-4fca-8dd7-25406abbe385/payload-processing/0.log"
Jul 02 23:44:13.308890 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:13.308830    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-lf46v_34d1b628-ad0d-40f0-b373-cafafc7d5f1f/main/0.log"
Jul 02 23:44:18.268326 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:18.268269    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:18.327562 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:18.327532    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log" limit=1024
Jul 02 23:44:20.896286 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:20.896253    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4rpk9_dee8ea60-68c5-4775-adbe-0f7a82fca7a3/global-pull-secret-syncer/0.log"
Jul 02 23:44:21.017991 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:21.017957    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bjnvr_3438e6dd-0c4b-4a90-8cb0-53a76863f603/konnectivity-agent/0.log"
Jul 02 23:44:21.142335 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:21.142303    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-220.ec2.internal_c289d765ebaf73084c7d6f9e7be86f96/haproxy/0.log"
Jul 02 23:44:26.187130 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:26.187050    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-s994r_fc900e75-1809-4c53-bfca-c0512739150b/kuadrant-console-plugin/0.log"
Jul 02 23:44:26.343748 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:26.343711    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-dvq5v_903fdf41-bdd2-4809-8095-52ed79ef900f/manager/0.log"
Jul 02 23:44:28.124773 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.124746    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-666cf66bbd-9ljk9_477e0b8b-d5ad-40a3-9418-68316bd6e209/metrics-server/0.log"
Jul 02 23:44:28.153241 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.153207    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-2gwxr_0ff89c3b-ea48-4ced-9381-787ef22e0080/monitoring-plugin/0.log"
Jul 02 23:44:28.190596 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.190570    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7vvdj_ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22/node-exporter/0.log"
Jul 02 23:44:28.214021 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.213987    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7vvdj_ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22/kube-rbac-proxy/0.log"
Jul 02 23:44:28.254348 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.254281    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7vvdj_ae0b3cd6-7487-4bf9-89d4-ae94e9c7dd22/init-textfile/0.log"
Jul 02 23:44:28.514983 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.514891    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b109c42-9ee0-44d7-9504-c6da977deb8f/prometheus/0.log"
Jul 02 23:44:28.536035 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.535998    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b109c42-9ee0-44d7-9504-c6da977deb8f/config-reloader/0.log"
Jul 02 23:44:28.556990 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.556968    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b109c42-9ee0-44d7-9504-c6da977deb8f/thanos-sidecar/0.log"
Jul 02 23:44:28.578703 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.578685    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b109c42-9ee0-44d7-9504-c6da977deb8f/kube-rbac-proxy-web/0.log"
Jul 02 23:44:28.601584 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.601550    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b109c42-9ee0-44d7-9504-c6da977deb8f/kube-rbac-proxy/0.log"
Jul 02 23:44:28.620693 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.620672    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b109c42-9ee0-44d7-9504-c6da977deb8f/kube-rbac-proxy-thanos/0.log"
Jul 02 23:44:28.640922 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.640901    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0b109c42-9ee0-44d7-9504-c6da977deb8f/init-config-reloader/0.log"
Jul 02 23:44:28.669579 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.669551    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-vj4wc_9a5b8441-6882-4ff0-81dc-2b80c5837fc8/prometheus-operator/0.log"
Jul 02 23:44:28.687680 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.687658    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-vj4wc_9a5b8441-6882-4ff0-81dc-2b80c5837fc8/kube-rbac-proxy/0.log"
Jul 02 23:44:28.709790 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.709760    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-fx45l_8d02e4ea-3ccd-407e-aae0-679bed970485/prometheus-operator-admission-webhook/0.log"
Jul 02 23:44:28.837631 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.837603    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f78f7496-p4t8t_49c85672-bf50-48b5-8740-1d845a6c1735/thanos-query/0.log"
Jul 02 23:44:28.856376 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.856355    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f78f7496-p4t8t_49c85672-bf50-48b5-8740-1d845a6c1735/kube-rbac-proxy-web/0.log"
Jul 02 23:44:28.878769 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.878744    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f78f7496-p4t8t_49c85672-bf50-48b5-8740-1d845a6c1735/kube-rbac-proxy/0.log"
Jul 02 23:44:28.897557 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.897530    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f78f7496-p4t8t_49c85672-bf50-48b5-8740-1d845a6c1735/prom-label-proxy/0.log"
Jul 02 23:44:28.917302 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.917267    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f78f7496-p4t8t_49c85672-bf50-48b5-8740-1d845a6c1735/kube-rbac-proxy-rules/0.log"
Jul 02 23:44:28.942928 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:28.942896    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66f78f7496-p4t8t_49c85672-bf50-48b5-8740-1d845a6c1735/kube-rbac-proxy-metrics/0.log"
Jul 02 23:44:31.340084 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.340056    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d7f6b8d9c-l5tbx_1e8ae975-a05d-47eb-b3f0-61a92b1d3c6a/console/0.log"
Jul 02 23:44:31.369411 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.369386    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"]
Jul 02 23:44:31.369925 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.369906    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b86e2078-a2e1-4bd4-bdad-6cad970fd8f4" containerName="maas-api"
Jul 02 23:44:31.370030 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.369928    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b86e2078-a2e1-4bd4-bdad-6cad970fd8f4" containerName="maas-api"
Jul 02 23:44:31.370030 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.370024    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b86e2078-a2e1-4bd4-bdad-6cad970fd8f4" containerName="maas-api"
Jul 02 23:44:31.373840 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.373823    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:31.375925 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.375902    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rbq7r\"/\"openshift-service-ca.crt\""
Jul 02 23:44:31.376894 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.376851    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-b9fdp_2963eb95-d18d-4e55-ab13-a546e256e740/download-server/0.log"
Jul 02 23:44:31.377047 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.377031    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rbq7r\"/\"kube-root-ca.crt\""
Jul 02 23:44:31.377283 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.377269    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rbq7r\"/\"default-dockercfg-jhnrh\""
Jul 02 23:44:31.379099 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.379075    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"]
Jul 02 23:44:31.547867 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.547830    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395-podres\") pod \"perf-node-gather-daemonset-vhrfc\" (UID: \"5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:31.548069 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.547902    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395-sys\") pod \"perf-node-gather-daemonset-vhrfc\" (UID: \"5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:31.548069 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.547927    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395-lib-modules\") pod \"perf-node-gather-daemonset-vhrfc\" (UID: \"5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:31.548069 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.548052    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395-proc\") pod \"perf-node-gather-daemonset-vhrfc\" (UID: \"5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:31.548222 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.548094    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlf5r\" (UniqueName: \"kubernetes.io/projected/5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395-kube-api-access-vlf5r\") pod \"perf-node-gather-daemonset-vhrfc\" (UID: \"5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:31.648949 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.648824    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395-proc\") pod \"perf-node-gather-daemonset-vhrfc\" (UID: \"5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:31.648949 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.648865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlf5r\" (UniqueName: \"kubernetes.io/projected/5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395-kube-api-access-vlf5r\") pod \"perf-node-gather-daemonset-vhrfc\" (UID: \"5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:31.648949 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.648923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395-podres\") pod \"perf-node-gather-daemonset-vhrfc\" (UID: \"5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:31.648949 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.648946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395-sys\") pod \"perf-node-gather-daemonset-vhrfc\" (UID: \"5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:31.649214 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.648964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395-lib-modules\") pod \"perf-node-gather-daemonset-vhrfc\" (UID: \"5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:31.649214 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.648977    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395-proc\") pod \"perf-node-gather-daemonset-vhrfc\" (UID: \"5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:31.649214 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.649069    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395-sys\") pod \"perf-node-gather-daemonset-vhrfc\" (UID: \"5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:31.649214 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.649078    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395-lib-modules\") pod \"perf-node-gather-daemonset-vhrfc\" (UID: \"5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:31.649214 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.649083    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395-podres\") pod \"perf-node-gather-daemonset-vhrfc\" (UID: \"5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:31.664142 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.664113    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlf5r\" (UniqueName: \"kubernetes.io/projected/5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395-kube-api-access-vlf5r\") pod \"perf-node-gather-daemonset-vhrfc\" (UID: \"5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395\") " pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:31.685735 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.685698    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:31.824369 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.824220    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"]
Jul 02 23:44:31.826708 ip-10-0-141-220 kubenswrapper[2581]: W0702 23:44:31.826677    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5d1cc2fd_e47c_4e6b_94d4_bcaaca31e395.slice/crio-f919c4d2bfeae1bf446293bddfff6638cf80468bda04c46f2c30439d5e47c873 WatchSource:0}: Error finding container f919c4d2bfeae1bf446293bddfff6638cf80468bda04c46f2c30439d5e47c873: Status 404 returned error can't find the container with id f919c4d2bfeae1bf446293bddfff6638cf80468bda04c46f2c30439d5e47c873
Jul 02 23:44:31.895351 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:31.895313    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc" event={"ID":"5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395","Type":"ContainerStarted","Data":"f919c4d2bfeae1bf446293bddfff6638cf80468bda04c46f2c30439d5e47c873"}
Jul 02 23:44:32.901841 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:32.901802    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc" event={"ID":"5d1cc2fd-e47c-4e6b-94d4-bcaaca31e395","Type":"ContainerStarted","Data":"24331c36c399533a10dce1ac607cb75a7b8603d3505a8891a4da59fa5aa4659e"}
Jul 02 23:44:32.902293 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:32.901935    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:32.915968 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:32.915923    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc" podStartSLOduration=1.915908443 podStartE2EDuration="1.915908443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 23:44:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 23:44:32.914541183 +0000 UTC m=+2235.877974518" watchObservedRunningTime="2026-07-02 23:44:32.915908443 +0000 UTC m=+2235.879341776"
Jul 02 23:44:33.188685 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:33.188593    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zc557_634ade03-7ded-4891-87bf-e73daf8023b5/dns/0.log"
Jul 02 23:44:33.207120 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:33.207090    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zc557_634ade03-7ded-4891-87bf-e73daf8023b5/kube-rbac-proxy/0.log"
Jul 02 23:44:33.248593 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:33.248567    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fdp9l_d909661b-ea6e-417b-8b1c-a0260bf28058/dns-node-resolver/0.log"
Jul 02 23:44:33.769061 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:33.769036    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5c67b478c5-djn42_d8e2c5eb-30b6-4213-aa3c-8db08d7ce665/registry/0.log"
Jul 02 23:44:33.810788 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:33.810750    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jxk2s_25ecfdbf-2d20-4557-831c-365fac161de9/node-ca/0.log"
Jul 02 23:44:34.855370 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:34.855329    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55fc97dffd-nfqhr_477691e0-93d4-4709-b361-b4313cb14ccc/kube-auth-proxy/0.log"
Jul 02 23:44:34.951208 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:34.951178    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rm8z9_4bb751ee-b9c1-4218-a907-d48742ad3838/payload-pre-processing/0.log"
Jul 02 23:44:34.993350 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:34.993317    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zc8qq_4aacec4b-e326-4fca-8dd7-25406abbe385/payload-processing/0.log"
Jul 02 23:44:35.664037 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:35.664006    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7r4br_a467ba7c-cf83-46e6-94fc-07bdd59d653e/serve-healthcheck-canary/0.log"
Jul 02 23:44:36.206004 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:36.205963    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4gc2w_3320abb0-4218-4bcb-a023-1d267b06df39/kube-rbac-proxy/0.log"
Jul 02 23:44:36.243891 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:36.243859    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4gc2w_3320abb0-4218-4bcb-a023-1d267b06df39/exporter/0.log"
Jul 02 23:44:36.284577 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:36.284552    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4gc2w_3320abb0-4218-4bcb-a023-1d267b06df39/extractor/0.log"
Jul 02 23:44:38.584960 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:38.584856    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-58b7999567-25htw_2f421f72-9544-476e-bfcf-1b8931a2c51f/maas-api/0.log"
Jul 02 23:44:38.682925 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:38.682888    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-54f69f846c-hpsgv_ad953538-ed65-4b38-8bf8-18d01bfcf60f/manager/0.log"
Jul 02 23:44:38.918888 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:38.918786    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rbq7r/perf-node-gather-daemonset-vhrfc"
Jul 02 23:44:38.924529 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:38.924497    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fb7747bfc-xsmq2_3a8eff66-6136-4c0d-a860-13d9f48f6a3c/manager/0.log"
Jul 02 23:44:38.942020 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:38.941983    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fb7747bfc-xsmq2_3a8eff66-6136-4c0d-a860-13d9f48f6a3c/copy-manifests/0.log"
Jul 02 23:44:38.964800 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:38.964775    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-q8mt2_dc5980eb-8a9f-4762-a731-8a3d2d7c2d14/postgres/0.log"
Jul 02 23:44:40.334289 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:40.334248    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-675f46f85c-nmc4b_2ff7f3fe-3282-446c-b7b1-0978b1fe19a1/manager/0.log"
Jul 02 23:44:41.618851 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:41.618818    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55fc97dffd-nfqhr_477691e0-93d4-4709-b361-b4313cb14ccc/kube-auth-proxy/0.log"
Jul 02 23:44:41.695409 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:41.695376    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rm8z9_4bb751ee-b9c1-4218-a907-d48742ad3838/payload-pre-processing/0.log"
Jul 02 23:44:41.727894 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:41.727847    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zc8qq_4aacec4b-e326-4fca-8dd7-25406abbe385/payload-processing/0.log"
Jul 02 23:44:43.105483 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:43.105398    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55fc97dffd-nfqhr_477691e0-93d4-4709-b361-b4313cb14ccc/kube-auth-proxy/0.log"
Jul 02 23:44:43.181095 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:43.181065    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rm8z9_4bb751ee-b9c1-4218-a907-d48742ad3838/payload-pre-processing/0.log"
Jul 02 23:44:43.217643 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:43.217604    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-zc8qq_4aacec4b-e326-4fca-8dd7-25406abbe385/payload-processing/0.log"
Jul 02 23:44:46.945735 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:46.945705    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hdhkd_e0451a6f-879b-490d-a413-df7e1e20a6b4/kube-multus-additional-cni-plugins/0.log"
Jul 02 23:44:46.964818 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:46.964780    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hdhkd_e0451a6f-879b-490d-a413-df7e1e20a6b4/egress-router-binary-copy/0.log"
Jul 02 23:44:46.985332 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:46.985302    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hdhkd_e0451a6f-879b-490d-a413-df7e1e20a6b4/cni-plugins/0.log"
Jul 02 23:44:47.004168 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:47.004140    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hdhkd_e0451a6f-879b-490d-a413-df7e1e20a6b4/bond-cni-plugin/0.log"
Jul 02 23:44:47.023386 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:47.023350    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hdhkd_e0451a6f-879b-490d-a413-df7e1e20a6b4/routeoverride-cni/0.log"
Jul 02 23:44:47.046953 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:47.046922    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hdhkd_e0451a6f-879b-490d-a413-df7e1e20a6b4/whereabouts-cni-bincopy/0.log"
Jul 02 23:44:47.066494 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:47.066458    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hdhkd_e0451a6f-879b-490d-a413-df7e1e20a6b4/whereabouts-cni/0.log"
Jul 02 23:44:47.259713 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:47.259642    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-k9m8v_4e5de9cc-16a7-40ce-b2f8-9ace191c44c9/kube-multus/0.log"
Jul 02 23:44:47.280721 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:47.280690    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-27zv5_9b58b91e-ef2e-4ecd-bfbe-619ba380493f/network-metrics-daemon/0.log"
Jul 02 23:44:47.297442 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:47.297415    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-27zv5_9b58b91e-ef2e-4ecd-bfbe-619ba380493f/kube-rbac-proxy/0.log"
Jul 02 23:44:48.511056 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:48.511030    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pq45t_b99491c3-0d67-483e-91e4-0022e54bbb90/ovn-controller/0.log"
Jul 02 23:44:48.532818 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:48.532792    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pq45t_b99491c3-0d67-483e-91e4-0022e54bbb90/ovn-acl-logging/0.log"
Jul 02 23:44:48.552716 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:48.552693    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pq45t_b99491c3-0d67-483e-91e4-0022e54bbb90/kube-rbac-proxy-node/0.log"
Jul 02 23:44:48.572706 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:48.572681    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pq45t_b99491c3-0d67-483e-91e4-0022e54bbb90/kube-rbac-proxy-ovn-metrics/0.log"
Jul 02 23:44:48.590134 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:48.590105    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pq45t_b99491c3-0d67-483e-91e4-0022e54bbb90/northd/0.log"
Jul 02 23:44:48.607834 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:48.607804    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pq45t_b99491c3-0d67-483e-91e4-0022e54bbb90/nbdb/0.log"
Jul 02 23:44:48.626085 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:48.626055    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pq45t_b99491c3-0d67-483e-91e4-0022e54bbb90/sbdb/0.log"
Jul 02 23:44:48.675672 ip-10-0-141-220 kubenswrapper[2581]: I0702 23:44:48.675647    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pq45t_b99491c3-0d67-483e-91e4-0022e54bbb90/ovnkube-controller/0.log"