Jul 08 15:51:00.464889 ip-10-0-131-108 systemd[1]: Starting Kubernetes Kubelet...
Jul 08 15:51:02.368635 ip-10-0-131-108 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 15:51:02.368635 ip-10-0-131-108 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 08 15:51:02.368635 ip-10-0-131-108 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 15:51:02.368635 ip-10-0-131-108 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 08 15:51:02.368635 ip-10-0-131-108 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 08 15:51:02.369296 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.368641    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 08 15:51:02.372887 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372868    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 15:51:02.372887 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372886    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 15:51:02.372887 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372890    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372893    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372898    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372901    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372905    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372908    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372912    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372915    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372918    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372921    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372924    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372927    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372931    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372934    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372937    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372939    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372944    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372948    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372953    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 15:51:02.372991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372956    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372959    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372962    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372965    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372968    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372971    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372974    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372976    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372979    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372982    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372985    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372987    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372990    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372993    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372996    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.372999    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373002    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373009    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373012    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373015    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 15:51:02.373499 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373017    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373020    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373023    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373025    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373028    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373030    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373033    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373036    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373038    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373041    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373043    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373046    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373049    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373053    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373058    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373062    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373065    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373069    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373072    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 15:51:02.374046 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373076    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373079    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373082    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373085    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373087    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373090    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373093    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373096    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373099    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373101    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373104    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373107    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373110    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373112    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373115    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373120    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373124    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373128    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373130    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373135    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 15:51:02.374570 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373137    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373140    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373143    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373146    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373149    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373152    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373155    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373158    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373160    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373163    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373166    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373169    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373172    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373175    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373177    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373180    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373183    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373186    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373189    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.373999    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 15:51:02.375131 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374008    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374011    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374015    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374018    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374021    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374024    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374027    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374030    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374033    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374036    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374039    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374042    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374045    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374048    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374051    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374054    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374057    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374060    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374063    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374066    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 15:51:02.375644 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374069    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374072    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374075    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374078    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374080    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374083    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374086    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374089    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374092    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374094    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374097    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374100    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374103    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374106    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374108    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374111    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374113    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374117    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374119    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374122    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 15:51:02.376182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374125    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374128    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374131    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374134    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374136    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374139    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374143    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374145    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374148    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374151    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374154    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374158    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374160    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374163    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374168    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374173    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374177    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374181    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374185    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 15:51:02.376707 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374188    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374191    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374193    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374196    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374199    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374202    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374205    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374207    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374210    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374212    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374215    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374222    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374224    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374227    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374230    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374233    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374236    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374239    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374242    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 15:51:02.377200 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374246    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374250    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374253    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374256    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374260    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374263    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374266    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374269    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374272    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374274    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374277    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374280    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374283    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374286    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374288    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374291    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374293    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374296    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374299    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 15:51:02.377696 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374302    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374717    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374725    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374729    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374732    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374737    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374740    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374743    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374745    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374749    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374752    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374755    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374758    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374761    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374763    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374766    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374769    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374772    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374774    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374777    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 15:51:02.378182 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374780    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374783    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374785    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374788    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374791    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374794    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374796    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374800    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374803    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374806    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374809    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374813    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374816    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374818    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374821    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374824    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374827    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374830    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374833    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374836    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 15:51:02.378721 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374838    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374842    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374844    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374847    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374850    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374852    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374855    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374858    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374860    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374863    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374866    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374868    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374871    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374874    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374876    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374879    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374882    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374884    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374887    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374890    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 15:51:02.379260 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374892    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374895    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374898    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374900    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374903    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374905    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374911    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374914    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374917    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374920    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374922    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374925    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374928    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374931    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374934    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374937    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374939    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374942    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374945    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374947    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 15:51:02.379825 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374950    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374953    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374955    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374958    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374961    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374964    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374967    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374969    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374974    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374978    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374981    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374984    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374987    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374990    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374993    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374996    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.374999    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375002    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375006    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 15:51:02.380422 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375008    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375090    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375098    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375105    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375110    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375115    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375119    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375124    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375129    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375132    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375136    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375140    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375144    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375147    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375150    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375154    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375157    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375160    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375163    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375167    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375170    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375174    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375177    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375181    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 08 15:51:02.380932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375185    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375189    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375193    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375197    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375200    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375203    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375206    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375211    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375215    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375219    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375223    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375226    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375229    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375232    2562 flags.go:64] FLAG: --enable-server="true"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375239    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375244    2562 flags.go:64] FLAG: --event-burst="100"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375247    2562 flags.go:64] FLAG: --event-qps="50"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375251    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375255    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375257    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375261    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375264    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375268    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375271    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375274    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 08 15:51:02.381546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375277    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375280    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375283    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375286    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375290    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375293    2562 flags.go:64] FLAG: --feature-gates=""
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375312    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375317    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375321    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375324    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375327    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375331    2562 flags.go:64] FLAG: --help="false"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375334    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-131-108.ec2.internal"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375337    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375342    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375345    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375349    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375353    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375356    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375359    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375362    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375367    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375371    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375375    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 08 15:51:02.382225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375378    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375381    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375384    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375387    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375390    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375393    2562 flags.go:64] FLAG: --lock-file=""
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375396    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375400    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375403    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375409    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375412    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375414    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375417    2562 flags.go:64] FLAG: --logging-format="text"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375420    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375424    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375427    2562 flags.go:64] FLAG: --manifest-url=""
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375430    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375434    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375437    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375442    2562 flags.go:64] FLAG: --max-pods="110"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375445    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375449    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375453    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375457    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375460    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 08 15:51:02.382908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375463    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375466    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375478    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375481    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375486    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375489    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375493    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375498    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375502    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375505    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375508    2562 flags.go:64] FLAG: --port="10250"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375511    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375514    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ddee829195751696"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375518    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375521    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375524    2562 flags.go:64] FLAG: --register-node="true"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375527    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375531    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375534    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375537    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375540    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375544    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375547    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375551    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375554    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 08 15:51:02.383604 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375557    2562 flags.go:64] FLAG: --runonce="false"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375560    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375563    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375566    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375569    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375574    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375577    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375580    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375584    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375586    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375590    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375596    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375599    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375602    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375606    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375609    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375615    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375618    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375621    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375625    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375628    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375631    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375634    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375637    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375640    2562 flags.go:64] FLAG: --v="2"
Jul 08 15:51:02.384248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375645    2562 flags.go:64] FLAG: --version="false"
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375649    2562 flags.go:64] FLAG: --vmodule=""
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375666    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.375670    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375797    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375801    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375805    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375809    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375812    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375816    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375821    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375825    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375830    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375833    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375836    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375839    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375841    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375844    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375849    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 15:51:02.384905 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375851    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375854    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375857    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375860    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375864    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375867    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375870    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375872    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375875    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375878    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375881    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375884    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375886    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375889    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375892    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375894    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375897    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375900    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375903    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375906    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 15:51:02.385398 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375908    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375911    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375914    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375916    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375920    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375926    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375929    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375932    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375935    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375937    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375940    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375944    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375947    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375950    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375953    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375963    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375967    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375970    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375973    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 15:51:02.385956 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375976    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375979    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375981    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375984    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375987    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375989    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375992    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375995    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.375998    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376001    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376004    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376006    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376009    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376012    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376014    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376017    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376020    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376022    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376027    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376030    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 15:51:02.386436 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376032    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376035    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376038    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376040    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376044    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376047    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376050    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376053    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376056    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376059    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376062    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376065    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376068    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376070    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376073    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376076    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376079    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376081    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376084    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376087    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 15:51:02.387117 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376090    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 15:51:02.387710 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376092    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 15:51:02.387710 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376095    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 15:51:02.387710 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376098    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 15:51:02.387710 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.376101    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 15:51:02.387710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.376773    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 15:51:02.387710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.383955    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 08 15:51:02.387710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.383973    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 08 15:51:02.387710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.383990    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 08 15:51:02.387710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.383997    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 08 15:51:02.387710 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384057    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 15:51:02.387710 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384062    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 15:51:02.387710 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384066    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 15:51:02.387710 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384069    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 15:51:02.387710 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384072    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 15:51:02.387710 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384076    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384079    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384082    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384085    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384088    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384091    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384094    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384096    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384100    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384103    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384106    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384108    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384111    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384114    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384117    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384120    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384123    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384125    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384129    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384131    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 15:51:02.388109 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384134    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384137    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384140    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384143    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384147    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384150    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384153    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384156    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384160    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384163    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384165    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384168    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384171    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384174    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384177    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384179    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384182    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384185    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384187    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384190    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 15:51:02.388642 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384193    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384196    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384198    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384201    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384205    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384208    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384211    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384213    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384216    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384219    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384222    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384225    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384227    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384230    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384233    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384236    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384239    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384242    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384245    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 15:51:02.389201 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384248    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384250    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384253    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384256    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384259    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384262    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384265    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384268    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384271    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384274    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384277    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384280    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384284    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384289    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384293    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384297    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384300    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384304    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384307    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 15:51:02.389740 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384310    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 15:51:02.390229 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384313    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 15:51:02.390229 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384316    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 15:51:02.390229 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384319    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 15:51:02.390229 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384322    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 15:51:02.390229 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384325    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 15:51:02.390229 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384328    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 15:51:02.390229 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384331    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 15:51:02.390229 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384334    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 15:51:02.390229 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384336    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 15:51:02.390229 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384340    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 15:51:02.390229 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384343    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 15:51:02.390229 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384346    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 15:51:02.390229 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384349    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 15:51:02.390229 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384352    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 15:51:02.390229 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384356    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 15:51:02.390622 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.384362    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 15:51:02.390622 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384485    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 08 15:51:02.390622 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384491    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 08 15:51:02.390622 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384495    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 08 15:51:02.390622 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384498    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 08 15:51:02.390622 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384501    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 08 15:51:02.390622 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384504    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 08 15:51:02.390622 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384507    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 08 15:51:02.390622 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384511    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 08 15:51:02.390622 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384514    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 08 15:51:02.390622 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384516    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 08 15:51:02.390622 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384519    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 08 15:51:02.390622 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384522    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 08 15:51:02.390622 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384525    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384528    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384531    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384534    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384537    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384539    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384542    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384545    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384547    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384550    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384553    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384555    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384558    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384560    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384563    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384566    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384570    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384573    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384576    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384579    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 08 15:51:02.391044 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384581    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384584    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384587    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384589    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384593    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384596    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384598    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384601    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384604    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384606    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384609    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384612    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384615    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384617    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384628    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384632    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384635    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384637    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384640    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384643    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 08 15:51:02.391800 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384646    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384650    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384668    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384672    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384675    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384678    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384681    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384684    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384687    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384690    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384694    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384696    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384699    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384702    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384705    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384707    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384711    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384713    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384716    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 08 15:51:02.392685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384719    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384722    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384724    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384727    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384730    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384733    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384735    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384738    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384741    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384743    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384746    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384749    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384751    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384754    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384757    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384760    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384763    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384767    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384771    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384774    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 08 15:51:02.393271 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384777    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 08 15:51:02.394081 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384780    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 08 15:51:02.394081 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384783    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 08 15:51:02.394081 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384788    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 08 15:51:02.394081 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384792    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 08 15:51:02.394081 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384795    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 08 15:51:02.394081 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384797    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 08 15:51:02.394081 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:02.384800    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 08 15:51:02.394081 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.384805    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 08 15:51:02.394081 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.384950    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 08 15:51:02.394081 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.387017    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 08 15:51:02.394081 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.388395    2562 server.go:1019] "Starting client certificate rotation"
Jul 08 15:51:02.394081 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.388523    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 15:51:02.394081 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.388563    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 08 15:51:02.394468 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.390801    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 15:51:02.396341 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.396317    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 08 15:51:02.412719 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.412688    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 08 15:51:02.415059 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.415039    2562 log.go:25] "Validated CRI v1 image API"
Jul 08 15:51:02.415953 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.415936    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 08 15:51:02.418696 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.418673    2562 fs.go:135] Filesystem UUIDs: map[4e3786fe-7952-4a6c-907b-f729698bb1b1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 df3afb02-ba10-4e93-94c2-1497dcf9cdae:/dev/nvme0n1p4]
Jul 08 15:51:02.418745 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.418696    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 08 15:51:02.423998 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.423976    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 15:51:02.424629 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.424499    2562 manager.go:216] Machine: {Timestamp:2026-07-08 15:51:02.422696398 +0000 UTC m=+1.833361045 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099193 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2083ffa0511fbc376628400bea0a6f SystemUUID:ec2083ff-a051-1fbc-3766-28400bea0a6f BootID:b90e82bd-80da-4a2a-84bc-461ec1a6a70c Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5b:02:35:b8:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5b:02:35:b8:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:46:fb:04:3f:d7:31 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 08 15:51:02.424629 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.424629    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 08 15:51:02.424796 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.424783    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 08 15:51:02.427905 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.427874    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 08 15:51:02.428085 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.427907    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-108.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 08 15:51:02.428701 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.428690    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 08 15:51:02.428746 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.428704    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 08 15:51:02.428746 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.428712    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 15:51:02.429340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.429329    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 08 15:51:02.430478 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.430467    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 08 15:51:02.433300 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.433284    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 15:51:02.433427 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.433417    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 08 15:51:02.433467 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.433451    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 08 15:51:02.433467 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.433462    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 08 15:51:02.433543 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.433474    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 08 15:51:02.433543 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.433485    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 08 15:51:02.433543 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.433496    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 08 15:51:02.433947 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.433935    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 15:51:02.433995 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.433958    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 08 15:51:02.436345 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.436326    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 08 15:51:02.438130 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.438110    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 08 15:51:02.438258 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.438146    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 08 15:51:02.439684 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.439672    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 08 15:51:02.439738 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.439691    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 08 15:51:02.439738 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.439700    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 08 15:51:02.439738 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.439709    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 08 15:51:02.439738 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.439722    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 08 15:51:02.439738 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.439730    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 08 15:51:02.439738 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.439739    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 08 15:51:02.439963 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.439745    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 08 15:51:02.439963 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.439753    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 08 15:51:02.439963 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.439758    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 08 15:51:02.439963 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.439773    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 08 15:51:02.439963 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.439779    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 08 15:51:02.440622 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.440612    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 08 15:51:02.440622 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.440621    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 08 15:51:02.444700 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:02.444670    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-108.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 08 15:51:02.444700 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.444676    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-108.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 08 15:51:02.444854 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:02.444702    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 08 15:51:02.445463 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.445424    2562 server.go:1268] "Started kubelet"
Jul 08 15:51:02.445738 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.445705    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 08 15:51:02.445866 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.445695    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 08 15:51:02.445923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.445883    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 08 15:51:02.447114 ip-10-0-131-108 systemd[1]: Started Kubernetes Kubelet.
Jul 08 15:51:02.447659 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.447379    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 08 15:51:02.447788 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.447735    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 08 15:51:02.450075 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.450055    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wzrh2"
Jul 08 15:51:02.451829 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:02.450804    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-108.ec2.internal.18c05b5286c7844d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-108.ec2.internal,UID:ip-10-0-131-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-108.ec2.internal,},FirstTimestamp:2026-07-08 15:51:02.445384781 +0000 UTC m=+1.856049428,LastTimestamp:2026-07-08 15:51:02.445384781 +0000 UTC m=+1.856049428,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-108.ec2.internal,}"
Jul 08 15:51:02.452082 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:02.452061    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 08 15:51:02.454860 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.454845    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 08 15:51:02.454919 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.454863    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 08 15:51:02.454985 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:02.454962    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-108.ec2.internal\" not found"
Jul 08 15:51:02.455750 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.455731    2562 factory.go:55] Registering systemd factory
Jul 08 15:51:02.455750 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.455752    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 08 15:51:02.455906 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.455853    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 08 15:51:02.455906 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.455878    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 08 15:51:02.455906 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.455898    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 08 15:51:02.456056 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.456000    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 08 15:51:02.456056 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.456010    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 08 15:51:02.456056 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.456017    2562 factory.go:153] Registering CRI-O factory
Jul 08 15:51:02.456056 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.456029    2562 factory.go:223] Registration of the crio container factory successfully
Jul 08 15:51:02.456232 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.456074    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 08 15:51:02.456232 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.456093    2562 factory.go:103] Registering Raw factory
Jul 08 15:51:02.456232 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.456104    2562 manager.go:1196] Started watching for new ooms in manager
Jul 08 15:51:02.456545 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.456532    2562 manager.go:349] Starting recovery of all containers
Jul 08 15:51:02.457403 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.457371    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wzrh2"
Jul 08 15:51:02.464449 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.464421    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 15:51:02.467439 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.467412    2562 manager.go:354] Recovery completed
Jul 08 15:51:02.468267 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:02.468244    2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-108.ec2.internal\" not found" node="ip-10-0-131-108.ec2.internal"
Jul 08 15:51:02.474634 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.474619    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 15:51:02.476727 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.476702    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 15:51:02.476818 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.476765    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 15:51:02.476818 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.476787    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasSufficientPID"
Jul 08 15:51:02.477344 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.477329    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 08 15:51:02.477344 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.477341    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 15:51:02.477445 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.477342    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 08 15:51:02.477445 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.477417    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 08 15:51:02.478121 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.478102    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 15:51:02.478206 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.478140    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 15:51:02.478206 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.478157    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasSufficientPID"
Jul 08 15:51:02.478834 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.478823    2562 policy_none.go:49] "None policy: Start"
Jul 08 15:51:02.478873 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.478839    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 08 15:51:02.478873 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.478851    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 08 15:51:02.479922 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.479911    2562 policy_none.go:47] "Start"
Jul 08 15:51:02.520424 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.520235    2562 manager.go:337] "Starting Device Plugin manager"
Jul 08 15:51:02.520528 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:02.520445    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 08 15:51:02.520528 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.520461    2562 server.go:87] "Starting device plugin registration server"
Jul 08 15:51:02.520737 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.520724    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 08 15:51:02.520783 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.520737    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 08 15:51:02.520824 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.520811    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 08 15:51:02.520959 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.520941    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 08 15:51:02.520959 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.520957    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 08 15:51:02.521498 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:02.521480    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 08 15:51:02.521594 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:02.521528    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-108.ec2.internal\" not found"
Jul 08 15:51:02.609565 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.609514    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 08 15:51:02.611264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.610803    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 08 15:51:02.611264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.610846    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 08 15:51:02.611264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.610879    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 08 15:51:02.611264 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:02.610933    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 08 15:51:02.613208 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.613188    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 15:51:02.621099 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.621031    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 15:51:02.621929 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.621913    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 15:51:02.622014 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.621944    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 15:51:02.622014 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.621957    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasSufficientPID"
Jul 08 15:51:02.622014 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.621984    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-108.ec2.internal"
Jul 08 15:51:02.630435 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.630420    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-108.ec2.internal"
Jul 08 15:51:02.630499 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:02.630446    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-108.ec2.internal\": node \"ip-10-0-131-108.ec2.internal\" not found"
Jul 08 15:51:02.647037 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:02.647012    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-108.ec2.internal\" not found"
Jul 08 15:51:02.712696 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.712644    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-108.ec2.internal"]
Jul 08 15:51:02.712812 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.712740    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 15:51:02.714435 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.714412    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 15:51:02.714521 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.714450    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 15:51:02.714521 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.714461    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasSufficientPID"
Jul 08 15:51:02.715819 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.715805    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 15:51:02.715938 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.715924    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal"
Jul 08 15:51:02.715977 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.715961    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 15:51:02.716627 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.716581    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 15:51:02.716627 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.716631    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 15:51:02.716769 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.716641    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasSufficientPID"
Jul 08 15:51:02.716769 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.716606    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 15:51:02.716769 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.716690    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 15:51:02.716769 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.716700    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasSufficientPID"
Jul 08 15:51:02.717796 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.717781    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-108.ec2.internal"
Jul 08 15:51:02.717860 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.717806    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 08 15:51:02.718671 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.718642    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasSufficientMemory"
Jul 08 15:51:02.718671 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.718671    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasNoDiskPressure"
Jul 08 15:51:02.718777 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.718682    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeHasSufficientPID"
Jul 08 15:51:02.742590 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:02.742550    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-108.ec2.internal\" not found" node="ip-10-0-131-108.ec2.internal"
Jul 08 15:51:02.747273 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:02.747250    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-108.ec2.internal\" not found"
Jul 08 15:51:02.747401 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:02.747388    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-108.ec2.internal\" not found" node="ip-10-0-131-108.ec2.internal"
Jul 08 15:51:02.757224 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.757205    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f22ba0b68e3ed2da157c9fd0e9361669-config\") pod \"kube-apiserver-proxy-ip-10-0-131-108.ec2.internal\" (UID: \"f22ba0b68e3ed2da157c9fd0e9361669\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-108.ec2.internal"
Jul 08 15:51:02.757361 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.757232    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/657a9ac6d5e82faef8a6d88ba6433a58-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal\" (UID: \"657a9ac6d5e82faef8a6d88ba6433a58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal"
Jul 08 15:51:02.757361 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.757252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/657a9ac6d5e82faef8a6d88ba6433a58-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal\" (UID: \"657a9ac6d5e82faef8a6d88ba6433a58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal"
Jul 08 15:51:02.847602 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:02.847543    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-108.ec2.internal\" not found"
Jul 08 15:51:02.857650 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.857626    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/657a9ac6d5e82faef8a6d88ba6433a58-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal\" (UID: \"657a9ac6d5e82faef8a6d88ba6433a58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal"
Jul 08 15:51:02.857784 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.857664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/657a9ac6d5e82faef8a6d88ba6433a58-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal\" (UID: \"657a9ac6d5e82faef8a6d88ba6433a58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal"
Jul 08 15:51:02.857784 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.857691    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f22ba0b68e3ed2da157c9fd0e9361669-config\") pod \"kube-apiserver-proxy-ip-10-0-131-108.ec2.internal\" (UID: \"f22ba0b68e3ed2da157c9fd0e9361669\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-108.ec2.internal"
Jul 08 15:51:02.857784 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.857744    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f22ba0b68e3ed2da157c9fd0e9361669-config\") pod \"kube-apiserver-proxy-ip-10-0-131-108.ec2.internal\" (UID: \"f22ba0b68e3ed2da157c9fd0e9361669\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-108.ec2.internal"
Jul 08 15:51:02.857784 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.857749    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/657a9ac6d5e82faef8a6d88ba6433a58-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal\" (UID: \"657a9ac6d5e82faef8a6d88ba6433a58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal"
Jul 08 15:51:02.857929 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:02.857748    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/657a9ac6d5e82faef8a6d88ba6433a58-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal\" (UID: \"657a9ac6d5e82faef8a6d88ba6433a58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal"
Jul 08 15:51:02.947895 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:02.947803    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-108.ec2.internal\" not found"
Jul 08 15:51:03.051780 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.051737    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-108.ec2.internal"
Jul 08 15:51:03.051880 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.051744    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal"
Jul 08 15:51:03.051931 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:03.051759    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-108.ec2.internal\" not found"
Jul 08 15:51:03.152950 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:03.152909    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-108.ec2.internal\" not found"
Jul 08 15:51:03.256317 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:03.256232    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-108.ec2.internal\" not found"
Jul 08 15:51:03.356365 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:03.356334    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-108.ec2.internal\" not found"
Jul 08 15:51:03.389053 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.389024    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 08 15:51:03.389515 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.389209    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 15:51:03.389515 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.389223    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 08 15:51:03.419975 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.419941    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 15:51:03.434234 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.434210    2562 apiserver.go:52] "Watching apiserver"
Jul 08 15:51:03.444853 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.444828    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 08 15:51:03.445188 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.445165    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk","openshift-cluster-node-tuning-operator/tuned-c6n6c","openshift-multus/multus-additional-cni-plugins-8xkqh","openshift-multus/multus-rmjrs","openshift-network-diagnostics/network-check-target-mq6mh","kube-system/global-pull-secret-syncer-fwvjs","openshift-dns/node-resolver-5m9q9","openshift-image-registry/node-ca-287gc","openshift-multus/network-metrics-daemon-txtpm","openshift-network-operator/iptables-alerter-sz4pg","openshift-ovn-kubernetes/ovnkube-node-7kt66","kube-system/konnectivity-agent-5thr2"]
Jul 08 15:51:03.447497 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.447383    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.448686 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.448659    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.449940 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.449919    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.450848 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.450828    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 08 15:51:03.450920 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.450887    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 08 15:51:03.450920 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.450887    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 08 15:51:03.451005 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.450977    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fs7hm\""
Jul 08 15:51:03.451080 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.451062    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ptc59\""
Jul 08 15:51:03.451218 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.451201    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 08 15:51:03.451280 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.451244    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 08 15:51:03.451437 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.451419    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.452674 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.452656    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:03.452766 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.452747    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 08 15:51:03.452766 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:03.452753    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:03.452875 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.452855    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 08 15:51:03.452928 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.452907    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 08 15:51:03.452983 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.452967    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-frhlb\""
Jul 08 15:51:03.453095 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.453021    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 08 15:51:03.453143 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.453129    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 08 15:51:03.453823 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.453808    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:03.453906 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:03.453879    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:03.453957 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.453926    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 08 15:51:03.453994 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.453968    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-47f2m\""
Jul 08 15:51:03.454932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.454918    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 08 15:51:03.455003 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.454938    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5m9q9"
Jul 08 15:51:03.455062 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.455002    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal"
Jul 08 15:51:03.456350 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.456335    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-287gc"
Jul 08 15:51:03.457755 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.457735    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:03.457839 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:03.457809    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:03.458966 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.458947    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sz4pg"
Jul 08 15:51:03.459141 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.459118    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l7cpz\""
Jul 08 15:51:03.459385 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.459327    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 15:46:03 +0000 UTC" deadline="2028-02-16 09:55:14.63794324 +0000 UTC"
Jul 08 15:51:03.459385 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.459372    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 08 15:51:03.459385 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.459372    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14106h4m11.178575073s"
Jul 08 15:51:03.459565 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.459468    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 08 15:51:03.459691 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.459671    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 08 15:51:03.459883 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.459869    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 08 15:51:03.459958 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.459942    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jbctp\""
Jul 08 15:51:03.460000 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.459942    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 08 15:51:03.460478 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.460464    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.460840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.460815    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7-host\") pod \"node-ca-287gc\" (UID: \"f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7\") " pod="openshift-image-registry/node-ca-287gc"
Jul 08 15:51:03.460919 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.460853    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-cnibin\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.460919 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.460885    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-var-lib-kubelet\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.460919 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.460910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-run-multus-certs\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.461060 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.460935    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnc62\" (UniqueName: \"kubernetes.io/projected/35d153c0-3c55-4eea-af1d-6f0dfc498243-kube-api-access-jnc62\") pod \"node-resolver-5m9q9\" (UID: \"35d153c0-3c55-4eea-af1d-6f0dfc498243\") " pod="openshift-dns/node-resolver-5m9q9"
Jul 08 15:51:03.461060 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.460961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret\") pod \"global-pull-secret-syncer-fwvjs\" (UID: \"80295698-bf83-4342-a954-7491ebe64be9\") " pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:03.461060 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.460986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-registration-dir\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.461060 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-var-lib-kubelet\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.461060 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461056    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-cni-binary-copy\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.461363 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461081    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvb4n\" (UniqueName: \"kubernetes.io/projected/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-kube-api-access-qvb4n\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.461363 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461098    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-system-cni-dir\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.461363 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461114    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80295698-bf83-4342-a954-7491ebe64be9-dbus\") pod \"global-pull-secret-syncer-fwvjs\" (UID: \"80295698-bf83-4342-a954-7491ebe64be9\") " pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:03.461363 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461137    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-device-dir\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.461363 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461210    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jjjt\" (UniqueName: \"kubernetes.io/projected/f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7-kube-api-access-8jjjt\") pod \"node-ca-287gc\" (UID: \"f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7\") " pod="openshift-image-registry/node-ca-287gc"
Jul 08 15:51:03.461363 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461248    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzzrz\" (UniqueName: \"kubernetes.io/projected/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-kube-api-access-xzzrz\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.461363 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461278    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-kubernetes\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.461363 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461304    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-os-release\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.461363 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461329    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-run-netns\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.461363 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461354    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80295698-bf83-4342-a954-7491ebe64be9-kubelet-config\") pod \"global-pull-secret-syncer-fwvjs\" (UID: \"80295698-bf83-4342-a954-7491ebe64be9\") " pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461403    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-sys-fs\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461438    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-sysconfig\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461468    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-sys\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461498    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9d30797-cfba-491d-bce8-bc3501219625-tmp\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461521    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm4s2\" (UniqueName: \"kubernetes.io/projected/e9d30797-cfba-491d-bce8-bc3501219625-kube-api-access-zm4s2\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461546    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-multus-daemon-config\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461572    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-cni-binary-copy\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461598    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461611    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l56q4\""
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461645    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zm8p\" (UniqueName: \"kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p\") pod \"network-check-target-mq6mh\" (UID: \"357f648e-a202-4a71-a7ea-ffdd1c250bff\") " pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461715    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-modprobe-d\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461776    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-hostroot\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461789    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461803    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qdqb\" (UniqueName: \"kubernetes.io/projected/b3a835a9-b28a-4cca-afac-7e1e370602e2-kube-api-access-4qdqb\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.462016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-cnibin\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461891    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461916    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-multus-cni-dir\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461892    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5thr2"
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461940    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-var-lib-cni-multus\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.461982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-etc-kubernetes\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462000    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462012    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-socket-dir\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-sysctl-d\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462058    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-run\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462098    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35d153c0-3c55-4eea-af1d-6f0dfc498243-tmp-dir\") pod \"node-resolver-5m9q9\" (UID: \"35d153c0-3c55-4eea-af1d-6f0dfc498243\") " pod="openshift-dns/node-resolver-5m9q9"
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462129    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-sysctl-conf\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462154    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-systemd\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-multus-conf-dir\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7-serviceca\") pod \"node-ca-287gc\" (UID: \"f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7\") " pod="openshift-image-registry/node-ca-287gc"
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462243    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/35d153c0-3c55-4eea-af1d-6f0dfc498243-hosts-file\") pod \"node-resolver-5m9q9\" (UID: \"35d153c0-3c55-4eea-af1d-6f0dfc498243\") " pod="openshift-dns/node-resolver-5m9q9"
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462260    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-lib-modules\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462275    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-run-k8s-cni-cncf-io\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.462641 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462293    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-var-lib-cni-bin\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.463275 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462356    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-os-release\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.463275 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462377    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-system-cni-dir\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.463275 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462401    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-multus-socket-dir-parent\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.463275 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462425    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.463275 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462448    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-host\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.463275 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9d30797-cfba-491d-bce8-bc3501219625-etc-tuned\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.463275 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.462984    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 08 15:51:03.463275 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.463026    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 08 15:51:03.463706 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.463639    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 08 15:51:03.463706 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.463678    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 08 15:51:03.463706 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.463692    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 08 15:51:03.463871 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.463713    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8nnmz\""
Jul 08 15:51:03.465102 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.464870    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 08 15:51:03.465102 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.464882    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 08 15:51:03.465218 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.465175    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hv8sq\""
Jul 08 15:51:03.465218 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.465202    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 08 15:51:03.473405 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.473309    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal"]
Jul 08 15:51:03.473506 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.473457    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 15:51:03.473580 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.473552    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-108.ec2.internal"
Jul 08 15:51:03.475920 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.475896    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 08 15:51:03.481639 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.481622    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-108.ec2.internal"]
Jul 08 15:51:03.481744 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.481656    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 08 15:51:03.493053 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.493031    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sx7sb"
Jul 08 15:51:03.502204 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.502186    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sx7sb"
Jul 08 15:51:03.556668 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.556618    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 08 15:51:03.563351 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563331    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jjjt\" (UniqueName: \"kubernetes.io/projected/f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7-kube-api-access-8jjjt\") pod \"node-ca-287gc\" (UID: \"f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7\") " pod="openshift-image-registry/node-ca-287gc"
Jul 08 15:51:03.563429 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563362    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzzrz\" (UniqueName: \"kubernetes.io/projected/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-kube-api-access-xzzrz\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.563429 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563380    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-kubernetes\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.563429 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-os-release\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.563429 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563416    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-run-netns\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.563598 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563443    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-systemd-units\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.563598 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563468    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.563598 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563485    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-kubernetes\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.563598 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563510    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-os-release\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.563598 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563505    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-run-netns\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.563598 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80295698-bf83-4342-a954-7491ebe64be9-kubelet-config\") pod \"global-pull-secret-syncer-fwvjs\" (UID: \"80295698-bf83-4342-a954-7491ebe64be9\") " pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:03.563598 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563582    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-sys-fs\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.564011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563607    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-sysconfig\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.564011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563631    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-sys\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.564011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563646    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-sys-fs\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.564011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563631    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80295698-bf83-4342-a954-7491ebe64be9-kubelet-config\") pod \"global-pull-secret-syncer-fwvjs\" (UID: \"80295698-bf83-4342-a954-7491ebe64be9\") " pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:03.564011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563665    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-sysconfig\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.564011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9d30797-cfba-491d-bce8-bc3501219625-tmp\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.564011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563697    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-sys\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.564011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563710    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm4s2\" (UniqueName: \"kubernetes.io/projected/e9d30797-cfba-491d-bce8-bc3501219625-kube-api-access-zm4s2\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.564011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563744    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-multus-daemon-config\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.564011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563769    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-cni-binary-copy\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.564011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563803    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.564011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zm8p\" (UniqueName: \"kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p\") pod \"network-check-target-mq6mh\" (UID: \"357f648e-a202-4a71-a7ea-ffdd1c250bff\") " pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:03.564011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563864    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.564011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563894    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-modprobe-d\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.564011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-hostroot\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.564011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8z9g\" (UniqueName: \"kubernetes.io/projected/4d3d9829-234c-45ed-8d74-75cdadc4f135-kube-api-access-m8z9g\") pod \"network-metrics-daemon-txtpm\" (UID: \"4d3d9829-234c-45ed-8d74-75cdadc4f135\") " pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:03.564011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563973    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.564923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-node-log\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.564923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.563989    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 08 15:51:03.564923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564010    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qdqb\" (UniqueName: \"kubernetes.io/projected/b3a835a9-b28a-4cca-afac-7e1e370602e2-kube-api-access-4qdqb\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.564923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564038    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18c2c4bb-6bff-464c-8908-feb288405da4-host-slash\") pod \"iptables-alerter-sz4pg\" (UID: \"18c2c4bb-6bff-464c-8908-feb288405da4\") " pod="openshift-network-operator/iptables-alerter-sz4pg"
Jul 08 15:51:03.564923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564038    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-hostroot\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.564923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-log-socket\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.564923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564117    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-cni-netd\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.564923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564144    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.564923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564155    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whhs8\" (UniqueName: \"kubernetes.io/projected/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-kube-api-access-whhs8\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.564923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39598e1b-be56-4383-816d-e36a823de7a7-konnectivity-ca\") pod \"konnectivity-agent-5thr2\" (UID: \"39598e1b-be56-4383-816d-e36a823de7a7\") " pod="kube-system/konnectivity-agent-5thr2"
Jul 08 15:51:03.564923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564224    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-modprobe-d\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.564923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564235    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-cnibin\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.564923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564268    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.564923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564277    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-cnibin\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.564923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564307    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-cni-binary-copy\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.564923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564312    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-multus-cni-dir\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.564923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564350    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-etc-selinux\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.565714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-var-lib-cni-multus\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.565714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564384    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-etc-kubernetes\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.565714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564408    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-run-ovn\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.565714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564409    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-multus-daemon-config\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.565714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564428    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-ovnkube-config\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.565714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564419    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-var-lib-cni-multus\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.565714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564441    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.565714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564467    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-multus-cni-dir\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.565714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-socket-dir\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.565714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564486    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-etc-kubernetes\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.565714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564513    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-sysctl-d\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.565714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-run\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.565714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564567    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs\") pod \"network-metrics-daemon-txtpm\" (UID: \"4d3d9829-234c-45ed-8d74-75cdadc4f135\") " pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:03.565714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564596    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-slash\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.565714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564601    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-run\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.565714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564622    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-socket-dir\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.565714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564623    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-run-systemd\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564642    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-sysctl-d\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564657    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35d153c0-3c55-4eea-af1d-6f0dfc498243-tmp-dir\") pod \"node-resolver-5m9q9\" (UID: \"35d153c0-3c55-4eea-af1d-6f0dfc498243\") " pod="openshift-dns/node-resolver-5m9q9"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-sysctl-conf\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564712    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-systemd\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-multus-conf-dir\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564765    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-systemd\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564766    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-multus-conf-dir\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564791    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-var-lib-openvswitch\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564815    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7-serviceca\") pod \"node-ca-287gc\" (UID: \"f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7\") " pod="openshift-image-registry/node-ca-287gc"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564828    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-etc-sysctl-conf\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564845    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/35d153c0-3c55-4eea-af1d-6f0dfc498243-hosts-file\") pod \"node-resolver-5m9q9\" (UID: \"35d153c0-3c55-4eea-af1d-6f0dfc498243\") " pod="openshift-dns/node-resolver-5m9q9"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-lib-modules\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564884    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-run-k8s-cni-cncf-io\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564905    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-var-lib-cni-bin\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564941    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35d153c0-3c55-4eea-af1d-6f0dfc498243-tmp-dir\") pod \"node-resolver-5m9q9\" (UID: \"35d153c0-3c55-4eea-af1d-6f0dfc498243\") " pod="openshift-dns/node-resolver-5m9q9"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpxjx\" (UniqueName: \"kubernetes.io/projected/18c2c4bb-6bff-464c-8908-feb288405da4-kube-api-access-gpxjx\") pod \"iptables-alerter-sz4pg\" (UID: \"18c2c4bb-6bff-464c-8908-feb288405da4\") " pod="openshift-network-operator/iptables-alerter-sz4pg"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564955    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-run-k8s-cni-cncf-io\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.566357 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564978    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/35d153c0-3c55-4eea-af1d-6f0dfc498243-hosts-file\") pod \"node-resolver-5m9q9\" (UID: \"35d153c0-3c55-4eea-af1d-6f0dfc498243\") " pod="openshift-dns/node-resolver-5m9q9"
Jul 08 15:51:03.567031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564989    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-lib-modules\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.567031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.564980    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-os-release\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.567031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565015    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-var-lib-cni-bin\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.567031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565033    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-system-cni-dir\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.567031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565037    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-os-release\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.567031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565062    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-multus-socket-dir-parent\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.567031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565073    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-system-cni-dir\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.567031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565084    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39598e1b-be56-4383-816d-e36a823de7a7-agent-certs\") pod \"konnectivity-agent-5thr2\" (UID: \"39598e1b-be56-4383-816d-e36a823de7a7\") " pod="kube-system/konnectivity-agent-5thr2"
Jul 08 15:51:03.567031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565111    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.567031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-host\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.567031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565156    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-multus-socket-dir-parent\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.567031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9d30797-cfba-491d-bce8-bc3501219625-etc-tuned\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.567031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-etc-openvswitch\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.567031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565212    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-host\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.567031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565212    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-run-openvswitch\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.567031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565249    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7-serviceca\") pod \"node-ca-287gc\" (UID: \"f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7\") " pod="openshift-image-registry/node-ca-287gc"
Jul 08 15:51:03.567031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-ovnkube-script-lib\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7-host\") pod \"node-ca-287gc\" (UID: \"f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7\") " pod="openshift-image-registry/node-ca-287gc"
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565309    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-cnibin\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565331    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7-host\") pod \"node-ca-287gc\" (UID: \"f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7\") " pod="openshift-image-registry/node-ca-287gc"
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-var-lib-kubelet\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565361    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-var-lib-kubelet\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565360    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-run-multus-certs\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565373    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-cnibin\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565393    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-host-run-multus-certs\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565392    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565435    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnc62\" (UniqueName: \"kubernetes.io/projected/35d153c0-3c55-4eea-af1d-6f0dfc498243-kube-api-access-jnc62\") pod \"node-resolver-5m9q9\" (UID: \"35d153c0-3c55-4eea-af1d-6f0dfc498243\") " pod="openshift-dns/node-resolver-5m9q9"
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565465    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565496    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-env-overrides\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret\") pod \"global-pull-secret-syncer-fwvjs\" (UID: \"80295698-bf83-4342-a954-7491ebe64be9\") " pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-registration-dir\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565571    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565615    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-var-lib-kubelet\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:03.565632    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:03.567534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565642    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-cni-binary-copy\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.568124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565660    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-registration-dir\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.568124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565667    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvb4n\" (UniqueName: \"kubernetes.io/projected/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-kube-api-access-qvb4n\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.568124 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:03.565718    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret podName:80295698-bf83-4342-a954-7491ebe64be9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:04.065677996 +0000 UTC m=+3.476342658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret") pod "global-pull-secret-syncer-fwvjs" (UID: "80295698-bf83-4342-a954-7491ebe64be9") : object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:03.568124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565723    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9d30797-cfba-491d-bce8-bc3501219625-var-lib-kubelet\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.568124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565768    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-run-netns\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.568124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565792    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-cni-bin\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.568124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-ovn-node-metrics-cert\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.568124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565851    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-system-cni-dir\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.568124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80295698-bf83-4342-a954-7491ebe64be9-dbus\") pod \"global-pull-secret-syncer-fwvjs\" (UID: \"80295698-bf83-4342-a954-7491ebe64be9\") " pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:03.568124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565900    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-system-cni-dir\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.568124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-device-dir\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.568124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/18c2c4bb-6bff-464c-8908-feb288405da4-iptables-alerter-script\") pod \"iptables-alerter-sz4pg\" (UID: \"18c2c4bb-6bff-464c-8908-feb288405da4\") " pod="openshift-network-operator/iptables-alerter-sz4pg"
Jul 08 15:51:03.568124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565962    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-kubelet\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.568124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565967    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80295698-bf83-4342-a954-7491ebe64be9-dbus\") pod \"global-pull-secret-syncer-fwvjs\" (UID: \"80295698-bf83-4342-a954-7491ebe64be9\") " pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:03.568124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.565971    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b3a835a9-b28a-4cca-afac-7e1e370602e2-device-dir\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.568124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.566091    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-cni-binary-copy\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.568638 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.568085    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e9d30797-cfba-491d-bce8-bc3501219625-etc-tuned\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.568638 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.568115    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9d30797-cfba-491d-bce8-bc3501219625-tmp\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.574908 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:03.574891    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 15:51:03.575008 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:03.574912    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 15:51:03.575008 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:03.574925    2562 projected.go:196] Error preparing data for projected volume kube-api-access-9zm8p for pod openshift-network-diagnostics/network-check-target-mq6mh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:03.575008 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:03.574987    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p podName:357f648e-a202-4a71-a7ea-ffdd1c250bff nodeName:}" failed. No retries permitted until 2026-07-08 15:51:04.074967979 +0000 UTC m=+3.485632634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9zm8p" (UniqueName: "kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p") pod "network-check-target-mq6mh" (UID: "357f648e-a202-4a71-a7ea-ffdd1c250bff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:03.577730 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.577604    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm4s2\" (UniqueName: \"kubernetes.io/projected/e9d30797-cfba-491d-bce8-bc3501219625-kube-api-access-zm4s2\") pod \"tuned-c6n6c\" (UID: \"e9d30797-cfba-491d-bce8-bc3501219625\") " pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.577970 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.577858    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qdqb\" (UniqueName: \"kubernetes.io/projected/b3a835a9-b28a-4cca-afac-7e1e370602e2-kube-api-access-4qdqb\") pod \"aws-ebs-csi-driver-node-tdhfk\" (UID: \"b3a835a9-b28a-4cca-afac-7e1e370602e2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.578045 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.577984    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvb4n\" (UniqueName: \"kubernetes.io/projected/ca7334d7-2933-491d-a1e2-5a9b5dbd323c-kube-api-access-qvb4n\") pod \"multus-rmjrs\" (UID: \"ca7334d7-2933-491d-a1e2-5a9b5dbd323c\") " pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.578777 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.578745    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnc62\" (UniqueName: \"kubernetes.io/projected/35d153c0-3c55-4eea-af1d-6f0dfc498243-kube-api-access-jnc62\") pod \"node-resolver-5m9q9\" (UID: \"35d153c0-3c55-4eea-af1d-6f0dfc498243\") " pod="openshift-dns/node-resolver-5m9q9"
Jul 08 15:51:03.579001 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.578979    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzzrz\" (UniqueName: \"kubernetes.io/projected/33628d14-fa4a-4bba-8f64-8e7e4b93bbb9-kube-api-access-xzzrz\") pod \"multus-additional-cni-plugins-8xkqh\" (UID: \"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9\") " pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.579513 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.579495    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jjjt\" (UniqueName: \"kubernetes.io/projected/f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7-kube-api-access-8jjjt\") pod \"node-ca-287gc\" (UID: \"f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7\") " pod="openshift-image-registry/node-ca-287gc"
Jul 08 15:51:03.666293 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpxjx\" (UniqueName: \"kubernetes.io/projected/18c2c4bb-6bff-464c-8908-feb288405da4-kube-api-access-gpxjx\") pod \"iptables-alerter-sz4pg\" (UID: \"18c2c4bb-6bff-464c-8908-feb288405da4\") " pod="openshift-network-operator/iptables-alerter-sz4pg"
Jul 08 15:51:03.666594 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39598e1b-be56-4383-816d-e36a823de7a7-agent-certs\") pod \"konnectivity-agent-5thr2\" (UID: \"39598e1b-be56-4383-816d-e36a823de7a7\") " pod="kube-system/konnectivity-agent-5thr2"
Jul 08 15:51:03.666594 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666331    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-etc-openvswitch\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.666594 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-run-openvswitch\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.666594 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666393    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-ovnkube-script-lib\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.666594 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666423    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.666594 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666450    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.666594 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666464    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-run-openvswitch\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.666594 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666464    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-etc-openvswitch\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.666594 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666476    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-env-overrides\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.666594 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666516    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-run-ovn-kubernetes\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.666594 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666528    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.666594 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-run-netns\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.666594 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666599    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-cni-bin\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.667340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-ovn-node-metrics-cert\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.667340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666666    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/18c2c4bb-6bff-464c-8908-feb288405da4-iptables-alerter-script\") pod \"iptables-alerter-sz4pg\" (UID: \"18c2c4bb-6bff-464c-8908-feb288405da4\") " pod="openshift-network-operator/iptables-alerter-sz4pg"
Jul 08 15:51:03.667340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666669    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-run-netns\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.667340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666691    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-kubelet\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.667340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666703    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-cni-bin\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.667340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666727    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-systemd-units\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.667340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666778    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8z9g\" (UniqueName: \"kubernetes.io/projected/4d3d9829-234c-45ed-8d74-75cdadc4f135-kube-api-access-m8z9g\") pod \"network-metrics-daemon-txtpm\" (UID: \"4d3d9829-234c-45ed-8d74-75cdadc4f135\") " pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:03.667340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666803    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-node-log\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.667340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666831    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18c2c4bb-6bff-464c-8908-feb288405da4-host-slash\") pod \"iptables-alerter-sz4pg\" (UID: \"18c2c4bb-6bff-464c-8908-feb288405da4\") " pod="openshift-network-operator/iptables-alerter-sz4pg"
Jul 08 15:51:03.667340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666856    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-log-socket\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.667340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-cni-netd\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.667340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666905    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-systemd-units\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.667340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666913    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whhs8\" (UniqueName: \"kubernetes.io/projected/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-kube-api-access-whhs8\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.667340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666826    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-kubelet\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.667340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666938    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39598e1b-be56-4383-816d-e36a823de7a7-konnectivity-ca\") pod \"konnectivity-agent-5thr2\" (UID: \"39598e1b-be56-4383-816d-e36a823de7a7\") " pod="kube-system/konnectivity-agent-5thr2"
Jul 08 15:51:03.667340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666969    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-run-ovn\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.667340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666974    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-node-log\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.668264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.666993    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-ovnkube-config\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.668264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.667061    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-cni-netd\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.668264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.667066    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-env-overrides\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.668264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.667118    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-run-ovn\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.668264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.667159    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/18c2c4bb-6bff-464c-8908-feb288405da4-host-slash\") pod \"iptables-alerter-sz4pg\" (UID: \"18c2c4bb-6bff-464c-8908-feb288405da4\") " pod="openshift-network-operator/iptables-alerter-sz4pg"
Jul 08 15:51:03.668264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.667164    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-ovnkube-script-lib\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.668264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.667188    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs\") pod \"network-metrics-daemon-txtpm\" (UID: \"4d3d9829-234c-45ed-8d74-75cdadc4f135\") " pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:03.668264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.667218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-slash\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.668264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.667243    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-run-systemd\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.668264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.667273    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-var-lib-openvswitch\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.668264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.667310    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-host-slash\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.668264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.667325    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/18c2c4bb-6bff-464c-8908-feb288405da4-iptables-alerter-script\") pod \"iptables-alerter-sz4pg\" (UID: \"18c2c4bb-6bff-464c-8908-feb288405da4\") " pod="openshift-network-operator/iptables-alerter-sz4pg"
Jul 08 15:51:03.668264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.667360    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-run-systemd\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.668264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.667386    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-log-socket\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.668264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.667433    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-var-lib-openvswitch\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.668264 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:03.667497    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:03.668264 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.667533    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-ovnkube-config\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.669169 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:03.667558    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs podName:4d3d9829-234c-45ed-8d74-75cdadc4f135 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:04.167542095 +0000 UTC m=+3.578206731 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs") pod "network-metrics-daemon-txtpm" (UID: "4d3d9829-234c-45ed-8d74-75cdadc4f135") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:03.669169 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.667638    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/39598e1b-be56-4383-816d-e36a823de7a7-konnectivity-ca\") pod \"konnectivity-agent-5thr2\" (UID: \"39598e1b-be56-4383-816d-e36a823de7a7\") " pod="kube-system/konnectivity-agent-5thr2"
Jul 08 15:51:03.669301 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.669238    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-ovn-node-metrics-cert\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.670056 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.670023    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/39598e1b-be56-4383-816d-e36a823de7a7-agent-certs\") pod \"konnectivity-agent-5thr2\" (UID: \"39598e1b-be56-4383-816d-e36a823de7a7\") " pod="kube-system/konnectivity-agent-5thr2"
Jul 08 15:51:03.679176 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.679148    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8z9g\" (UniqueName: \"kubernetes.io/projected/4d3d9829-234c-45ed-8d74-75cdadc4f135-kube-api-access-m8z9g\") pod \"network-metrics-daemon-txtpm\" (UID: \"4d3d9829-234c-45ed-8d74-75cdadc4f135\") " pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:03.679735 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.679715    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpxjx\" (UniqueName: \"kubernetes.io/projected/18c2c4bb-6bff-464c-8908-feb288405da4-kube-api-access-gpxjx\") pod \"iptables-alerter-sz4pg\" (UID: \"18c2c4bb-6bff-464c-8908-feb288405da4\") " pod="openshift-network-operator/iptables-alerter-sz4pg"
Jul 08 15:51:03.680068 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.680052    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whhs8\" (UniqueName: \"kubernetes.io/projected/87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d-kube-api-access-whhs8\") pod \"ovnkube-node-7kt66\" (UID: \"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d\") " pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.740966 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:03.740911    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657a9ac6d5e82faef8a6d88ba6433a58.slice/crio-7c32e97b06d506f5c79716ab7a869ba4ff4304554a7577828dd55de344c735cf WatchSource:0}: Error finding container 7c32e97b06d506f5c79716ab7a869ba4ff4304554a7577828dd55de344c735cf: Status 404 returned error can't find the container with id 7c32e97b06d506f5c79716ab7a869ba4ff4304554a7577828dd55de344c735cf
Jul 08 15:51:03.744541 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:03.744514    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf22ba0b68e3ed2da157c9fd0e9361669.slice/crio-1ff0023a16823c584c8094ec60e034f1755d5616d25c8809ddc73cd92a5a8b64 WatchSource:0}: Error finding container 1ff0023a16823c584c8094ec60e034f1755d5616d25c8809ddc73cd92a5a8b64: Status 404 returned error can't find the container with id 1ff0023a16823c584c8094ec60e034f1755d5616d25c8809ddc73cd92a5a8b64
Jul 08 15:51:03.746110 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.746095    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 15:51:03.780144 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.780064    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk"
Jul 08 15:51:03.785972 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.785945    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c6n6c"
Jul 08 15:51:03.788912 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:03.788888    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3a835a9_b28a_4cca_afac_7e1e370602e2.slice/crio-5643177fd4392e8ea1e8e050cf818dd2a191063f1774f957529b430bb6c0996a WatchSource:0}: Error finding container 5643177fd4392e8ea1e8e050cf818dd2a191063f1774f957529b430bb6c0996a: Status 404 returned error can't find the container with id 5643177fd4392e8ea1e8e050cf818dd2a191063f1774f957529b430bb6c0996a
Jul 08 15:51:03.793876 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:03.793847    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d30797_cfba_491d_bce8_bc3501219625.slice/crio-c67cf644b8465c4050fcbb5523ac9ec47358f2d3463d09593e6ed59f2fbc4b6b WatchSource:0}: Error finding container c67cf644b8465c4050fcbb5523ac9ec47358f2d3463d09593e6ed59f2fbc4b6b: Status 404 returned error can't find the container with id c67cf644b8465c4050fcbb5523ac9ec47358f2d3463d09593e6ed59f2fbc4b6b
Jul 08 15:51:03.799951 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.799933    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8xkqh"
Jul 08 15:51:03.807460 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:03.807423    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33628d14_fa4a_4bba_8f64_8e7e4b93bbb9.slice/crio-22b52f59d99c2114b2ac4d06a15f1723fb98ff6379aeb64f0ac599a7f83ad9ec WatchSource:0}: Error finding container 22b52f59d99c2114b2ac4d06a15f1723fb98ff6379aeb64f0ac599a7f83ad9ec: Status 404 returned error can't find the container with id 22b52f59d99c2114b2ac4d06a15f1723fb98ff6379aeb64f0ac599a7f83ad9ec
Jul 08 15:51:03.810744 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.810727    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 15:51:03.811534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.811514    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rmjrs"
Jul 08 15:51:03.818892 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:03.818871    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca7334d7_2933_491d_a1e2_5a9b5dbd323c.slice/crio-b16e56d683138b12a9f8a8694832d528c1648687ea60545c396d1f214a7f50f1 WatchSource:0}: Error finding container b16e56d683138b12a9f8a8694832d528c1648687ea60545c396d1f214a7f50f1: Status 404 returned error can't find the container with id b16e56d683138b12a9f8a8694832d528c1648687ea60545c396d1f214a7f50f1
Jul 08 15:51:03.827875 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.827860    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5m9q9"
Jul 08 15:51:03.834958 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:03.834937    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d153c0_3c55_4eea_af1d_6f0dfc498243.slice/crio-107f02f880b5448d1a209303591053c81890acf5c9bd8207553ecb2b4dc3f3ae WatchSource:0}: Error finding container 107f02f880b5448d1a209303591053c81890acf5c9bd8207553ecb2b4dc3f3ae: Status 404 returned error can't find the container with id 107f02f880b5448d1a209303591053c81890acf5c9bd8207553ecb2b4dc3f3ae
Jul 08 15:51:03.838199 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.838182    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-287gc"
Jul 08 15:51:03.845552 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:03.845528    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf09d8cdf_3fb9_4661_ab2a_d56dac22f1f7.slice/crio-c8ae9d6aa9832c050d36d787d04b6985c981a1e5828c97c331678af9622b7cb9 WatchSource:0}: Error finding container c8ae9d6aa9832c050d36d787d04b6985c981a1e5828c97c331678af9622b7cb9: Status 404 returned error can't find the container with id c8ae9d6aa9832c050d36d787d04b6985c981a1e5828c97c331678af9622b7cb9
Jul 08 15:51:03.859232 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.859211    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sz4pg"
Jul 08 15:51:03.866732 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:03.866709    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c2c4bb_6bff_464c_8908_feb288405da4.slice/crio-c3171ce8b8cb0df2d59b182fdee7c46ce70f0cf44af2e6d38cd46f736cb1a998 WatchSource:0}: Error finding container c3171ce8b8cb0df2d59b182fdee7c46ce70f0cf44af2e6d38cd46f736cb1a998: Status 404 returned error can't find the container with id c3171ce8b8cb0df2d59b182fdee7c46ce70f0cf44af2e6d38cd46f736cb1a998
Jul 08 15:51:03.876022 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.876002    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:03.883097 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:03.883074    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c8a54f_d1b2_4ddd_a47b_8d62c110bf5d.slice/crio-161b4809c55482e66a0ca80e26f48b8870ff9234da8d94638df664c6ad0ae3ca WatchSource:0}: Error finding container 161b4809c55482e66a0ca80e26f48b8870ff9234da8d94638df664c6ad0ae3ca: Status 404 returned error can't find the container with id 161b4809c55482e66a0ca80e26f48b8870ff9234da8d94638df664c6ad0ae3ca
Jul 08 15:51:03.889589 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:03.889567    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5thr2"
Jul 08 15:51:03.897885 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:03.897862    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39598e1b_be56_4383_816d_e36a823de7a7.slice/crio-fb3031ba0053b475e1ddb05798c12c79069648fb06baf3fd031c1be68b1f20f6 WatchSource:0}: Error finding container fb3031ba0053b475e1ddb05798c12c79069648fb06baf3fd031c1be68b1f20f6: Status 404 returned error can't find the container with id fb3031ba0053b475e1ddb05798c12c79069648fb06baf3fd031c1be68b1f20f6
Jul 08 15:51:03.899599 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:03.899579    2562 kuberuntime_manager.go:1459] "Unhandled Error" err="container konnectivity-agent start failed in pod konnectivity-agent-5thr2_kube-system(39598e1b-be56-4383-816d-e36a823de7a7): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 08 15:51:03.899682 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:03.899616    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ErrImagePull: \"pull QPS exceeded\"" pod="kube-system/konnectivity-agent-5thr2" podUID="39598e1b-be56-4383-816d-e36a823de7a7"
Jul 08 15:51:04.070502 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.070416    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret\") pod \"global-pull-secret-syncer-fwvjs\" (UID: \"80295698-bf83-4342-a954-7491ebe64be9\") " pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:04.070680 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:04.070553    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:04.070680 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:04.070620    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret podName:80295698-bf83-4342-a954-7491ebe64be9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:05.070604916 +0000 UTC m=+4.481269551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret") pod "global-pull-secret-syncer-fwvjs" (UID: "80295698-bf83-4342-a954-7491ebe64be9") : object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:04.170873 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.170840    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zm8p\" (UniqueName: \"kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p\") pod \"network-check-target-mq6mh\" (UID: \"357f648e-a202-4a71-a7ea-ffdd1c250bff\") " pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:04.170873 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.170879    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs\") pod \"network-metrics-daemon-txtpm\" (UID: \"4d3d9829-234c-45ed-8d74-75cdadc4f135\") " pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:04.171078 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:04.170993    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:04.171078 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:04.171008    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 15:51:04.171078 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:04.171028    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 15:51:04.171078 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:04.171039    2562 projected.go:196] Error preparing data for projected volume kube-api-access-9zm8p for pod openshift-network-diagnostics/network-check-target-mq6mh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:04.171078 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:04.171042    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs podName:4d3d9829-234c-45ed-8d74-75cdadc4f135 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:05.17102829 +0000 UTC m=+4.581692923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs") pod "network-metrics-daemon-txtpm" (UID: "4d3d9829-234c-45ed-8d74-75cdadc4f135") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:04.171078 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:04.171078    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p podName:357f648e-a202-4a71-a7ea-ffdd1c250bff nodeName:}" failed. No retries permitted until 2026-07-08 15:51:05.171065723 +0000 UTC m=+4.581730357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zm8p" (UniqueName: "kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p") pod "network-check-target-mq6mh" (UID: "357f648e-a202-4a71-a7ea-ffdd1c250bff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:04.504362 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.504214    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 15:46:04 +0000 UTC" deadline="2027-12-02 21:23:55.887098981 +0000 UTC"
Jul 08 15:51:04.504362 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.504307    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12293h32m51.382798693s"
Jul 08 15:51:04.551666 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.551614    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 15:51:04.611887 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.611850    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:04.612128 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:04.612021    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:04.619931 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.619875    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66" event={"ID":"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d","Type":"ContainerStarted","Data":"161b4809c55482e66a0ca80e26f48b8870ff9234da8d94638df664c6ad0ae3ca"}
Jul 08 15:51:04.640894 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.640845    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-287gc" event={"ID":"f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7","Type":"ContainerStarted","Data":"c8ae9d6aa9832c050d36d787d04b6985c981a1e5828c97c331678af9622b7cb9"}
Jul 08 15:51:04.645729 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.645623    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5m9q9" event={"ID":"35d153c0-3c55-4eea-af1d-6f0dfc498243","Type":"ContainerStarted","Data":"107f02f880b5448d1a209303591053c81890acf5c9bd8207553ecb2b4dc3f3ae"}
Jul 08 15:51:04.651658 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.651597    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c6n6c" event={"ID":"e9d30797-cfba-491d-bce8-bc3501219625","Type":"ContainerStarted","Data":"c67cf644b8465c4050fcbb5523ac9ec47358f2d3463d09593e6ed59f2fbc4b6b"}
Jul 08 15:51:04.654157 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.654127    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk" event={"ID":"b3a835a9-b28a-4cca-afac-7e1e370602e2","Type":"ContainerStarted","Data":"5643177fd4392e8ea1e8e050cf818dd2a191063f1774f957529b430bb6c0996a"}
Jul 08 15:51:04.662327 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.660595    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-108.ec2.internal" event={"ID":"f22ba0b68e3ed2da157c9fd0e9361669","Type":"ContainerStarted","Data":"1ff0023a16823c584c8094ec60e034f1755d5616d25c8809ddc73cd92a5a8b64"}
Jul 08 15:51:04.665562 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.665534    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5thr2" event={"ID":"39598e1b-be56-4383-816d-e36a823de7a7","Type":"ContainerStarted","Data":"fb3031ba0053b475e1ddb05798c12c79069648fb06baf3fd031c1be68b1f20f6"}
Jul 08 15:51:04.667785 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:04.667719    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"konnectivity-agent\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b2e954d9267f62174ff45a44976fa7a47e58d87fef14ffbb9fc0f8184e722280\\\": ErrImagePull: pull QPS exceeded\"" pod="kube-system/konnectivity-agent-5thr2" podUID="39598e1b-be56-4383-816d-e36a823de7a7"
Jul 08 15:51:04.671697 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.671505    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sz4pg" event={"ID":"18c2c4bb-6bff-464c-8908-feb288405da4","Type":"ContainerStarted","Data":"c3171ce8b8cb0df2d59b182fdee7c46ce70f0cf44af2e6d38cd46f736cb1a998"}
Jul 08 15:51:04.678460 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.678427    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rmjrs" event={"ID":"ca7334d7-2933-491d-a1e2-5a9b5dbd323c","Type":"ContainerStarted","Data":"b16e56d683138b12a9f8a8694832d528c1648687ea60545c396d1f214a7f50f1"}
Jul 08 15:51:04.694861 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.694830    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xkqh" event={"ID":"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9","Type":"ContainerStarted","Data":"22b52f59d99c2114b2ac4d06a15f1723fb98ff6379aeb64f0ac599a7f83ad9ec"}
Jul 08 15:51:04.701897 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.701741    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal" event={"ID":"657a9ac6d5e82faef8a6d88ba6433a58","Type":"ContainerStarted","Data":"7c32e97b06d506f5c79716ab7a869ba4ff4304554a7577828dd55de344c735cf"}
Jul 08 15:51:04.762196 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:04.762115    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 08 15:51:05.077640 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:05.077546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret\") pod \"global-pull-secret-syncer-fwvjs\" (UID: \"80295698-bf83-4342-a954-7491ebe64be9\") " pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:05.077827 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:05.077792    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:05.077901 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:05.077861    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret podName:80295698-bf83-4342-a954-7491ebe64be9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:07.077841742 +0000 UTC m=+6.488506383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret") pod "global-pull-secret-syncer-fwvjs" (UID: "80295698-bf83-4342-a954-7491ebe64be9") : object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:05.179051 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:05.179007    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zm8p\" (UniqueName: \"kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p\") pod \"network-check-target-mq6mh\" (UID: \"357f648e-a202-4a71-a7ea-ffdd1c250bff\") " pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:05.179250 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:05.179076    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs\") pod \"network-metrics-daemon-txtpm\" (UID: \"4d3d9829-234c-45ed-8d74-75cdadc4f135\") " pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:05.179250 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:05.179240    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:05.179370 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:05.179308    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs podName:4d3d9829-234c-45ed-8d74-75cdadc4f135 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:07.179286643 +0000 UTC m=+6.589951280 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs") pod "network-metrics-daemon-txtpm" (UID: "4d3d9829-234c-45ed-8d74-75cdadc4f135") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:05.179823 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:05.179802    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 15:51:05.179936 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:05.179828    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 15:51:05.179936 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:05.179841    2562 projected.go:196] Error preparing data for projected volume kube-api-access-9zm8p for pod openshift-network-diagnostics/network-check-target-mq6mh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:05.179936 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:05.179891    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p podName:357f648e-a202-4a71-a7ea-ffdd1c250bff nodeName:}" failed. No retries permitted until 2026-07-08 15:51:07.179874839 +0000 UTC m=+6.590539475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zm8p" (UniqueName: "kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p") pod "network-check-target-mq6mh" (UID: "357f648e-a202-4a71-a7ea-ffdd1c250bff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:05.504795 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:05.504671    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 15:46:04 +0000 UTC" deadline="2028-01-05 10:03:32.254886749 +0000 UTC"
Jul 08 15:51:05.504795 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:05.504740    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13098h12m26.750150758s"
Jul 08 15:51:05.612174 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:05.612136    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:05.612369 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:05.612287    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:05.612781 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:05.612755    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:05.612921 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:05.612869    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:06.614900 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:06.614844    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:06.615477 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:06.614999    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:07.095128 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:07.095037    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret\") pod \"global-pull-secret-syncer-fwvjs\" (UID: \"80295698-bf83-4342-a954-7491ebe64be9\") " pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:07.095295 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:07.095223    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:07.095295 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:07.095293    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret podName:80295698-bf83-4342-a954-7491ebe64be9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:11.095270714 +0000 UTC m=+10.505935351 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret") pod "global-pull-secret-syncer-fwvjs" (UID: "80295698-bf83-4342-a954-7491ebe64be9") : object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:07.196852 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:07.195984    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zm8p\" (UniqueName: \"kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p\") pod \"network-check-target-mq6mh\" (UID: \"357f648e-a202-4a71-a7ea-ffdd1c250bff\") " pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:07.196852 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:07.196059    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs\") pod \"network-metrics-daemon-txtpm\" (UID: \"4d3d9829-234c-45ed-8d74-75cdadc4f135\") " pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:07.196852 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:07.196219    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:07.196852 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:07.196285    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs podName:4d3d9829-234c-45ed-8d74-75cdadc4f135 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:11.196264463 +0000 UTC m=+10.606929125 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs") pod "network-metrics-daemon-txtpm" (UID: "4d3d9829-234c-45ed-8d74-75cdadc4f135") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:07.196852 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:07.196730    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 15:51:07.196852 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:07.196749    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 15:51:07.196852 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:07.196764    2562 projected.go:196] Error preparing data for projected volume kube-api-access-9zm8p for pod openshift-network-diagnostics/network-check-target-mq6mh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:07.196852 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:07.196810    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p podName:357f648e-a202-4a71-a7ea-ffdd1c250bff nodeName:}" failed. No retries permitted until 2026-07-08 15:51:11.196794207 +0000 UTC m=+10.607458867 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zm8p" (UniqueName: "kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p") pod "network-check-target-mq6mh" (UID: "357f648e-a202-4a71-a7ea-ffdd1c250bff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:07.611756 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:07.611722    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:07.611958 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:07.611859    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:07.611958 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:07.611886    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:07.612085 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:07.611971    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:08.611626 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:08.611566    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:08.612139 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:08.611751    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:09.611889 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:09.611845    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:09.612397 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:09.611904    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:09.612397 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:09.611999    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:09.612397 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:09.612195    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:10.612564 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:10.612526    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:10.613126 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:10.612705    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:11.127740 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:11.127632    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret\") pod \"global-pull-secret-syncer-fwvjs\" (UID: \"80295698-bf83-4342-a954-7491ebe64be9\") " pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:11.127959 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:11.127819    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:11.127959 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:11.127907    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret podName:80295698-bf83-4342-a954-7491ebe64be9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:19.127883477 +0000 UTC m=+18.538548114 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret") pod "global-pull-secret-syncer-fwvjs" (UID: "80295698-bf83-4342-a954-7491ebe64be9") : object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:11.228170 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:11.228110    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zm8p\" (UniqueName: \"kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p\") pod \"network-check-target-mq6mh\" (UID: \"357f648e-a202-4a71-a7ea-ffdd1c250bff\") " pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:11.228364 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:11.228185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs\") pod \"network-metrics-daemon-txtpm\" (UID: \"4d3d9829-234c-45ed-8d74-75cdadc4f135\") " pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:11.228364 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:11.228328    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:11.228465 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:11.228394    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs podName:4d3d9829-234c-45ed-8d74-75cdadc4f135 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:19.228374248 +0000 UTC m=+18.639038885 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs") pod "network-metrics-daemon-txtpm" (UID: "4d3d9829-234c-45ed-8d74-75cdadc4f135") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:11.228883 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:11.228842    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 15:51:11.228883 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:11.228869    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 15:51:11.228883 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:11.228883    2562 projected.go:196] Error preparing data for projected volume kube-api-access-9zm8p for pod openshift-network-diagnostics/network-check-target-mq6mh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:11.229156 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:11.228938    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p podName:357f648e-a202-4a71-a7ea-ffdd1c250bff nodeName:}" failed. No retries permitted until 2026-07-08 15:51:19.228921371 +0000 UTC m=+18.639586004 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zm8p" (UniqueName: "kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p") pod "network-check-target-mq6mh" (UID: "357f648e-a202-4a71-a7ea-ffdd1c250bff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:11.611566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:11.611467    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:11.611566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:11.611492    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:11.611781 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:11.611636    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:11.611836 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:11.611780    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:12.613194 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:12.612384    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:12.613194 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:12.612514    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:13.611974 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:13.611936    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:13.612177 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:13.611955    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:13.612177 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:13.612074    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:13.612177 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:13.612166    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:14.611335 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:14.611296    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:14.611822 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:14.611438    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:15.611311 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:15.611278    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:15.611420 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:15.611400    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:15.611709 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:15.611396    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:15.611709 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:15.611652    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:16.611846 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:16.611814    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:16.612296 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:16.611962    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:17.611382 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:17.611344    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:17.611382 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:17.611388    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:17.611649 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:17.611467    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:17.611649 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:17.611610    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:18.612135 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:18.612097    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:18.612636 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:18.612256    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:19.189825 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:19.189790    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret\") pod \"global-pull-secret-syncer-fwvjs\" (UID: \"80295698-bf83-4342-a954-7491ebe64be9\") " pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:19.190020 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:19.189931    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:19.190020 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:19.190000    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret podName:80295698-bf83-4342-a954-7491ebe64be9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:35.18998233 +0000 UTC m=+34.600646962 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret") pod "global-pull-secret-syncer-fwvjs" (UID: "80295698-bf83-4342-a954-7491ebe64be9") : object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:19.290864 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:19.290831    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zm8p\" (UniqueName: \"kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p\") pod \"network-check-target-mq6mh\" (UID: \"357f648e-a202-4a71-a7ea-ffdd1c250bff\") " pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:19.291017 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:19.290877    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs\") pod \"network-metrics-daemon-txtpm\" (UID: \"4d3d9829-234c-45ed-8d74-75cdadc4f135\") " pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:19.291017 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:19.290995    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:19.291017 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:19.291003    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 15:51:19.291116 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:19.291022    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 15:51:19.291116 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:19.291034    2562 projected.go:196] Error preparing data for projected volume kube-api-access-9zm8p for pod openshift-network-diagnostics/network-check-target-mq6mh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:19.291116 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:19.291059    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs podName:4d3d9829-234c-45ed-8d74-75cdadc4f135 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:35.291041871 +0000 UTC m=+34.701706507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs") pod "network-metrics-daemon-txtpm" (UID: "4d3d9829-234c-45ed-8d74-75cdadc4f135") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:19.291116 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:19.291076    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p podName:357f648e-a202-4a71-a7ea-ffdd1c250bff nodeName:}" failed. No retries permitted until 2026-07-08 15:51:35.29106717 +0000 UTC m=+34.701731805 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zm8p" (UniqueName: "kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p") pod "network-check-target-mq6mh" (UID: "357f648e-a202-4a71-a7ea-ffdd1c250bff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:19.612201 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:19.612109    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:19.612201 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:19.612156    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:19.612722 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:19.612244    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:19.612722 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:19.612372    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:20.612122 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:20.612087    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:20.612318 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:20.612236    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:21.611760 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:21.611722    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:21.611933 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:21.611726    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:21.611933 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:21.611841    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:21.611933 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:21.611900    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:22.612592 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:22.612543    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:22.613029 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:22.612696    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:23.612005 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:23.611970    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:23.612154 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:23.611981    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:23.612154 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:23.612088    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:23.612154 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:23.612132    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:24.612170 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:24.611765    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:24.612758 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:24.612295    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:24.752079 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:24.752043    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rmjrs" event={"ID":"ca7334d7-2933-491d-a1e2-5a9b5dbd323c","Type":"ContainerStarted","Data":"100e73933c0d779dbb53841e04be2b062a7ab31bd99fdddee18059691d3569e5"}
Jul 08 15:51:24.756948 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:24.756232    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66" event={"ID":"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d","Type":"ContainerStarted","Data":"378a8351d42bdd2d23fe06ad1834bdb66d200d37db6a18832a106fba6aa6d07a"}
Jul 08 15:51:24.756948 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:24.756314    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66" event={"ID":"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d","Type":"ContainerStarted","Data":"949d53a8c1a93c3ea0524233d941968c4e39c5b36a1127a3d4055c53e82e20db"}
Jul 08 15:51:24.756948 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:24.756368    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66" event={"ID":"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d","Type":"ContainerStarted","Data":"0158ac65af8896d1a5d6d9746f39dad621ce27348071691e8e93bd973590131e"}
Jul 08 15:51:24.756948 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:24.756416    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66" event={"ID":"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d","Type":"ContainerStarted","Data":"28d035116be3c3524764177439263e316643c2584eab3138025a6bd9be2f2cd8"}
Jul 08 15:51:24.756948 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:24.756464    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66" event={"ID":"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d","Type":"ContainerStarted","Data":"9da3943462082e3fa242a673c5010d497416511c6eedf934b02cb61512581420"}
Jul 08 15:51:24.759652 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:24.759543    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c6n6c" event={"ID":"e9d30797-cfba-491d-bce8-bc3501219625","Type":"ContainerStarted","Data":"12ccc930d172b1aacdd5a35c54ea1c36f942865db4d79edbe3b78d411b77730f"}
Jul 08 15:51:24.763743 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:24.763384    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-108.ec2.internal" event={"ID":"f22ba0b68e3ed2da157c9fd0e9361669","Type":"ContainerStarted","Data":"c5b937ff21f588a08d92c2960ff152b4336c6d31836efc6f349b9d0595c57252"}
Jul 08 15:51:24.773922 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:24.773879    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rmjrs" podStartSLOduration=1.551363144 podStartE2EDuration="21.773864611s" totalImagesPullingTime="20.222501467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:24.773499884 +0000 UTC m=+24.184164539" watchObservedRunningTime="2026-07-08 15:51:24.773864611 +0000 UTC m=+24.184529276"
Jul 08 15:51:24.793403 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:24.791911    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-108.ec2.internal" podStartSLOduration=20.791892479 podStartE2EDuration="20.791892479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:24.791294278 +0000 UTC m=+24.201958938" watchObservedRunningTime="2026-07-08 15:51:24.791892479 +0000 UTC m=+24.202557146"
Jul 08 15:51:24.810461 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:24.810407    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c6n6c" podStartSLOduration=1.576903299 podStartE2EDuration="21.810385585s" totalImagesPullingTime="20.233482286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:24.809485859 +0000 UTC m=+24.220150512" watchObservedRunningTime="2026-07-08 15:51:24.810385585 +0000 UTC m=+24.221050240"
Jul 08 15:51:25.611648 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:25.611616    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:25.611862 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:25.611734    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:25.611862 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:25.611811    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:25.612007 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:25.611899    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:25.767309 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:25.767191    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk" event={"ID":"b3a835a9-b28a-4cca-afac-7e1e370602e2","Type":"ContainerStarted","Data":"ca7dcd6c51eed175f18ee2d89703115d531acb9590770c6f293e65c0a5d21a74"}
Jul 08 15:51:25.768929 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:25.768900    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5thr2" event={"ID":"39598e1b-be56-4383-816d-e36a823de7a7","Type":"ContainerStarted","Data":"e7b23af3d7a6e99c43102f2b7657ffa6f26c146dcb3cfdb5727b245bd967d3a6"}
Jul 08 15:51:25.770728 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:25.770676    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sz4pg" event={"ID":"18c2c4bb-6bff-464c-8908-feb288405da4","Type":"ContainerStarted","Data":"195ce8d676a53929d9cd40b984344aa1d137bdd8db79179877dfe1b4618996b6"}
Jul 08 15:51:25.772481 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:25.772456    2562 generic.go:356] "Generic (PLEG): container finished" podID="33628d14-fa4a-4bba-8f64-8e7e4b93bbb9" containerID="eebfd279c1ae2cfe163677e338d0e5de76220976ee9b633e27883e575ed86b81" exitCode=0
Jul 08 15:51:25.772619 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:25.772521    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xkqh" event={"ID":"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9","Type":"ContainerDied","Data":"eebfd279c1ae2cfe163677e338d0e5de76220976ee9b633e27883e575ed86b81"}
Jul 08 15:51:25.774271 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:25.774251    2562 generic.go:356] "Generic (PLEG): container finished" podID="657a9ac6d5e82faef8a6d88ba6433a58" containerID="e7ecf9b00758cbc1f94f4192f4a6cc123d70bbf151ef33fa1b0e323979a2ecd2" exitCode=0
Jul 08 15:51:25.774418 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:25.774403    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal" event={"ID":"657a9ac6d5e82faef8a6d88ba6433a58","Type":"ContainerDied","Data":"e7ecf9b00758cbc1f94f4192f4a6cc123d70bbf151ef33fa1b0e323979a2ecd2"}
Jul 08 15:51:25.778014 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:25.777980    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66" event={"ID":"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d","Type":"ContainerStarted","Data":"c84e00b12e804c9e3dd33b8be51f4648d6f3a26f7cf273df5480446ae21e1f83"}
Jul 08 15:51:25.779634 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:25.779612    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-287gc" event={"ID":"f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7","Type":"ContainerStarted","Data":"6abd201b023066066c4fd38f22363f382d27f1d4edd548b8bcebcd8739355d59"}
Jul 08 15:51:25.781186 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:25.781145    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5m9q9" event={"ID":"35d153c0-3c55-4eea-af1d-6f0dfc498243","Type":"ContainerStarted","Data":"24e46826fa3fa3a8cd59388746de841e31a3960adc115ffc23be1af62bacac49"}
Jul 08 15:51:25.784920 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:25.784873    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5thr2" podStartSLOduration=1.301627384 podStartE2EDuration="22.78485703s" totalImagesPullingTime="21.483229646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-08 15:51:25.784616873 +0000 UTC m=+25.195281528" watchObservedRunningTime="2026-07-08 15:51:25.78485703 +0000 UTC m=+25.195521687"
Jul 08 15:51:25.851052 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:25.851006    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5m9q9" podStartSLOduration=7.390938705 podStartE2EDuration="22.850989029s" totalImagesPullingTime="15.460050324s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:25.835794914 +0000 UTC m=+25.246459568" watchObservedRunningTime="2026-07-08 15:51:25.850989029 +0000 UTC m=+25.261653688"
Jul 08 15:51:25.851202 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:25.851092    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-287gc" podStartSLOduration=2.668853694 podStartE2EDuration="22.851083749s" totalImagesPullingTime="20.182230055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:25.850560453 +0000 UTC m=+25.261225106" watchObservedRunningTime="2026-07-08 15:51:25.851083749 +0000 UTC m=+25.261748404"
Jul 08 15:51:26.344051 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:26.344028    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 08 15:51:26.534374 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:26.534214    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T15:51:26.344046252Z","UUID":"73481833-34ae-49f0-afca-f193febc1276","Handler":null,"Name":"","Endpoint":""}
Jul 08 15:51:26.535900 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:26.535878    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 08 15:51:26.536016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:26.535924    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 08 15:51:26.611677 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:26.611644    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:26.611955 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:26.611755    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:26.785453 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:26.785370    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal" event={"ID":"657a9ac6d5e82faef8a6d88ba6433a58","Type":"ContainerStarted","Data":"b22ff1775e0a95c6bd41c129bbf01e0ab6c91c16b1c50bc0ce0537f494254c1a"}
Jul 08 15:51:26.787514 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:26.787486    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk" event={"ID":"b3a835a9-b28a-4cca-afac-7e1e370602e2","Type":"ContainerStarted","Data":"696e50445b494ead11c22ddd63292b5ecc8a6ded18d2c1580be744e56ddf98fd"}
Jul 08 15:51:26.804993 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:26.803401    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-108.ec2.internal" podStartSLOduration=22.803381886 podStartE2EDuration="22.803381886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:26.803317795 +0000 UTC m=+26.213982457" watchObservedRunningTime="2026-07-08 15:51:26.803381886 +0000 UTC m=+26.214046541"
Jul 08 15:51:26.804993 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:26.803787    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sz4pg" podStartSLOduration=3.646005485 podStartE2EDuration="23.803777014s" totalImagesPullingTime="20.157771529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:25.866900578 +0000 UTC m=+25.277565233" watchObservedRunningTime="2026-07-08 15:51:26.803777014 +0000 UTC m=+26.214441671"
Jul 08 15:51:27.611283 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:27.611207    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:27.611435 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:27.611208    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:27.611435 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:27.611314    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:27.611435 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:27.611381    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:27.795845 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:27.795811    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66" event={"ID":"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d","Type":"ContainerStarted","Data":"ec05d2ff31e32c67969fde2e4b9ab7e9edf1778eac42d55c28cd5e1f46d7cbf6"}
Jul 08 15:51:28.331323 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:28.331289    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5thr2"
Jul 08 15:51:28.331998 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:28.331979    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5thr2"
Jul 08 15:51:28.612189 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:28.612110    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:28.612352 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:28.612255    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:28.799381 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:28.799349    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk" event={"ID":"b3a835a9-b28a-4cca-afac-7e1e370602e2","Type":"ContainerStarted","Data":"07dac1e307902ed664ef620fb55c6de34e7d944d831a6989158a6fe7304472c7"}
Jul 08 15:51:28.799821 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:28.799519    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5thr2"
Jul 08 15:51:28.800028 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:28.800013    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5thr2"
Jul 08 15:51:28.819879 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:28.819827    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tdhfk" podStartSLOduration=2.743403486 podStartE2EDuration="25.819808761s" totalImagesPullingTime="23.076405275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:28.819198444 +0000 UTC m=+28.229863098" watchObservedRunningTime="2026-07-08 15:51:28.819808761 +0000 UTC m=+28.230473416"
Jul 08 15:51:29.612138 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:29.611913    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:29.612293 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:29.611913    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:29.612293 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:29.612261    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:29.612400 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:29.612323    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:29.804448 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:29.804359    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66" event={"ID":"87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d","Type":"ContainerStarted","Data":"1dda332bc1b2ce2cde0ad96bb11ed0c29f5b153d995153835ccf632281b9ec0e"}
Jul 08 15:51:29.835445 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:29.835379    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66" podStartSLOduration=6.591196726 podStartE2EDuration="26.83536021s" totalImagesPullingTime="20.244163484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:29.835295061 +0000 UTC m=+29.245959716" watchObservedRunningTime="2026-07-08 15:51:29.83536021 +0000 UTC m=+29.246024865"
Jul 08 15:51:30.611287 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:30.611256    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:30.611467 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:30.611390    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:30.807401 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:30.807363    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:30.807917 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:30.807454    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:30.807917 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:30.807506    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:30.824012 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:30.823982    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:30.824298 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:30.824277    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:51:31.611316 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:31.611282    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:31.611466 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:31.611413    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:31.611466 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:31.611452    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:31.611573 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:31.611524    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:31.808792 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:31.808553    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fwvjs"]
Jul 08 15:51:31.809250 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:31.808953    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:31.809250 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:31.809037    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:31.809250 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:31.809155    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mq6mh"]
Jul 08 15:51:31.809368 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:31.809289    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:31.809400 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:31.809365    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:31.810688 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:31.810665    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-txtpm"]
Jul 08 15:51:31.810809 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:31.810735    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:31.810866 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:31.810813    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:32.812771 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:32.812732    2562 generic.go:356] "Generic (PLEG): container finished" podID="33628d14-fa4a-4bba-8f64-8e7e4b93bbb9" containerID="0286e7d1dd6778241a80c52c0563c1c91da16c51036232dd2f499c99ef3619a5" exitCode=0
Jul 08 15:51:32.813125 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:32.812813    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xkqh" event={"ID":"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9","Type":"ContainerDied","Data":"0286e7d1dd6778241a80c52c0563c1c91da16c51036232dd2f499c99ef3619a5"}
Jul 08 15:51:33.612078 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:33.611968    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:33.612261 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:33.612097    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:33.612261 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:33.611968    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:33.612386 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:33.611968    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:33.612386 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:33.612279    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:33.612531 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:33.612379    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:34.711536 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:34.711490    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:34.820269 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:34.820236    2562 generic.go:356] "Generic (PLEG): container finished" podID="33628d14-fa4a-4bba-8f64-8e7e4b93bbb9" containerID="18939fcd6d867d1191b04917b31797e45e7f59aa19adaa473cb8b761652e28e2" exitCode=0
Jul 08 15:51:34.820425 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:34.820289    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xkqh" event={"ID":"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9","Type":"ContainerDied","Data":"18939fcd6d867d1191b04917b31797e45e7f59aa19adaa473cb8b761652e28e2"}
Jul 08 15:51:34.999895 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:34.999817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:35.075979 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:35.075952    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:35.208087 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:35.208048    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret\") pod \"global-pull-secret-syncer-fwvjs\" (UID: \"80295698-bf83-4342-a954-7491ebe64be9\") " pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:35.208224 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:35.208190    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:35.208282 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:35.208250    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret podName:80295698-bf83-4342-a954-7491ebe64be9 nodeName:}" failed. No retries permitted until 2026-07-08 15:52:07.208235444 +0000 UTC m=+66.618900075 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret") pod "global-pull-secret-syncer-fwvjs" (UID: "80295698-bf83-4342-a954-7491ebe64be9") : object "kube-system"/"original-pull-secret" not registered
Jul 08 15:51:35.309413 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:35.309366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zm8p\" (UniqueName: \"kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p\") pod \"network-check-target-mq6mh\" (UID: \"357f648e-a202-4a71-a7ea-ffdd1c250bff\") " pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:35.309559 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:35.309423    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs\") pod \"network-metrics-daemon-txtpm\" (UID: \"4d3d9829-234c-45ed-8d74-75cdadc4f135\") " pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:35.309559 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:35.309516    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:35.309559 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:35.309524    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 08 15:51:35.309559 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:35.309544    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 08 15:51:35.309559 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:35.309554    2562 projected.go:196] Error preparing data for projected volume kube-api-access-9zm8p for pod openshift-network-diagnostics/network-check-target-mq6mh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:35.309749 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:35.309571    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs podName:4d3d9829-234c-45ed-8d74-75cdadc4f135 nodeName:}" failed. No retries permitted until 2026-07-08 15:52:07.309557669 +0000 UTC m=+66.720222302 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs") pod "network-metrics-daemon-txtpm" (UID: "4d3d9829-234c-45ed-8d74-75cdadc4f135") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 08 15:51:35.309749 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:35.309615    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p podName:357f648e-a202-4a71-a7ea-ffdd1c250bff nodeName:}" failed. No retries permitted until 2026-07-08 15:52:07.309599818 +0000 UTC m=+66.720264451 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zm8p" (UniqueName: "kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p") pod "network-check-target-mq6mh" (UID: "357f648e-a202-4a71-a7ea-ffdd1c250bff") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 08 15:51:35.611533 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:35.611499    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:35.611726 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:35.611504    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:35.611726 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:35.611650    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:35.611726 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:35.611504    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:35.611887 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:35.611737    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:35.611887 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:35.611764    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:35.824968 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:35.824879    2562 generic.go:356] "Generic (PLEG): container finished" podID="33628d14-fa4a-4bba-8f64-8e7e4b93bbb9" containerID="faf6182ad9f7abbb9e26fe16f07656a0b18f36f73e3438596673e32f2b0c4757" exitCode=0
Jul 08 15:51:35.824968 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:35.824921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xkqh" event={"ID":"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9","Type":"ContainerDied","Data":"faf6182ad9f7abbb9e26fe16f07656a0b18f36f73e3438596673e32f2b0c4757"}
Jul 08 15:51:37.611713 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.611672    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:37.612209 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:37.611788    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mq6mh" podUID="357f648e-a202-4a71-a7ea-ffdd1c250bff"
Jul 08 15:51:37.612209 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.611689    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:37.612209 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.611821    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:37.612209 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:37.611939    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-txtpm" podUID="4d3d9829-234c-45ed-8d74-75cdadc4f135"
Jul 08 15:51:37.612209 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:37.612034    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fwvjs" podUID="80295698-bf83-4342-a954-7491ebe64be9"
Jul 08 15:51:37.830267 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.830198    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-108.ec2.internal" event="NodeReady"
Jul 08 15:51:37.830423 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.830320    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 08 15:51:37.884769 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.884736    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kn9t5"]
Jul 08 15:51:37.886487 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.886462    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n85j9"]
Jul 08 15:51:37.886647 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.886607    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kn9t5"
Jul 08 15:51:37.888559 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.888537    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74f65cff65-tj9wh"]
Jul 08 15:51:37.888746 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.888679    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n85j9"
Jul 08 15:51:37.889711 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.889673    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 08 15:51:37.889814 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.889780    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 08 15:51:37.890062 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.889997    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-68mn7\""
Jul 08 15:51:37.890172 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.890075    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:37.890172 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.890091    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 08 15:51:37.891081 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.891066    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 08 15:51:37.891302 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.891277    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 08 15:51:37.891429 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.891287    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mjhcc\""
Jul 08 15:51:37.892691 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.892673    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 08 15:51:37.892843 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.892710    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 08 15:51:37.893086 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.893066    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rpkvs\""
Jul 08 15:51:37.895976 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.895954    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 08 15:51:37.902972 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.902893    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kn9t5"]
Jul 08 15:51:37.905507 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.905456    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n85j9"]
Jul 08 15:51:37.916608 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.916564    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 08 15:51:37.916865 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:37.916844    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74f65cff65-tj9wh"]
Jul 08 15:51:38.031063 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.031028    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-certificates\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.031063 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.031063    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-bound-sa-token\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.031331 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.031091    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q265j\" (UniqueName: \"kubernetes.io/projected/eb8acfc6-62bf-4756-afcc-156d78e816d7-kube-api-access-q265j\") pod \"ingress-canary-kn9t5\" (UID: \"eb8acfc6-62bf-4756-afcc-156d78e816d7\") " pod="openshift-ingress-canary/ingress-canary-kn9t5"
Jul 08 15:51:38.031331 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.031155    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5da4aec-b067-4797-8bf1-902ca6f8685b-trusted-ca\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.031331 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.031187    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7dll\" (UniqueName: \"kubernetes.io/projected/2e25c91b-8570-40e1-b46f-02c99f5d4f47-kube-api-access-n7dll\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:51:38.031331 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.031208    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9bh6\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-kube-api-access-j9bh6\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.031331 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.031241    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2e25c91b-8570-40e1-b46f-02c99f5d4f47-config-volume\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:51:38.031331 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.031260    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:51:38.031331 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.031280    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5da4aec-b067-4797-8bf1-902ca6f8685b-installation-pull-secrets\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.031656 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.031402    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb8acfc6-62bf-4756-afcc-156d78e816d7-cert\") pod \"ingress-canary-kn9t5\" (UID: \"eb8acfc6-62bf-4756-afcc-156d78e816d7\") " pod="openshift-ingress-canary/ingress-canary-kn9t5"
Jul 08 15:51:38.031656 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.031433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5da4aec-b067-4797-8bf1-902ca6f8685b-image-registry-private-configuration\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.031656 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.031460    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5da4aec-b067-4797-8bf1-902ca6f8685b-ca-trust-extracted\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.031656 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.031491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e25c91b-8570-40e1-b46f-02c99f5d4f47-tmp-dir\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:51:38.031656 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.031518    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.132916 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.132844    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9bh6\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-kube-api-access-j9bh6\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.132916 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.132886    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2e25c91b-8570-40e1-b46f-02c99f5d4f47-config-volume\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:51:38.132916 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.132916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:51:38.133178 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.132946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5da4aec-b067-4797-8bf1-902ca6f8685b-installation-pull-secrets\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.133178 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:38.133060    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 15:51:38.133178 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.133111    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb8acfc6-62bf-4756-afcc-156d78e816d7-cert\") pod \"ingress-canary-kn9t5\" (UID: \"eb8acfc6-62bf-4756-afcc-156d78e816d7\") " pod="openshift-ingress-canary/ingress-canary-kn9t5"
Jul 08 15:51:38.133178 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:38.133133    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls podName:2e25c91b-8570-40e1-b46f-02c99f5d4f47 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:38.633116586 +0000 UTC m=+38.043781218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls") pod "dns-default-n85j9" (UID: "2e25c91b-8570-40e1-b46f-02c99f5d4f47") : secret "dns-default-metrics-tls" not found
Jul 08 15:51:38.133178 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.133157    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5da4aec-b067-4797-8bf1-902ca6f8685b-image-registry-private-configuration\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.133439 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.133183    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5da4aec-b067-4797-8bf1-902ca6f8685b-ca-trust-extracted\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.133439 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.133250    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e25c91b-8570-40e1-b46f-02c99f5d4f47-tmp-dir\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:51:38.133439 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.133280    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.133611 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.133309    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-certificates\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.133611 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.133546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-bound-sa-token\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.133611 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.133555    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2e25c91b-8570-40e1-b46f-02c99f5d4f47-config-volume\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:51:38.133611 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.133600    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q265j\" (UniqueName: \"kubernetes.io/projected/eb8acfc6-62bf-4756-afcc-156d78e816d7-kube-api-access-q265j\") pod \"ingress-canary-kn9t5\" (UID: \"eb8acfc6-62bf-4756-afcc-156d78e816d7\") " pod="openshift-ingress-canary/ingress-canary-kn9t5"
Jul 08 15:51:38.133813 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.133629    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5da4aec-b067-4797-8bf1-902ca6f8685b-ca-trust-extracted\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.133813 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.133634    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5da4aec-b067-4797-8bf1-902ca6f8685b-trusted-ca\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.133813 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.133610    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e25c91b-8570-40e1-b46f-02c99f5d4f47-tmp-dir\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:51:38.133813 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:38.133690    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 15:51:38.133813 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:38.133707    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74f65cff65-tj9wh: secret "image-registry-tls" not found
Jul 08 15:51:38.133813 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:38.133752    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls podName:d5da4aec-b067-4797-8bf1-902ca6f8685b nodeName:}" failed. No retries permitted until 2026-07-08 15:51:38.633736436 +0000 UTC m=+38.044401092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls") pod "image-registry-74f65cff65-tj9wh" (UID: "d5da4aec-b067-4797-8bf1-902ca6f8685b") : secret "image-registry-tls" not found
Jul 08 15:51:38.134096 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.133878    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7dll\" (UniqueName: \"kubernetes.io/projected/2e25c91b-8570-40e1-b46f-02c99f5d4f47-kube-api-access-n7dll\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:51:38.134396 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.134369    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-certificates\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.134656 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.134628    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5da4aec-b067-4797-8bf1-902ca6f8685b-trusted-ca\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.137735 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.137716    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5da4aec-b067-4797-8bf1-902ca6f8685b-installation-pull-secrets\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.137841 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.137748    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5da4aec-b067-4797-8bf1-902ca6f8685b-image-registry-private-configuration\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.137841 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.137758    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb8acfc6-62bf-4756-afcc-156d78e816d7-cert\") pod \"ingress-canary-kn9t5\" (UID: \"eb8acfc6-62bf-4756-afcc-156d78e816d7\") " pod="openshift-ingress-canary/ingress-canary-kn9t5"
Jul 08 15:51:38.144105 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.144077    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7dll\" (UniqueName: \"kubernetes.io/projected/2e25c91b-8570-40e1-b46f-02c99f5d4f47-kube-api-access-n7dll\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:51:38.145453 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.145430    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q265j\" (UniqueName: \"kubernetes.io/projected/eb8acfc6-62bf-4756-afcc-156d78e816d7-kube-api-access-q265j\") pod \"ingress-canary-kn9t5\" (UID: \"eb8acfc6-62bf-4756-afcc-156d78e816d7\") " pod="openshift-ingress-canary/ingress-canary-kn9t5"
Jul 08 15:51:38.145552 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.145481    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9bh6\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-kube-api-access-j9bh6\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.145892 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.145871    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-bound-sa-token\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.200008 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.199971    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kn9t5"
Jul 08 15:51:38.342917 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.342884    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kn9t5"]
Jul 08 15:51:38.346400 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:38.346370    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8acfc6_62bf_4756_afcc_156d78e816d7.slice/crio-37817f4eae54d168dfe6d64eff3fad0c0ce650c9dd8fd7448226fcf91315aee9 WatchSource:0}: Error finding container 37817f4eae54d168dfe6d64eff3fad0c0ce650c9dd8fd7448226fcf91315aee9: Status 404 returned error can't find the container with id 37817f4eae54d168dfe6d64eff3fad0c0ce650c9dd8fd7448226fcf91315aee9
Jul 08 15:51:38.638470 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.638434    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:38.639018 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.638499    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:51:38.639018 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:38.638606    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 15:51:38.639018 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:38.638626    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74f65cff65-tj9wh: secret "image-registry-tls" not found
Jul 08 15:51:38.639018 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:38.638632    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 15:51:38.639018 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:38.638692    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls podName:d5da4aec-b067-4797-8bf1-902ca6f8685b nodeName:}" failed. No retries permitted until 2026-07-08 15:51:39.638670718 +0000 UTC m=+39.049335356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls") pod "image-registry-74f65cff65-tj9wh" (UID: "d5da4aec-b067-4797-8bf1-902ca6f8685b") : secret "image-registry-tls" not found
Jul 08 15:51:38.639018 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:38.638719    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls podName:2e25c91b-8570-40e1-b46f-02c99f5d4f47 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:39.638709482 +0000 UTC m=+39.049374114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls") pod "dns-default-n85j9" (UID: "2e25c91b-8570-40e1-b46f-02c99f5d4f47") : secret "dns-default-metrics-tls" not found
Jul 08 15:51:38.834121 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:38.834064    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kn9t5" event={"ID":"eb8acfc6-62bf-4756-afcc-156d78e816d7","Type":"ContainerStarted","Data":"37817f4eae54d168dfe6d64eff3fad0c0ce650c9dd8fd7448226fcf91315aee9"}
Jul 08 15:51:39.612166 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:39.612132    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:51:39.612343 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:39.612177    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:51:39.612402 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:39.612360    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:51:39.616529 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:39.616157    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 15:51:39.616529 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:39.616206    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 15:51:39.616529 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:39.616157    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f8k7f\""
Jul 08 15:51:39.616529 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:39.616396    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 15:51:39.616529 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:39.616478    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 15:51:39.616529 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:39.616506    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-24mlw\""
Jul 08 15:51:39.647161 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:39.647136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:39.647540 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:39.647201    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:51:39.647540 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:39.647336    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 15:51:39.647540 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:39.647382    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 15:51:39.647540 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:39.647400    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74f65cff65-tj9wh: secret "image-registry-tls" not found
Jul 08 15:51:39.647540 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:39.647425    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls podName:2e25c91b-8570-40e1-b46f-02c99f5d4f47 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:41.647401757 +0000 UTC m=+41.058066391 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls") pod "dns-default-n85j9" (UID: "2e25c91b-8570-40e1-b46f-02c99f5d4f47") : secret "dns-default-metrics-tls" not found
Jul 08 15:51:39.647540 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:39.647461    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls podName:d5da4aec-b067-4797-8bf1-902ca6f8685b nodeName:}" failed. No retries permitted until 2026-07-08 15:51:41.647445499 +0000 UTC m=+41.058110138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls") pod "image-registry-74f65cff65-tj9wh" (UID: "d5da4aec-b067-4797-8bf1-902ca6f8685b") : secret "image-registry-tls" not found
Jul 08 15:51:41.662562 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:41.662522    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:51:41.663047 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:41.662677    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 15:51:41.663047 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:41.662674    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:41.663047 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:41.662736    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 15:51:41.663047 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:41.662768    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74f65cff65-tj9wh: secret "image-registry-tls" not found
Jul 08 15:51:41.663047 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:41.662741    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls podName:2e25c91b-8570-40e1-b46f-02c99f5d4f47 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:45.662723265 +0000 UTC m=+45.073387909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls") pod "dns-default-n85j9" (UID: "2e25c91b-8570-40e1-b46f-02c99f5d4f47") : secret "dns-default-metrics-tls" not found
Jul 08 15:51:41.663047 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:41.662863    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls podName:d5da4aec-b067-4797-8bf1-902ca6f8685b nodeName:}" failed. No retries permitted until 2026-07-08 15:51:45.662835276 +0000 UTC m=+45.073499911 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls") pod "image-registry-74f65cff65-tj9wh" (UID: "d5da4aec-b067-4797-8bf1-902ca6f8685b") : secret "image-registry-tls" not found
Jul 08 15:51:42.504265 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:42.504237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:42.846473 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:42.846440    2562 generic.go:356] "Generic (PLEG): container finished" podID="33628d14-fa4a-4bba-8f64-8e7e4b93bbb9" containerID="0e1ef439439d6202c535c9f66f6ce4076c9558fe4a4ffe5f08613f7819fc0f19" exitCode=0
Jul 08 15:51:42.846921 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:42.846524    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xkqh" event={"ID":"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9","Type":"ContainerDied","Data":"0e1ef439439d6202c535c9f66f6ce4076c9558fe4a4ffe5f08613f7819fc0f19"}
Jul 08 15:51:42.847932 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:42.847912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kn9t5" event={"ID":"eb8acfc6-62bf-4756-afcc-156d78e816d7","Type":"ContainerStarted","Data":"17ee5757a4639d59170bc04ba2a5475bfd9c6bef7209b476a1ebce18d28b920b"}
Jul 08 15:51:42.886364 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:42.886013    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kn9t5" podStartSLOduration=2.009311279 podStartE2EDuration="5.885993576s" totalImagesPullingTime="3.876682297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:42.885235926 +0000 UTC m=+42.295900582" watchObservedRunningTime="2026-07-08 15:51:42.885993576 +0000 UTC m=+42.296658230"
Jul 08 15:51:43.252572 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:43.252489    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:43.351931 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:43.351899    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:43.682069 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:43.682033    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:43.745814 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:43.745785    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:43.853006 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:43.852974    2562 generic.go:356] "Generic (PLEG): container finished" podID="33628d14-fa4a-4bba-8f64-8e7e4b93bbb9" containerID="34c8f8803832d15ccd4cddd48e4f8cdfa5e92cfae92d78db63a916fbe2da2e1c" exitCode=0
Jul 08 15:51:43.853488 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:43.853058    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xkqh" event={"ID":"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9","Type":"ContainerDied","Data":"34c8f8803832d15ccd4cddd48e4f8cdfa5e92cfae92d78db63a916fbe2da2e1c"}
Jul 08 15:51:44.347461 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.347428    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:44.363406 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.363375    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-dkbqw"]
Jul 08 15:51:44.381640 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.381609    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-dkbqw"]
Jul 08 15:51:44.381761 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.381690    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dkbqw"
Jul 08 15:51:44.384376 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.384353    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 08 15:51:44.384497 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.384404    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 08 15:51:44.384808 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.384788    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7cqwt\""
Jul 08 15:51:44.442098 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.442052    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:44.485135 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.485096    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55ktr\" (UniqueName: \"kubernetes.io/projected/028573ac-1ac9-4b53-8534-d3ca16b6143f-kube-api-access-55ktr\") pod \"migrator-d57d58cc9-dkbqw\" (UID: \"028573ac-1ac9-4b53-8534-d3ca16b6143f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dkbqw"
Jul 08 15:51:44.540022 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.539963    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:44.586200 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.586166    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55ktr\" (UniqueName: \"kubernetes.io/projected/028573ac-1ac9-4b53-8534-d3ca16b6143f-kube-api-access-55ktr\") pod \"migrator-d57d58cc9-dkbqw\" (UID: \"028573ac-1ac9-4b53-8534-d3ca16b6143f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dkbqw"
Jul 08 15:51:44.595358 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.595329    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55ktr\" (UniqueName: \"kubernetes.io/projected/028573ac-1ac9-4b53-8534-d3ca16b6143f-kube-api-access-55ktr\") pod \"migrator-d57d58cc9-dkbqw\" (UID: \"028573ac-1ac9-4b53-8534-d3ca16b6143f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dkbqw"
Jul 08 15:51:44.609173 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.609108    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:44.690811 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.690776    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dkbqw"
Jul 08 15:51:44.831049 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.831023    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-dkbqw"]
Jul 08 15:51:44.833215 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:51:44.833192    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod028573ac_1ac9_4b53_8534_d3ca16b6143f.slice/crio-a39fe5e76e4e3720a18bcc4427d983a2af83ab5e60d16e37937f6e4b4afbfb18 WatchSource:0}: Error finding container a39fe5e76e4e3720a18bcc4427d983a2af83ab5e60d16e37937f6e4b4afbfb18: Status 404 returned error can't find the container with id a39fe5e76e4e3720a18bcc4427d983a2af83ab5e60d16e37937f6e4b4afbfb18
Jul 08 15:51:44.856128 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.856101    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dkbqw" event={"ID":"028573ac-1ac9-4b53-8534-d3ca16b6143f","Type":"ContainerStarted","Data":"a39fe5e76e4e3720a18bcc4427d983a2af83ab5e60d16e37937f6e4b4afbfb18"}
Jul 08 15:51:44.859376 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.859323    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8xkqh" event={"ID":"33628d14-fa4a-4bba-8f64-8e7e4b93bbb9","Type":"ContainerStarted","Data":"6f8618eeb3dab873bde268c854344ee6e6c8f654c0d93d638310390600745ead"}
Jul 08 15:51:44.895373 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:44.895318    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8xkqh" podStartSLOduration=7.416247267 podStartE2EDuration="41.895304392s" totalImagesPullingTime="34.479057125s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:44.893673369 +0000 UTC m=+44.304338022" watchObservedRunningTime="2026-07-08 15:51:44.895304392 +0000 UTC m=+44.305969045"
Jul 08 15:51:45.020159 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.020124    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:45.083516 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.083485    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:45.220553 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.220478    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-cxdfq"]
Jul 08 15:51:45.252812 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.252786    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cxdfq"]
Jul 08 15:51:45.252985 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.252896    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:45.261934 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.261914    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-96wh4\""
Jul 08 15:51:45.262163 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.262149    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 08 15:51:45.262163 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.262152    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 08 15:51:45.262283 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.262180    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 08 15:51:45.265972 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.265956    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 08 15:51:45.295606 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.295566    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:45.391191 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.391160    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:45.391333 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.391197    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:45.391333 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.391217    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/de1a42ce-0b39-419a-a113-6cdc13b00ea9-data-volume\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:45.391333 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.391260    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56ghh\" (UniqueName: \"kubernetes.io/projected/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-api-access-56ghh\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:45.391333 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.391313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/de1a42ce-0b39-419a-a113-6cdc13b00ea9-crio-socket\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:45.402124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.402103    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:45.491973 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.491898    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/de1a42ce-0b39-419a-a113-6cdc13b00ea9-crio-socket\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:45.491973 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.491954    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:45.492118 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:45.492011    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 15:51:45.492118 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.492058    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:45.492118 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:45.492074    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm podName:de1a42ce-0b39-419a-a113-6cdc13b00ea9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:45.992060041 +0000 UTC m=+45.402724673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cxdfq" (UID: "de1a42ce-0b39-419a-a113-6cdc13b00ea9") : configmap "kube-rbac-proxy" not found
Jul 08 15:51:45.492118 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.492094    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/de1a42ce-0b39-419a-a113-6cdc13b00ea9-data-volume\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:45.492118 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.492100    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/de1a42ce-0b39-419a-a113-6cdc13b00ea9-crio-socket\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:45.492263 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.492119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56ghh\" (UniqueName: \"kubernetes.io/projected/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-api-access-56ghh\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:45.492263 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:45.492147    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:45.492263 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:45.492208    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls podName:de1a42ce-0b39-419a-a113-6cdc13b00ea9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:45.992190736 +0000 UTC m=+45.402855382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cxdfq" (UID: "de1a42ce-0b39-419a-a113-6cdc13b00ea9") : secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:45.492430 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.492413    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/de1a42ce-0b39-419a-a113-6cdc13b00ea9-data-volume\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:45.500463 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.500440    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56ghh\" (UniqueName: \"kubernetes.io/projected/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-api-access-56ghh\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:45.694184 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.694145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:51:45.694368 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.694218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:45.694368 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:45.694315    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 15:51:45.694368 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:45.694339    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 15:51:45.694368 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:45.694351    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74f65cff65-tj9wh: secret "image-registry-tls" not found
Jul 08 15:51:45.694569 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:45.694404    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls podName:2e25c91b-8570-40e1-b46f-02c99f5d4f47 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:53.694384466 +0000 UTC m=+53.105049115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls") pod "dns-default-n85j9" (UID: "2e25c91b-8570-40e1-b46f-02c99f5d4f47") : secret "dns-default-metrics-tls" not found
Jul 08 15:51:45.694569 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:45.694425    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls podName:d5da4aec-b067-4797-8bf1-902ca6f8685b nodeName:}" failed. No retries permitted until 2026-07-08 15:51:53.694416985 +0000 UTC m=+53.105081617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls") pod "image-registry-74f65cff65-tj9wh" (UID: "d5da4aec-b067-4797-8bf1-902ca6f8685b") : secret "image-registry-tls" not found
Jul 08 15:51:45.996305 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.996264    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:45.996776 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:45.996335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:45.996776 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:45.996411    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 15:51:45.996776 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:45.996487    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm podName:de1a42ce-0b39-419a-a113-6cdc13b00ea9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:46.996465353 +0000 UTC m=+46.407129986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cxdfq" (UID: "de1a42ce-0b39-419a-a113-6cdc13b00ea9") : configmap "kube-rbac-proxy" not found
Jul 08 15:51:45.996776 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:45.996535    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:45.996776 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:45.996607    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls podName:de1a42ce-0b39-419a-a113-6cdc13b00ea9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:46.99657565 +0000 UTC m=+46.407240297 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cxdfq" (UID: "de1a42ce-0b39-419a-a113-6cdc13b00ea9") : secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:46.865256 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:46.865230    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dkbqw" event={"ID":"028573ac-1ac9-4b53-8534-d3ca16b6143f","Type":"ContainerStarted","Data":"4f69d5cc6146926a4ec746dcf80b1fb4944a1df4f0547fef008d5e0c6b6d5d12"}
Jul 08 15:51:46.893345 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:46.893316    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:46.948939 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:46.948913    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:47.003251 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:47.003224    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:47.003555 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:47.003264    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:47.003555 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:47.003338    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 15:51:47.003555 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:47.003361    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:47.003555 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:47.003396    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm podName:de1a42ce-0b39-419a-a113-6cdc13b00ea9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:49.003380078 +0000 UTC m=+48.414044709 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cxdfq" (UID: "de1a42ce-0b39-419a-a113-6cdc13b00ea9") : configmap "kube-rbac-proxy" not found
Jul 08 15:51:47.003555 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:47.003410    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls podName:de1a42ce-0b39-419a-a113-6cdc13b00ea9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:49.003404303 +0000 UTC m=+48.414068934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cxdfq" (UID: "de1a42ce-0b39-419a-a113-6cdc13b00ea9") : secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:47.410289 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:47.410263    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5m9q9_35d153c0-3c55-4eea-af1d-6f0dfc498243/dns-node-resolver/0.log"
Jul 08 15:51:47.869269 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:47.869231    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dkbqw" event={"ID":"028573ac-1ac9-4b53-8534-d3ca16b6143f","Type":"ContainerStarted","Data":"f2cc9169a4cbc156ce82aae6326294706b4fce70456015d83232556f00e3aec6"}
Jul 08 15:51:47.888071 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:47.888019    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dkbqw" podStartSLOduration=1.965090255 podStartE2EDuration="3.888000449s" totalImagesPullingTime="1.922910194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:51:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:51:47.887313101 +0000 UTC m=+47.297977756" watchObservedRunningTime="2026-07-08 15:51:47.888000449 +0000 UTC m=+47.298665102"
Jul 08 15:51:48.142780 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:48.142705    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:48.411771 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:48.411694    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-287gc_f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7/node-ca/0.log"
Jul 08 15:51:49.021643 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:49.021605    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:49.021811 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:49.021659    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:49.021811 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:49.021726    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 15:51:49.021811 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:49.021791    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm podName:de1a42ce-0b39-419a-a113-6cdc13b00ea9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:53.021776785 +0000 UTC m=+52.432441421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cxdfq" (UID: "de1a42ce-0b39-419a-a113-6cdc13b00ea9") : configmap "kube-rbac-proxy" not found
Jul 08 15:51:49.021928 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:49.021836    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:49.021928 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:49.021889    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls podName:de1a42ce-0b39-419a-a113-6cdc13b00ea9 nodeName:}" failed. No retries permitted until 2026-07-08 15:51:53.021875906 +0000 UTC m=+52.432540538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cxdfq" (UID: "de1a42ce-0b39-419a-a113-6cdc13b00ea9") : secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:49.409516 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:49.409441    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kn9t5_eb8acfc6-62bf-4756-afcc-156d78e816d7/serve-healthcheck-canary/0.log"
Jul 08 15:51:49.610191 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:49.610141    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-dkbqw_028573ac-1ac9-4b53-8534-d3ca16b6143f/migrator/0.log"
Jul 08 15:51:49.809692 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:49.809663    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-dkbqw_028573ac-1ac9-4b53-8534-d3ca16b6143f/graceful-termination/0.log"
Jul 08 15:51:50.237181 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:50.237105    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:50.337943 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:50.337913    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:51.266869 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:51.266838    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:53.050697 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:53.050663    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:53.054731 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:53.054712    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:53.054830 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:53.054814    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:51:53.054900 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:53.054880    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:53.054974 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:53.054962    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls podName:de1a42ce-0b39-419a-a113-6cdc13b00ea9 nodeName:}" failed. No retries permitted until 2026-07-08 15:52:01.054946579 +0000 UTC m=+60.465611221 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cxdfq" (UID: "de1a42ce-0b39-419a-a113-6cdc13b00ea9") : secret "insights-runtime-extractor-tls" not found
Jul 08 15:51:53.055039 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:53.054885    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 08 15:51:53.055039 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:53.055020    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm podName:de1a42ce-0b39-419a-a113-6cdc13b00ea9 nodeName:}" failed. No retries permitted until 2026-07-08 15:52:01.055007138 +0000 UTC m=+60.465671769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-cxdfq" (UID: "de1a42ce-0b39-419a-a113-6cdc13b00ea9") : configmap "kube-rbac-proxy" not found
Jul 08 15:51:53.151766 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:53.151735    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:53.293178 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:53.293147    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:53.393701 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:53.393630    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:53.570637 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:53.570603    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:53.749013 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:53.748932    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:53.761059 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:53.761029    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:51:53.761193 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:53.761119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:51:53.761193 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:53.761184    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 08 15:51:53.761309 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:53.761200    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74f65cff65-tj9wh: secret "image-registry-tls" not found
Jul 08 15:51:53.761309 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:53.761264    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls podName:d5da4aec-b067-4797-8bf1-902ca6f8685b nodeName:}" failed. No retries permitted until 2026-07-08 15:52:09.761244082 +0000 UTC m=+69.171908715 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls") pod "image-registry-74f65cff65-tj9wh" (UID: "d5da4aec-b067-4797-8bf1-902ca6f8685b") : secret "image-registry-tls" not found
Jul 08 15:51:53.761309 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:53.761277    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 08 15:51:53.761443 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:51:53.761352    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls podName:2e25c91b-8570-40e1-b46f-02c99f5d4f47 nodeName:}" failed. No retries permitted until 2026-07-08 15:52:09.761334789 +0000 UTC m=+69.171999424 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls") pod "dns-default-n85j9" (UID: "2e25c91b-8570-40e1-b46f-02c99f5d4f47") : secret "dns-default-metrics-tls" not found
Jul 08 15:51:54.777669 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:54.777575    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:55.186067 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:55.185989    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:55.353364 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:55.353332    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:55.548216 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:55.548171    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:55.958261 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:55.958186    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:56.547410 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:56.547370    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:56.681020 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:56.680989    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:56.781274 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:56.781240    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:56.955973 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:56.955890    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:57.168738 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:57.168704    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:57.233558 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:57.233488    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:57.499191 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:57.499110    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:57.776163 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:57.776133    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:58.290503 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:58.290474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:58.404037 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:58.404003    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:58.562542 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:58.562465    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:58.660594 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:58.660554    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:58.760780 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:58.760747    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:58.955388 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:58.955304    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:59.181362 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:59.181331    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:59.240561 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:59.240485    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:59.365737 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:59.365702    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:59.553940 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:59.553914    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:51:59.964185 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:51:59.964108    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:00.065936 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:00.065907    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:00.166947 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:00.166918    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:00.266860 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:00.266828    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:00.546858 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:00.546779    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:00.648292 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:00.648263    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:00.749217 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:00.749187    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:00.947140 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:00.947062    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:01.049546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:01.049517    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:01.119764 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:01.119727    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:52:01.119764 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:01.119765    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:52:01.120001 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:52:01.119877    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 08 15:52:01.120001 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:52:01.119930    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls podName:de1a42ce-0b39-419a-a113-6cdc13b00ea9 nodeName:}" failed. No retries permitted until 2026-07-08 15:52:17.119916219 +0000 UTC m=+76.530580851 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-cxdfq" (UID: "de1a42ce-0b39-419a-a113-6cdc13b00ea9") : secret "insights-runtime-extractor-tls" not found
Jul 08 15:52:01.120344 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:01.120322    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/de1a42ce-0b39-419a-a113-6cdc13b00ea9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:52:01.368283 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:01.368250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:01.465705 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:01.465670    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:01.609845 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:01.609667    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:01.665883 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:01.665804    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:01.848850 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:01.848818    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:02.146929 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:02.146896    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:02.823125 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:02.823102    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7kt66"
Jul 08 15:52:02.998997 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:02.998958    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:03.100257 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:03.100186    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:03.363498 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:03.363428    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:03.547313 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:03.547278    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:03.747239 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:03.747165    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:04.147027 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:04.147000    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:05.508902 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:05.508868    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:05.588705 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:05.588674    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:07.269062 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.269013    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret\") pod \"global-pull-secret-syncer-fwvjs\" (UID: \"80295698-bf83-4342-a954-7491ebe64be9\") " pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:52:07.271610 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.271572    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 08 15:52:07.282323 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.282297    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80295698-bf83-4342-a954-7491ebe64be9-original-pull-secret\") pod \"global-pull-secret-syncer-fwvjs\" (UID: \"80295698-bf83-4342-a954-7491ebe64be9\") " pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:52:07.369438 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.369399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs\") pod \"network-metrics-daemon-txtpm\" (UID: \"4d3d9829-234c-45ed-8d74-75cdadc4f135\") " pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:52:07.369675 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.369492    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zm8p\" (UniqueName: \"kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p\") pod \"network-check-target-mq6mh\" (UID: \"357f648e-a202-4a71-a7ea-ffdd1c250bff\") " pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:52:07.372522 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.372504    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 08 15:52:07.372590 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.372503    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 08 15:52:07.381767 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.381743    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4d3d9829-234c-45ed-8d74-75cdadc4f135-metrics-certs\") pod \"network-metrics-daemon-txtpm\" (UID: \"4d3d9829-234c-45ed-8d74-75cdadc4f135\") " pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:52:07.382271 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.382254    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 08 15:52:07.392652 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.392626    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zm8p\" (UniqueName: \"kubernetes.io/projected/357f648e-a202-4a71-a7ea-ffdd1c250bff-kube-api-access-9zm8p\") pod \"network-check-target-mq6mh\" (UID: \"357f648e-a202-4a71-a7ea-ffdd1c250bff\") " pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:52:07.529142 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.529055    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-24mlw\""
Jul 08 15:52:07.534436 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.534408    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fwvjs"
Jul 08 15:52:07.536995 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.536973    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-txtpm"
Jul 08 15:52:07.544103 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.544079    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f8k7f\""
Jul 08 15:52:07.552417 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.552391    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:52:07.671820 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.671793    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fwvjs"]
Jul 08 15:52:07.677571 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:52:07.677541    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80295698_bf83_4342_a954_7491ebe64be9.slice/crio-1d70dfae522123209cdb8203cbedcf3d1dbee1b612a917218d85e36777cecf39 WatchSource:0}: Error finding container 1d70dfae522123209cdb8203cbedcf3d1dbee1b612a917218d85e36777cecf39: Status 404 returned error can't find the container with id 1d70dfae522123209cdb8203cbedcf3d1dbee1b612a917218d85e36777cecf39
Jul 08 15:52:07.690922 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.690897    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-txtpm"]
Jul 08 15:52:07.693991 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:52:07.693969    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d3d9829_234c_45ed_8d74_75cdadc4f135.slice/crio-a0f04ebb1930295aa151c052595f503b8449350d4f80ea006018c0c0fab6e2c3 WatchSource:0}: Error finding container a0f04ebb1930295aa151c052595f503b8449350d4f80ea006018c0c0fab6e2c3: Status 404 returned error can't find the container with id a0f04ebb1930295aa151c052595f503b8449350d4f80ea006018c0c0fab6e2c3
Jul 08 15:52:07.704093 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.704071    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mq6mh"]
Jul 08 15:52:07.706037 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:52:07.706013    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357f648e_a202_4a71_a7ea_ffdd1c250bff.slice/crio-3acec0914cc2b553ba5edc3941982d8da9d4bf75a20893fdaf3286fb467270ab WatchSource:0}: Error finding container 3acec0914cc2b553ba5edc3941982d8da9d4bf75a20893fdaf3286fb467270ab: Status 404 returned error can't find the container with id 3acec0914cc2b553ba5edc3941982d8da9d4bf75a20893fdaf3286fb467270ab
Jul 08 15:52:07.919363 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.919269    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txtpm" event={"ID":"4d3d9829-234c-45ed-8d74-75cdadc4f135","Type":"ContainerStarted","Data":"a0f04ebb1930295aa151c052595f503b8449350d4f80ea006018c0c0fab6e2c3"}
Jul 08 15:52:07.920298 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.920271    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mq6mh" event={"ID":"357f648e-a202-4a71-a7ea-ffdd1c250bff","Type":"ContainerStarted","Data":"3acec0914cc2b553ba5edc3941982d8da9d4bf75a20893fdaf3286fb467270ab"}
Jul 08 15:52:07.921165 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:07.921144    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fwvjs" event={"ID":"80295698-bf83-4342-a954-7491ebe64be9","Type":"ContainerStarted","Data":"1d70dfae522123209cdb8203cbedcf3d1dbee1b612a917218d85e36777cecf39"}
Jul 08 15:52:08.461557 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.460527    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd"]
Jul 08 15:52:08.463829 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.463804    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd"
Jul 08 15:52:08.469348 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.468601    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 08 15:52:08.469348 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.468851    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 08 15:52:08.469774 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.469707    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 08 15:52:08.472124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.472003    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 08 15:52:08.479061 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.478730    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd"]
Jul 08 15:52:08.479061 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.478845    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64123bc7-8bfb-4b5d-8c64-36bf6e1902de-tmp\") pod \"klusterlet-addon-workmgr-74c757f8df-8tbvd\" (UID: \"64123bc7-8bfb-4b5d-8c64-36bf6e1902de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd"
Jul 08 15:52:08.479061 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.478883    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/64123bc7-8bfb-4b5d-8c64-36bf6e1902de-klusterlet-config\") pod \"klusterlet-addon-workmgr-74c757f8df-8tbvd\" (UID: \"64123bc7-8bfb-4b5d-8c64-36bf6e1902de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd"
Jul 08 15:52:08.479061 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.478933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvht6\" (UniqueName: \"kubernetes.io/projected/64123bc7-8bfb-4b5d-8c64-36bf6e1902de-kube-api-access-pvht6\") pod \"klusterlet-addon-workmgr-74c757f8df-8tbvd\" (UID: \"64123bc7-8bfb-4b5d-8c64-36bf6e1902de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd"
Jul 08 15:52:08.569229 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.569184    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-xbt6w"]
Jul 08 15:52:08.571444 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.571420    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-xbt6w"
Jul 08 15:52:08.574452 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.574425    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-zkld2\""
Jul 08 15:52:08.575167 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.575036    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 08 15:52:08.575167 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.575046    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 08 15:52:08.580112 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.580086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64123bc7-8bfb-4b5d-8c64-36bf6e1902de-tmp\") pod \"klusterlet-addon-workmgr-74c757f8df-8tbvd\" (UID: \"64123bc7-8bfb-4b5d-8c64-36bf6e1902de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd"
Jul 08 15:52:08.580709 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.580123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/64123bc7-8bfb-4b5d-8c64-36bf6e1902de-klusterlet-config\") pod \"klusterlet-addon-workmgr-74c757f8df-8tbvd\" (UID: \"64123bc7-8bfb-4b5d-8c64-36bf6e1902de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd"
Jul 08 15:52:08.580709 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.580178    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvht6\" (UniqueName: \"kubernetes.io/projected/64123bc7-8bfb-4b5d-8c64-36bf6e1902de-kube-api-access-pvht6\") pod \"klusterlet-addon-workmgr-74c757f8df-8tbvd\" (UID: \"64123bc7-8bfb-4b5d-8c64-36bf6e1902de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd"
Jul 08 15:52:08.580709 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.580539    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64123bc7-8bfb-4b5d-8c64-36bf6e1902de-tmp\") pod \"klusterlet-addon-workmgr-74c757f8df-8tbvd\" (UID: \"64123bc7-8bfb-4b5d-8c64-36bf6e1902de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd"
Jul 08 15:52:08.586819 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.586795    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/64123bc7-8bfb-4b5d-8c64-36bf6e1902de-klusterlet-config\") pod \"klusterlet-addon-workmgr-74c757f8df-8tbvd\" (UID: \"64123bc7-8bfb-4b5d-8c64-36bf6e1902de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd"
Jul 08 15:52:08.599262 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.599201    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-xbt6w"]
Jul 08 15:52:08.608691 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.608382    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74f65cff65-tj9wh"]
Jul 08 15:52:08.608691 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:52:08.608640    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-74f65cff65-tj9wh" podUID="d5da4aec-b067-4797-8bf1-902ca6f8685b"
Jul 08 15:52:08.614061 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.611323    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvht6\" (UniqueName: \"kubernetes.io/projected/64123bc7-8bfb-4b5d-8c64-36bf6e1902de-kube-api-access-pvht6\") pod \"klusterlet-addon-workmgr-74c757f8df-8tbvd\" (UID: \"64123bc7-8bfb-4b5d-8c64-36bf6e1902de\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd"
Jul 08 15:52:08.669511 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.669474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:08.672778 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.672751    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6dc99fdc68-9gqbh"]
Jul 08 15:52:08.674986 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.674967    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.680633 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.680607    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5p4j\" (UniqueName: \"kubernetes.io/projected/dbf4d6fb-0a5f-43b8-b66a-95071d5c0882-kube-api-access-l5p4j\") pod \"downloads-685bfb5f64-xbt6w\" (UID: \"dbf4d6fb-0a5f-43b8-b66a-95071d5c0882\") " pod="openshift-console/downloads-685bfb5f64-xbt6w"
Jul 08 15:52:08.693789 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.691491    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dc99fdc68-9gqbh"]
Jul 08 15:52:08.772274 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.772237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:08.780541 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.780502    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd"
Jul 08 15:52:08.781772 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.781738    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5p4j\" (UniqueName: \"kubernetes.io/projected/dbf4d6fb-0a5f-43b8-b66a-95071d5c0882-kube-api-access-l5p4j\") pod \"downloads-685bfb5f64-xbt6w\" (UID: \"dbf4d6fb-0a5f-43b8-b66a-95071d5c0882\") " pod="openshift-console/downloads-685bfb5f64-xbt6w"
Jul 08 15:52:08.781904 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.781787    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea9650a3-fcff-457b-8529-d0a45323514b-trusted-ca\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.781904 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.781829    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea9650a3-fcff-457b-8529-d0a45323514b-installation-pull-secrets\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.781904 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.781861    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea9650a3-fcff-457b-8529-d0a45323514b-image-registry-private-configuration\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.781904 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.781895    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw2hv\" (UniqueName: \"kubernetes.io/projected/ea9650a3-fcff-457b-8529-d0a45323514b-kube-api-access-nw2hv\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.782102 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.781948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea9650a3-fcff-457b-8529-d0a45323514b-registry-tls\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.782102 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.781991    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea9650a3-fcff-457b-8529-d0a45323514b-ca-trust-extracted\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.782102 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.782013    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea9650a3-fcff-457b-8529-d0a45323514b-registry-certificates\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.782102 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.782067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea9650a3-fcff-457b-8529-d0a45323514b-bound-sa-token\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.796069 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.796046    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5p4j\" (UniqueName: \"kubernetes.io/projected/dbf4d6fb-0a5f-43b8-b66a-95071d5c0882-kube-api-access-l5p4j\") pod \"downloads-685bfb5f64-xbt6w\" (UID: \"dbf4d6fb-0a5f-43b8-b66a-95071d5c0882\") " pod="openshift-console/downloads-685bfb5f64-xbt6w"
Jul 08 15:52:08.876262 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.876226    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:08.882888 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.882860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea9650a3-fcff-457b-8529-d0a45323514b-bound-sa-token\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.883007 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.882909    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea9650a3-fcff-457b-8529-d0a45323514b-trusted-ca\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.883007 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.882948    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea9650a3-fcff-457b-8529-d0a45323514b-installation-pull-secrets\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.883007 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.882974    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea9650a3-fcff-457b-8529-d0a45323514b-image-registry-private-configuration\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.883176 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.883016    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw2hv\" (UniqueName: \"kubernetes.io/projected/ea9650a3-fcff-457b-8529-d0a45323514b-kube-api-access-nw2hv\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.883176 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.883067    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea9650a3-fcff-457b-8529-d0a45323514b-registry-tls\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.883176 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.883110    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea9650a3-fcff-457b-8529-d0a45323514b-ca-trust-extracted\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.883176 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.883134    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea9650a3-fcff-457b-8529-d0a45323514b-registry-certificates\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.884160 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.884040    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ea9650a3-fcff-457b-8529-d0a45323514b-ca-trust-extracted\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.884160 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.884070    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-xbt6w"
Jul 08 15:52:08.884567 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.884541    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ea9650a3-fcff-457b-8529-d0a45323514b-registry-certificates\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.885182 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.885154    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ea9650a3-fcff-457b-8529-d0a45323514b-trusted-ca\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.889146 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.887744    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ea9650a3-fcff-457b-8529-d0a45323514b-installation-pull-secrets\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.889146 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.888113    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ea9650a3-fcff-457b-8529-d0a45323514b-registry-tls\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.889146 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.888165    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ea9650a3-fcff-457b-8529-d0a45323514b-image-registry-private-configuration\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.893990 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.893940    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw2hv\" (UniqueName: \"kubernetes.io/projected/ea9650a3-fcff-457b-8529-d0a45323514b-kube-api-access-nw2hv\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.893990 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.893946    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ea9650a3-fcff-457b-8529-d0a45323514b-bound-sa-token\") pod \"image-registry-6dc99fdc68-9gqbh\" (UID: \"ea9650a3-fcff-457b-8529-d0a45323514b\") " pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:08.924439 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.924406    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:52:08.932866 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.932848    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:52:08.976988 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:52:08.976953    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64123bc7_8bfb_4b5d_8c64_36bf6e1902de.slice/crio-f6fcb7a66935f602e30c79fb40e1691aed0a16cbded6ed5a0e1ace6d1d09a691 WatchSource:0}: Error finding container f6fcb7a66935f602e30c79fb40e1691aed0a16cbded6ed5a0e1ace6d1d09a691: Status 404 returned error can't find the container with id f6fcb7a66935f602e30c79fb40e1691aed0a16cbded6ed5a0e1ace6d1d09a691
Jul 08 15:52:08.983351 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.983328    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd"]
Jul 08 15:52:08.983624 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.983606    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5da4aec-b067-4797-8bf1-902ca6f8685b-trusted-ca\") pod \"d5da4aec-b067-4797-8bf1-902ca6f8685b\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") "
Jul 08 15:52:08.983710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.983642    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-bound-sa-token\") pod \"d5da4aec-b067-4797-8bf1-902ca6f8685b\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") "
Jul 08 15:52:08.983710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.983675    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5da4aec-b067-4797-8bf1-902ca6f8685b-installation-pull-secrets\") pod \"d5da4aec-b067-4797-8bf1-902ca6f8685b\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") "
Jul 08 15:52:08.983710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.983703    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5da4aec-b067-4797-8bf1-902ca6f8685b-image-registry-private-configuration\") pod \"d5da4aec-b067-4797-8bf1-902ca6f8685b\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") "
Jul 08 15:52:08.983858 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.983749    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5da4aec-b067-4797-8bf1-902ca6f8685b-ca-trust-extracted\") pod \"d5da4aec-b067-4797-8bf1-902ca6f8685b\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") "
Jul 08 15:52:08.983858 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.983795    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9bh6\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-kube-api-access-j9bh6\") pod \"d5da4aec-b067-4797-8bf1-902ca6f8685b\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") "
Jul 08 15:52:08.983858 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.983823    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-certificates\") pod \"d5da4aec-b067-4797-8bf1-902ca6f8685b\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") "
Jul 08 15:52:08.985552 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.985521    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5da4aec-b067-4797-8bf1-902ca6f8685b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d5da4aec-b067-4797-8bf1-902ca6f8685b" (UID: "d5da4aec-b067-4797-8bf1-902ca6f8685b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 15:52:08.985804 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.985759    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5da4aec-b067-4797-8bf1-902ca6f8685b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d5da4aec-b067-4797-8bf1-902ca6f8685b" (UID: "d5da4aec-b067-4797-8bf1-902ca6f8685b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:52:08.986064 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.986045    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d5da4aec-b067-4797-8bf1-902ca6f8685b" (UID: "d5da4aec-b067-4797-8bf1-902ca6f8685b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:52:08.989231 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.989188    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-kube-api-access-j9bh6" (OuterVolumeSpecName: "kube-api-access-j9bh6") pod "d5da4aec-b067-4797-8bf1-902ca6f8685b" (UID: "d5da4aec-b067-4797-8bf1-902ca6f8685b"). InnerVolumeSpecName "kube-api-access-j9bh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:52:08.989534 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.989491    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5da4aec-b067-4797-8bf1-902ca6f8685b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d5da4aec-b067-4797-8bf1-902ca6f8685b" (UID: "d5da4aec-b067-4797-8bf1-902ca6f8685b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:52:08.990297 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.990264    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5da4aec-b067-4797-8bf1-902ca6f8685b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d5da4aec-b067-4797-8bf1-902ca6f8685b" (UID: "d5da4aec-b067-4797-8bf1-902ca6f8685b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:52:08.997381 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.991912    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rpkvs\""
Jul 08 15:52:08.997381 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.994630    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d5da4aec-b067-4797-8bf1-902ca6f8685b" (UID: "d5da4aec-b067-4797-8bf1-902ca6f8685b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:52:08.999191 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:08.998989    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:09.016047 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.015985    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:09.057459 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.057398    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-xbt6w"]
Jul 08 15:52:09.084912 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.084875    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d5da4aec-b067-4797-8bf1-902ca6f8685b-trusted-ca\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:52:09.084912 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.084908    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-bound-sa-token\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:52:09.085119 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.084923    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d5da4aec-b067-4797-8bf1-902ca6f8685b-installation-pull-secrets\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:52:09.085119 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.084939    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d5da4aec-b067-4797-8bf1-902ca6f8685b-image-registry-private-configuration\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:52:09.085119 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.084956    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d5da4aec-b067-4797-8bf1-902ca6f8685b-ca-trust-extracted\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:52:09.085119 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.084971    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9bh6\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-kube-api-access-j9bh6\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:52:09.085119 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.084984    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-certificates\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:52:09.106999 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.106940    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:09.167294 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.167254    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dc99fdc68-9gqbh"]
Jul 08 15:52:09.170731 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:52:09.170703    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea9650a3_fcff_457b_8529_d0a45323514b.slice/crio-cfe87de5417996c5e632e0f5e2080104ee864f0b026506ed9a4fbf2ebddddc74 WatchSource:0}: Error finding container cfe87de5417996c5e632e0f5e2080104ee864f0b026506ed9a4fbf2ebddddc74: Status 404 returned error can't find the container with id cfe87de5417996c5e632e0f5e2080104ee864f0b026506ed9a4fbf2ebddddc74
Jul 08 15:52:09.792488 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.792242    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:52:09.792488 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.792320    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:52:09.799375 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.796301    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls\") pod \"image-registry-74f65cff65-tj9wh\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") " pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:52:09.799375 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.799311    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e25c91b-8570-40e1-b46f-02c99f5d4f47-metrics-tls\") pod \"dns-default-n85j9\" (UID: \"2e25c91b-8570-40e1-b46f-02c99f5d4f47\") " pod="openshift-dns/dns-default-n85j9"
Jul 08 15:52:09.892752 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.892684    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls\") pod \"d5da4aec-b067-4797-8bf1-902ca6f8685b\" (UID: \"d5da4aec-b067-4797-8bf1-902ca6f8685b\") "
Jul 08 15:52:09.895919 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.895883    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d5da4aec-b067-4797-8bf1-902ca6f8685b" (UID: "d5da4aec-b067-4797-8bf1-902ca6f8685b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:52:09.932999 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.932958    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh" event={"ID":"ea9650a3-fcff-457b-8529-d0a45323514b","Type":"ContainerStarted","Data":"d129710f9558c392a58747f0af6321b929a711ce52d8c53173171914fda64365"}
Jul 08 15:52:09.933181 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.933020    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh" event={"ID":"ea9650a3-fcff-457b-8529-d0a45323514b","Type":"ContainerStarted","Data":"cfe87de5417996c5e632e0f5e2080104ee864f0b026506ed9a4fbf2ebddddc74"}
Jul 08 15:52:09.933317 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.933299    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:09.934729 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.934679    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd" event={"ID":"64123bc7-8bfb-4b5d-8c64-36bf6e1902de","Type":"ContainerStarted","Data":"f6fcb7a66935f602e30c79fb40e1691aed0a16cbded6ed5a0e1ace6d1d09a691"}
Jul 08 15:52:09.936162 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.936132    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-xbt6w" event={"ID":"dbf4d6fb-0a5f-43b8-b66a-95071d5c0882","Type":"ContainerStarted","Data":"bfbaa7f332b6e1746c586bb03d683c8825b9136a7ba91a8e4c90fdd9945e83cd"}
Jul 08 15:52:09.939077 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.939039    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74f65cff65-tj9wh"
Jul 08 15:52:09.939210 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.939060    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txtpm" event={"ID":"4d3d9829-234c-45ed-8d74-75cdadc4f135","Type":"ContainerStarted","Data":"e81660f468dad404fb9be473d74821dc655bc38dd30001d78920580628aea678"}
Jul 08 15:52:09.939210 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.939118    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-txtpm" event={"ID":"4d3d9829-234c-45ed-8d74-75cdadc4f135","Type":"ContainerStarted","Data":"ae005cc3a756fb4df5fc7f2e7079744f515a36fc6902a7242dca2e6a1e106e04"}
Jul 08 15:52:09.960355 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.960114    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh" podStartSLOduration=1.960094811 podStartE2EDuration="1.960094811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:52:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:09.959506593 +0000 UTC m=+69.370171248" watchObservedRunningTime="2026-07-08 15:52:09.960094811 +0000 UTC m=+69.370759445"
Jul 08 15:52:09.987613 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.987559    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74f65cff65-tj9wh"]
Jul 08 15:52:09.992810 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.992780    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74f65cff65-tj9wh"]
Jul 08 15:52:09.995460 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:09.994350    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d5da4aec-b067-4797-8bf1-902ca6f8685b-registry-tls\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:52:10.008946 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:10.007840    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-txtpm" podStartSLOduration=65.882127083 podStartE2EDuration="1m7.007822493s" totalImagesPullingTime="1.12569541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:10.007560633 +0000 UTC m=+69.418225291" watchObservedRunningTime="2026-07-08 15:52:10.007822493 +0000 UTC m=+69.418487148"
Jul 08 15:52:10.011453 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:10.011432    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mjhcc\""
Jul 08 15:52:10.018630 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:10.018608    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n85j9"
Jul 08 15:52:10.138157 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:10.138029    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:10.191789 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:10.191754    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n85j9"]
Jul 08 15:52:10.195375 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:52:10.195344    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e25c91b_8570_40e1_b46f_02c99f5d4f47.slice/crio-3bb8b14979df93d15df38bdf0fc327bb8d0f219b2b27a87ae37d5e9758e26da9 WatchSource:0}: Error finding container 3bb8b14979df93d15df38bdf0fc327bb8d0f219b2b27a87ae37d5e9758e26da9: Status 404 returned error can't find the container with id 3bb8b14979df93d15df38bdf0fc327bb8d0f219b2b27a87ae37d5e9758e26da9
Jul 08 15:52:10.229988 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:10.229950    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:10.293528 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:10.293461    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:10.617433 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:10.617222    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5da4aec-b067-4797-8bf1-902ca6f8685b" path="/var/lib/kubelet/pods/d5da4aec-b067-4797-8bf1-902ca6f8685b/volumes"
Jul 08 15:52:10.944712 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:10.944620    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n85j9" event={"ID":"2e25c91b-8570-40e1-b46f-02c99f5d4f47","Type":"ContainerStarted","Data":"3bb8b14979df93d15df38bdf0fc327bb8d0f219b2b27a87ae37d5e9758e26da9"}
Jul 08 15:52:11.075903 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:11.075868    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:11.176011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:11.175963    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:11.530344 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:11.530305    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:11.627830 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:11.627791    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:11.734259 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:11.734175    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:11.931429 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:11.931345    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:12.032236 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.032205    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:12.090804 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.090768    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6l7vp"]
Jul 08 15:52:12.093123 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.093075    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6l7vp"
Jul 08 15:52:12.095863 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.095841    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 08 15:52:12.095963 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.095849    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vkcsc\""
Jul 08 15:52:12.102342 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.101739    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6l7vp"]
Jul 08 15:52:12.106429 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.105903    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:12.222788 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.222689    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1b3ff321-1ffa-4703-b9b6-8a0c04cfccfd-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6l7vp\" (UID: \"1b3ff321-1ffa-4703-b9b6-8a0c04cfccfd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6l7vp"
Jul 08 15:52:12.283318 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.283280    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bbd6cb97c-xz9sz"]
Jul 08 15:52:12.285473 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.285446    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.288318 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.288181    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 08 15:52:12.288318 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.288207    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 08 15:52:12.288318 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.288227    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 08 15:52:12.288838 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.288813    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 08 15:52:12.289049 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.289028    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sfj5m\""
Jul 08 15:52:12.289254 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.289237    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 08 15:52:12.299556 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.299098    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bbd6cb97c-xz9sz"]
Jul 08 15:52:12.323927 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.323901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-oauth-config\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.324057 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.323960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1b3ff321-1ffa-4703-b9b6-8a0c04cfccfd-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6l7vp\" (UID: \"1b3ff321-1ffa-4703-b9b6-8a0c04cfccfd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6l7vp"
Jul 08 15:52:12.324057 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.323991    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-config\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.324057 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.324011    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-oauth-serving-cert\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.324057 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.324047    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-serving-cert\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.324273 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:52:12.324115    2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 08 15:52:12.324273 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.324136    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdxg8\" (UniqueName: \"kubernetes.io/projected/061749c8-4ff7-436d-96fe-3c6acd88cfa9-kube-api-access-jdxg8\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.324273 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:52:12.324182    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b3ff321-1ffa-4703-b9b6-8a0c04cfccfd-tls-certificates podName:1b3ff321-1ffa-4703-b9b6-8a0c04cfccfd nodeName:}" failed. No retries permitted until 2026-07-08 15:52:12.824164436 +0000 UTC m=+72.234829088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/1b3ff321-1ffa-4703-b9b6-8a0c04cfccfd-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-6l7vp" (UID: "1b3ff321-1ffa-4703-b9b6-8a0c04cfccfd") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 08 15:52:12.324273 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.324213    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-service-ca\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.392475 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.392441    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:12.424548 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.424518    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-oauth-config\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.424745 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.424610    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-config\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.424745 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.424636    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-oauth-serving-cert\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.424745 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.424667    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-serving-cert\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.424745 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.424699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdxg8\" (UniqueName: \"kubernetes.io/projected/061749c8-4ff7-436d-96fe-3c6acd88cfa9-kube-api-access-jdxg8\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.424745 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.424738    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-service-ca\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.425546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.425519    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-service-ca\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.426308 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.425869    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-oauth-serving-cert\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.426308 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.426276    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-config\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.428111 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.428084    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-serving-cert\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.428209 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.428135    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-oauth-config\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.436455 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.436425    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdxg8\" (UniqueName: \"kubernetes.io/projected/061749c8-4ff7-436d-96fe-3c6acd88cfa9-kube-api-access-jdxg8\") pod \"console-bbd6cb97c-xz9sz\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") " pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.493146 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.493030    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:12.594110 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.594049    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:12.600904 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.600882    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:12.828599 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.828551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1b3ff321-1ffa-4703-b9b6-8a0c04cfccfd-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6l7vp\" (UID: \"1b3ff321-1ffa-4703-b9b6-8a0c04cfccfd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6l7vp"
Jul 08 15:52:12.831463 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.831437    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1b3ff321-1ffa-4703-b9b6-8a0c04cfccfd-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-6l7vp\" (UID: \"1b3ff321-1ffa-4703-b9b6-8a0c04cfccfd\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6l7vp"
Jul 08 15:52:12.995218 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:12.995132    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:13.007142 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:13.007113    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6l7vp"
Jul 08 15:52:13.389300 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:13.389217    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:13.446029 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:13.445992    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:14.115025 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:14.114917    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bbd6cb97c-xz9sz"]
Jul 08 15:52:14.121970 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:52:14.121937    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061749c8_4ff7_436d_96fe_3c6acd88cfa9.slice/crio-171ff48c6c74a14ecde711505baf8ffd14ab0c9b8896417a92e7c7b45bff0d0d WatchSource:0}: Error finding container 171ff48c6c74a14ecde711505baf8ffd14ab0c9b8896417a92e7c7b45bff0d0d: Status 404 returned error can't find the container with id 171ff48c6c74a14ecde711505baf8ffd14ab0c9b8896417a92e7c7b45bff0d0d
Jul 08 15:52:14.132352 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:14.131777    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6l7vp"]
Jul 08 15:52:14.137377 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:52:14.137341    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b3ff321_1ffa_4703_b9b6_8a0c04cfccfd.slice/crio-41da1eb7adf54dbefc307bbac855b28a3af80cfa1ce18d7db63facc5b5e631e0 WatchSource:0}: Error finding container 41da1eb7adf54dbefc307bbac855b28a3af80cfa1ce18d7db63facc5b5e631e0: Status 404 returned error can't find the container with id 41da1eb7adf54dbefc307bbac855b28a3af80cfa1ce18d7db63facc5b5e631e0
Jul 08 15:52:14.690717 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:14.690679    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:14.790910 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:14.790868    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:14.854980 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:14.854948    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:14.969610 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:14.969500    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6l7vp" event={"ID":"1b3ff321-1ffa-4703-b9b6-8a0c04cfccfd","Type":"ContainerStarted","Data":"41da1eb7adf54dbefc307bbac855b28a3af80cfa1ce18d7db63facc5b5e631e0"}
Jul 08 15:52:14.971628 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:14.971599    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mq6mh" event={"ID":"357f648e-a202-4a71-a7ea-ffdd1c250bff","Type":"ContainerStarted","Data":"6eaa0a98c27f321c0fdd50985444e10108a2f7165b25b8633e852bca81a098f8"}
Jul 08 15:52:14.971776 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:14.971683    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:52:14.973342 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:14.973315    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fwvjs" event={"ID":"80295698-bf83-4342-a954-7491ebe64be9","Type":"ContainerStarted","Data":"2166a7752da14af452bacfe96a384f67115f09371ecba0d59f0f1954ac7a8db5"}
Jul 08 15:52:14.975295 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:14.975267    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n85j9" event={"ID":"2e25c91b-8570-40e1-b46f-02c99f5d4f47","Type":"ContainerStarted","Data":"8552ab64422875f70fa6dd473e5dfb810984a13d7e49d6881add1c82db36d071"}
Jul 08 15:52:14.975414 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:14.975321    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n85j9" event={"ID":"2e25c91b-8570-40e1-b46f-02c99f5d4f47","Type":"ContainerStarted","Data":"b291266cc6ddc1e55841f7810b049a6fb0dbbe1f0b8d2f3aa70c22e27efa1dd5"}
Jul 08 15:52:14.975891 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:14.975872    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n85j9"
Jul 08 15:52:14.977657 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:14.977632    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbd6cb97c-xz9sz" event={"ID":"061749c8-4ff7-436d-96fe-3c6acd88cfa9","Type":"ContainerStarted","Data":"171ff48c6c74a14ecde711505baf8ffd14ab0c9b8896417a92e7c7b45bff0d0d"}
Jul 08 15:52:14.992468 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:14.992380    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mq6mh" podStartSLOduration=65.77255584 podStartE2EDuration="1m11.992361854s" totalImagesPullingTime="6.219806014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:14.991223063 +0000 UTC m=+74.401887718" watchObservedRunningTime="2026-07-08 15:52:14.992361854 +0000 UTC m=+74.403026509"
Jul 08 15:52:15.008744 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:15.008516    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n85j9" podStartSLOduration=34.237035451 podStartE2EDuration="38.008497119s" totalImagesPullingTime="3.771461668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:15.008467485 +0000 UTC m=+74.419132141" watchObservedRunningTime="2026-07-08 15:52:15.008497119 +0000 UTC m=+74.419161773"
Jul 08 15:52:15.027488 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:15.027432    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fwvjs" podStartSLOduration=65.779287734 podStartE2EDuration="1m12.027412721s" totalImagesPullingTime="6.248124987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:15.025939588 +0000 UTC m=+74.436604244" watchObservedRunningTime="2026-07-08 15:52:15.027412721 +0000 UTC m=+74.438077378"
Jul 08 15:52:16.076594 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.076544    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:16.146376 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.146284    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:16.272529 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.272160    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fb947dc78-4kzfx"]
Jul 08 15:52:16.307733 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.307248    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fb947dc78-4kzfx"]
Jul 08 15:52:16.307733 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.307369    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.318548 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.318330    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 08 15:52:16.361524 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.361421    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-trusted-ca-bundle\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.361710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.361524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bf998c2-788d-4334-8379-56296783f4ee-console-serving-cert\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.361710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.361670    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-console-config\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.361710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.361706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bf998c2-788d-4334-8379-56296783f4ee-console-oauth-config\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.361874 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.361728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-service-ca\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.361874 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.361754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-oauth-serving-cert\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.361874 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.361813    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmd74\" (UniqueName: \"kubernetes.io/projected/5bf998c2-788d-4334-8379-56296783f4ee-kube-api-access-bmd74\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.462300 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.462250    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-console-config\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.462463 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.462306    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bf998c2-788d-4334-8379-56296783f4ee-console-oauth-config\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.462463 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.462331    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-service-ca\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.462463 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.462356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-oauth-serving-cert\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.462463 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.462404    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmd74\" (UniqueName: \"kubernetes.io/projected/5bf998c2-788d-4334-8379-56296783f4ee-kube-api-access-bmd74\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.462463 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.462431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-trusted-ca-bundle\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.462463 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.462463    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bf998c2-788d-4334-8379-56296783f4ee-console-serving-cert\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.463195 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.463130    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-console-config\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.463540 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.463514    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-oauth-serving-cert\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.463540 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.463532    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-service-ca\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.463958 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.463934    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-trusted-ca-bundle\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.466175 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.466132    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bf998c2-788d-4334-8379-56296783f4ee-console-oauth-config\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.467010 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.466988    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bf998c2-788d-4334-8379-56296783f4ee-console-serving-cert\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.477640 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.477575    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmd74\" (UniqueName: \"kubernetes.io/projected/5bf998c2-788d-4334-8379-56296783f4ee-kube-api-access-bmd74\") pod \"console-5fb947dc78-4kzfx\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") " pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.624191 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.624119    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:16.863540 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.863273    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fb947dc78-4kzfx"]
Jul 08 15:52:16.881743 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.881636    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:16.944596 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.944545    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:16.989962 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.989921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6l7vp" event={"ID":"1b3ff321-1ffa-4703-b9b6-8a0c04cfccfd","Type":"ContainerStarted","Data":"567a6ec5d459a8d516b3db4645f397c38f18adfa50d70e3bf5769632116b5de0"}
Jul 08 15:52:16.990263 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.990217    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6l7vp"
Jul 08 15:52:16.996955 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:16.996929    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6l7vp"
Jul 08 15:52:17.025001 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:17.024936    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-6l7vp" podStartSLOduration=2.447629126 podStartE2EDuration="5.024911755s" totalImagesPullingTime="2.577282629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:17.006919016 +0000 UTC m=+76.417583674" watchObservedRunningTime="2026-07-08 15:52:17.024911755 +0000 UTC m=+76.435576413"
Jul 08 15:52:17.124344 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:17.124311    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:17.167423 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:17.167338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:52:17.169882 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:17.169860    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/de1a42ce-0b39-419a-a113-6cdc13b00ea9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-cxdfq\" (UID: \"de1a42ce-0b39-419a-a113-6cdc13b00ea9\") " pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:52:17.209605 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:17.209540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:17.363979 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:17.363944    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-96wh4\""
Jul 08 15:52:17.372422 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:17.372384    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-cxdfq"
Jul 08 15:52:17.477203 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:17.477120    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:18.652181 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:18.652149    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:18.752545 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:18.752512    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:19.423925 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:52:19.423890    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf998c2_788d_4334_8379_56296783f4ee.slice/crio-b3a79f42568de562ddadeb60c06bdfee34e67571a415822b3ff15b8fa2d5d33c WatchSource:0}: Error finding container b3a79f42568de562ddadeb60c06bdfee34e67571a415822b3ff15b8fa2d5d33c: Status 404 returned error can't find the container with id b3a79f42568de562ddadeb60c06bdfee34e67571a415822b3ff15b8fa2d5d33c
Jul 08 15:52:19.610657 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:19.609958    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-cxdfq"]
Jul 08 15:52:19.613685 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:52:19.613646    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde1a42ce_0b39_419a_a113_6cdc13b00ea9.slice/crio-197f22223ce2c21cdf6f0c2b927a0cdf77562503870c2f94ff1d2b32a4c6ba97 WatchSource:0}: Error finding container 197f22223ce2c21cdf6f0c2b927a0cdf77562503870c2f94ff1d2b32a4c6ba97: Status 404 returned error can't find the container with id 197f22223ce2c21cdf6f0c2b927a0cdf77562503870c2f94ff1d2b32a4c6ba97
Jul 08 15:52:20.001204 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:20.001142    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd" event={"ID":"64123bc7-8bfb-4b5d-8c64-36bf6e1902de","Type":"ContainerStarted","Data":"ee958a01e5a6f6dcc9e6f9c5af6a153bc49b10f17f6c2349562c9bf40f6c35f4"}
Jul 08 15:52:20.001687 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:20.001405    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd"
Jul 08 15:52:20.003182 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:20.003158    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd"
Jul 08 15:52:20.003408 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:20.003382    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb947dc78-4kzfx" event={"ID":"5bf998c2-788d-4334-8379-56296783f4ee","Type":"ContainerStarted","Data":"ed8b14f6920cecc7d64a920e912df3a73f01bc49f64f973f72ab624ed539d877"}
Jul 08 15:52:20.003500 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:20.003427    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb947dc78-4kzfx" event={"ID":"5bf998c2-788d-4334-8379-56296783f4ee","Type":"ContainerStarted","Data":"b3a79f42568de562ddadeb60c06bdfee34e67571a415822b3ff15b8fa2d5d33c"}
Jul 08 15:52:20.005127 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:20.005102    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbd6cb97c-xz9sz" event={"ID":"061749c8-4ff7-436d-96fe-3c6acd88cfa9","Type":"ContainerStarted","Data":"c7106838049b3e0dbe42b1059315b108d82f9b4b541125ca6f5f3a611789b222"}
Jul 08 15:52:20.006873 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:20.006850    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxdfq" event={"ID":"de1a42ce-0b39-419a-a113-6cdc13b00ea9","Type":"ContainerStarted","Data":"197f22223ce2c21cdf6f0c2b927a0cdf77562503870c2f94ff1d2b32a4c6ba97"}
Jul 08 15:52:20.021148 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:20.021100    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74c757f8df-8tbvd" podStartSLOduration=1.5264686969999999 podStartE2EDuration="12.021083135s" totalImagesPullingTime="10.494614438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:20.018827182 +0000 UTC m=+79.429491837" watchObservedRunningTime="2026-07-08 15:52:20.021083135 +0000 UTC m=+79.431747779"
Jul 08 15:52:20.058438 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:20.057898    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bbd6cb97c-xz9sz" podStartSLOduration=2.708146962 podStartE2EDuration="8.057874747s" totalImagesPullingTime="5.349727785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:52:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:20.056643049 +0000 UTC m=+79.467307702" watchObservedRunningTime="2026-07-08 15:52:20.057874747 +0000 UTC m=+79.468539402"
Jul 08 15:52:20.080434 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:20.080372    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fb947dc78-4kzfx" podStartSLOduration=3.741966843 podStartE2EDuration="4.08035172s" totalImagesPullingTime="338.384877ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:52:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:20.079825107 +0000 UTC m=+79.490489761" watchObservedRunningTime="2026-07-08 15:52:20.08035172 +0000 UTC m=+79.491016356"
Jul 08 15:52:20.583672 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:20.583638    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:20.643382 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:20.643347    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:22.321174 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:22.321129    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:22.601526 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:22.601443    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:22.601692 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:22.601533    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:22.606927 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:22.606901    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:23.027793 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:23.027760    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:23.174287 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:23.174254    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:23.321514 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:23.321419    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:23.861126 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:23.861093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:23.965982 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:23.965945    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:24.273892 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.273845    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:24.489542 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.489505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:24.525723 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.525630    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"]
Jul 08 15:52:24.529559 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.529533    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"
Jul 08 15:52:24.532544 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.532520    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 08 15:52:24.532701 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.532550    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 08 15:52:24.532701 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.532521    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 08 15:52:24.532701 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.532518    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-pzhm5\""
Jul 08 15:52:24.532701 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.532642    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 08 15:52:24.533103 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.533082    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 08 15:52:24.536855 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.536830    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"]
Jul 08 15:52:24.541059 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.540672    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.541059 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.540904    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"]
Jul 08 15:52:24.542329 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.542304    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g82ql"]
Jul 08 15:52:24.543524 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.543502    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 08 15:52:24.543839 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.543819    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7qhrp\""
Jul 08 15:52:24.543839 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.543829    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 08 15:52:24.543993 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.543822    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 08 15:52:24.545054 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.545033    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.547464 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.547445    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 08 15:52:24.547600 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.547569    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 08 15:52:24.547736 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.547714    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4sr77\""
Jul 08 15:52:24.547818 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.547718    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 08 15:52:24.559879 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.559852    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"]
Jul 08 15:52:24.579125 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.579079    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:24.629376 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.629341    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a6c8c07-988c-4eb2-a6ca-0c63d6490652-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-dsvgk\" (UID: \"9a6c8c07-988c-4eb2-a6ca-0c63d6490652\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"
Jul 08 15:52:24.629572 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.629382    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-tls\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.629572 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.629407    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.629572 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.629432    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52bdeb88-c265-4960-8411-4ac5fde63982-metrics-client-ca\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.629572 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.629490    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-textfile\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.629572 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.629535    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52bdeb88-c265-4960-8411-4ac5fde63982-sys\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.629843 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.629617    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.629843 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.629651    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj6xt\" (UniqueName: \"kubernetes.io/projected/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-api-access-bj6xt\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.629843 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.629681    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.629843 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.629727    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-wtmp\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.629843 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.629815    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a6c8c07-988c-4eb2-a6ca-0c63d6490652-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-dsvgk\" (UID: \"9a6c8c07-988c-4eb2-a6ca-0c63d6490652\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"
Jul 08 15:52:24.630004 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.629845    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-accelerators-collector-config\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.630004 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.629875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.630004 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.629907    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a6c8c07-988c-4eb2-a6ca-0c63d6490652-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-dsvgk\" (UID: \"9a6c8c07-988c-4eb2-a6ca-0c63d6490652\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"
Jul 08 15:52:24.630004 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.629933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs75m\" (UniqueName: \"kubernetes.io/projected/52bdeb88-c265-4960-8411-4ac5fde63982-kube-api-access-cs75m\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.630004 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.629971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.630004 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.629995    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.630218 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.630020    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52bdeb88-c265-4960-8411-4ac5fde63982-root\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.630218 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.630062    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25tf6\" (UniqueName: \"kubernetes.io/projected/9a6c8c07-988c-4eb2-a6ca-0c63d6490652-kube-api-access-25tf6\") pod \"openshift-state-metrics-54cf96dfcf-dsvgk\" (UID: \"9a6c8c07-988c-4eb2-a6ca-0c63d6490652\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"
Jul 08 15:52:24.658351 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.658317    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:24.730674 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.730633    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a6c8c07-988c-4eb2-a6ca-0c63d6490652-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-dsvgk\" (UID: \"9a6c8c07-988c-4eb2-a6ca-0c63d6490652\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"
Jul 08 15:52:24.730674 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.730675    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs75m\" (UniqueName: \"kubernetes.io/projected/52bdeb88-c265-4960-8411-4ac5fde63982-kube-api-access-cs75m\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.730921 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:52:24.730804    2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 08 15:52:24.730921 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.730808    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.730921 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:52:24.730884    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a6c8c07-988c-4eb2-a6ca-0c63d6490652-openshift-state-metrics-tls podName:9a6c8c07-988c-4eb2-a6ca-0c63d6490652 nodeName:}" failed. No retries permitted until 2026-07-08 15:52:25.230860314 +0000 UTC m=+84.641524949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9a6c8c07-988c-4eb2-a6ca-0c63d6490652-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-dsvgk" (UID: "9a6c8c07-988c-4eb2-a6ca-0c63d6490652") : secret "openshift-state-metrics-tls" not found
Jul 08 15:52:24.730921 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.730917    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.731125 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.730948    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52bdeb88-c265-4960-8411-4ac5fde63982-root\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.731125 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.730993    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25tf6\" (UniqueName: \"kubernetes.io/projected/9a6c8c07-988c-4eb2-a6ca-0c63d6490652-kube-api-access-25tf6\") pod \"openshift-state-metrics-54cf96dfcf-dsvgk\" (UID: \"9a6c8c07-988c-4eb2-a6ca-0c63d6490652\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"
Jul 08 15:52:24.731125 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.731030    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a6c8c07-988c-4eb2-a6ca-0c63d6490652-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-dsvgk\" (UID: \"9a6c8c07-988c-4eb2-a6ca-0c63d6490652\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"
Jul 08 15:52:24.731125 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.731061    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/52bdeb88-c265-4960-8411-4ac5fde63982-root\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.731125 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.731071    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-tls\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.731125 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:52:24.731085    2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 08 15:52:24.731125 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.731097    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.731125 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.731125    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52bdeb88-c265-4960-8411-4ac5fde63982-metrics-client-ca\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.731523 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:52:24.731136    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-state-metrics-tls podName:fbf121f5-e8be-4e15-9a1e-6f68a834b89a nodeName:}" failed. No retries permitted until 2026-07-08 15:52:25.231119951 +0000 UTC m=+84.641784590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-d7cpv" (UID: "fbf121f5-e8be-4e15-9a1e-6f68a834b89a") : secret "kube-state-metrics-tls" not found
Jul 08 15:52:24.731523 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.731172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-textfile\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.731523 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.731209    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52bdeb88-c265-4960-8411-4ac5fde63982-sys\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.731523 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:52:24.731219    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 15:52:24.731523 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.731259    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/52bdeb88-c265-4960-8411-4ac5fde63982-sys\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.731523 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:52:24.731269    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-tls podName:52bdeb88-c265-4960-8411-4ac5fde63982 nodeName:}" failed. No retries permitted until 2026-07-08 15:52:25.231251731 +0000 UTC m=+84.641916376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-tls") pod "node-exporter-g82ql" (UID: "52bdeb88-c265-4960-8411-4ac5fde63982") : secret "node-exporter-tls" not found
Jul 08 15:52:24.731523 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.731293    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.731523 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.731322    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj6xt\" (UniqueName: \"kubernetes.io/projected/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-api-access-bj6xt\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.731523 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.731353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.731523 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.731509    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-textfile\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.732154 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.731661    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.732154 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.731792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-wtmp\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.732154 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.731840    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a6c8c07-988c-4eb2-a6ca-0c63d6490652-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-dsvgk\" (UID: \"9a6c8c07-988c-4eb2-a6ca-0c63d6490652\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"
Jul 08 15:52:24.732154 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.731879    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-accelerators-collector-config\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.732154 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.731908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.732154 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.732017    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52bdeb88-c265-4960-8411-4ac5fde63982-metrics-client-ca\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.732154 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.732095    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.732610 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.732566    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.732701 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.732612    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-accelerators-collector-config\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.732701 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.732669    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-wtmp\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.732810 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.732715    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a6c8c07-988c-4eb2-a6ca-0c63d6490652-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-dsvgk\" (UID: \"9a6c8c07-988c-4eb2-a6ca-0c63d6490652\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"
Jul 08 15:52:24.733683 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.733663    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.733840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.733815    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a6c8c07-988c-4eb2-a6ca-0c63d6490652-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-dsvgk\" (UID: \"9a6c8c07-988c-4eb2-a6ca-0c63d6490652\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"
Jul 08 15:52:24.733964 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.733863    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.743271 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.743242    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs75m\" (UniqueName: \"kubernetes.io/projected/52bdeb88-c265-4960-8411-4ac5fde63982-kube-api-access-cs75m\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:24.744032 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.744001    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj6xt\" (UniqueName: \"kubernetes.io/projected/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-api-access-bj6xt\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:24.744280 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.744255    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25tf6\" (UniqueName: \"kubernetes.io/projected/9a6c8c07-988c-4eb2-a6ca-0c63d6490652-kube-api-access-25tf6\") pod \"openshift-state-metrics-54cf96dfcf-dsvgk\" (UID: \"9a6c8c07-988c-4eb2-a6ca-0c63d6490652\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"
Jul 08 15:52:24.759512 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.759484    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:24.863668 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.863553    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:24.960747 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:24.960659    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:25.058902 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.058865    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:25.236733 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.236651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a6c8c07-988c-4eb2-a6ca-0c63d6490652-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-dsvgk\" (UID: \"9a6c8c07-988c-4eb2-a6ca-0c63d6490652\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"
Jul 08 15:52:25.236733 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.236709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:25.236969 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.236776    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-tls\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:25.236969 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:52:25.236888    2562 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 08 15:52:25.236969 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:52:25.236956    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-state-metrics-tls podName:fbf121f5-e8be-4e15-9a1e-6f68a834b89a nodeName:}" failed. No retries permitted until 2026-07-08 15:52:26.236939019 +0000 UTC m=+85.647603654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-d7cpv" (UID: "fbf121f5-e8be-4e15-9a1e-6f68a834b89a") : secret "kube-state-metrics-tls" not found
Jul 08 15:52:25.237145 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:52:25.236893    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 08 15:52:25.237145 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:52:25.237053    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-tls podName:52bdeb88-c265-4960-8411-4ac5fde63982 nodeName:}" failed. No retries permitted until 2026-07-08 15:52:26.237030788 +0000 UTC m=+85.647695435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-tls") pod "node-exporter-g82ql" (UID: "52bdeb88-c265-4960-8411-4ac5fde63982") : secret "node-exporter-tls" not found
Jul 08 15:52:25.239532 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.239507    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a6c8c07-988c-4eb2-a6ca-0c63d6490652-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-dsvgk\" (UID: \"9a6c8c07-988c-4eb2-a6ca-0c63d6490652\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"
Jul 08 15:52:25.285638 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.285598    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:25.387023 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.386987    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:25.442375 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.442338    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"
Jul 08 15:52:25.491899 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.491811    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:25.588461 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.588424    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:25.593627 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.593552    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 15:52:25.597537 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.597515    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.600045 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.600021    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 08 15:52:25.602369 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.602325    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 08 15:52:25.602369 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.602325    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 08 15:52:25.602647 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.602432    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 08 15:52:25.602647 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.602466    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 08 15:52:25.602647 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.602523    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 08 15:52:25.602647 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.602534    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 08 15:52:25.602884 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.602786    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2cqmt\""
Jul 08 15:52:25.603047 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.603021    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 08 15:52:25.603103 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.603047    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 08 15:52:25.612667 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.612639    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 15:52:25.694434 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.694398    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:25.741428 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.741387    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.741653 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.741464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.741653 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.741564    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.741653 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.741629    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f23e8478-c4b7-47f8-925f-de2f32c27be6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.741801 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.741668    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf4r4\" (UniqueName: \"kubernetes.io/projected/f23e8478-c4b7-47f8-925f-de2f32c27be6-kube-api-access-bf4r4\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.741801 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.741722    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-web-config\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.741801 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.741748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.741801 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.741770    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f23e8478-c4b7-47f8-925f-de2f32c27be6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.741801 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.741798    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f23e8478-c4b7-47f8-925f-de2f32c27be6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.742040 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.741841    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-config-volume\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.742040 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.741873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.742040 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.741895    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f23e8478-c4b7-47f8-925f-de2f32c27be6-config-out\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.742040 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.741910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f23e8478-c4b7-47f8-925f-de2f32c27be6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.843082 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.843041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.843253 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.843194    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.843253 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.843237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.843429 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.843402    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f23e8478-c4b7-47f8-925f-de2f32c27be6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.843497 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.843457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf4r4\" (UniqueName: \"kubernetes.io/projected/f23e8478-c4b7-47f8-925f-de2f32c27be6-kube-api-access-bf4r4\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.843647 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.843612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-web-config\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.843770 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.843665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.843770 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.843702    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f23e8478-c4b7-47f8-925f-de2f32c27be6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.843770 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.843733    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f23e8478-c4b7-47f8-925f-de2f32c27be6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.843770 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.843760    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-config-volume\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.843989 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.843797    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.843989 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.843831    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f23e8478-c4b7-47f8-925f-de2f32c27be6-config-out\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.843989 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.843867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f23e8478-c4b7-47f8-925f-de2f32c27be6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.844316 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.844291    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f23e8478-c4b7-47f8-925f-de2f32c27be6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.845779 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.844475    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f23e8478-c4b7-47f8-925f-de2f32c27be6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.845779 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.845134    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f23e8478-c4b7-47f8-925f-de2f32c27be6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.845779 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:52:25.845233    2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 08 15:52:25.845779 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:52:25.845295    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-main-tls podName:f23e8478-c4b7-47f8-925f-de2f32c27be6 nodeName:}" failed. No retries permitted until 2026-07-08 15:52:26.345274205 +0000 UTC m=+85.755938841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "f23e8478-c4b7-47f8-925f-de2f32c27be6") : secret "alertmanager-main-tls" not found
Jul 08 15:52:25.846558 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.846495    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f23e8478-c4b7-47f8-925f-de2f32c27be6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.847412 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.847368    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.847412 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.847397    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-web-config\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.848233 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.848207    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.848392 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.848368    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.848538 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.848520    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f23e8478-c4b7-47f8-925f-de2f32c27be6-config-out\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.848640 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.848602    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-config-volume\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.849020 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.848996    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.859570 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.859545    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf4r4\" (UniqueName: \"kubernetes.io/projected/f23e8478-c4b7-47f8-925f-de2f32c27be6-kube-api-access-bf4r4\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:25.993014 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:25.992925    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n85j9"
Jul 08 15:52:26.241622 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.241569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:26.247704 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.247629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:26.247704 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.247701    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-tls\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:26.250248 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.250226    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/52bdeb88-c265-4960-8411-4ac5fde63982-node-exporter-tls\") pod \"node-exporter-g82ql\" (UID: \"52bdeb88-c265-4960-8411-4ac5fde63982\") " pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:26.250488 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.250461    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fbf121f5-e8be-4e15-9a1e-6f68a834b89a-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-d7cpv\" (UID: \"fbf121f5-e8be-4e15-9a1e-6f68a834b89a\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:26.348844 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.348805    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:26.351597 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.351549    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:26.353370 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.353348    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"
Jul 08 15:52:26.361440 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.361412    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g82ql"
Jul 08 15:52:26.509822 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.509739    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:52:26.519246 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.519222    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-865d8fc895-7dxhx"]
Jul 08 15:52:26.523944 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.523922    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.527106 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.527078    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 08 15:52:26.527718 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.527563    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 08 15:52:26.527718 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.527597    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 08 15:52:26.527978 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.527959    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 08 15:52:26.528044 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.528008    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-4rlvk\""
Jul 08 15:52:26.528044 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.528033    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 08 15:52:26.528815 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.528792    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6sirn2100s4nd\""
Jul 08 15:52:26.538113 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.538091    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-865d8fc895-7dxhx"]
Jul 08 15:52:26.624758 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.624726    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:26.624949 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.624796    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:26.629885 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.629862    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:26.651679 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.651642    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.651845 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.651698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.651845 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.651784    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.651845 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.651826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-metrics-client-ca\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.651995 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.651855    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-thanos-querier-tls\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.651995 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.651952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-grpc-tls\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.651995 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.651978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzd8q\" (UniqueName: \"kubernetes.io/projected/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-kube-api-access-nzd8q\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.652165 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.652009    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.753219 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.753182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-thanos-querier-tls\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.753407 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.753270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-grpc-tls\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.753407 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.753296    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzd8q\" (UniqueName: \"kubernetes.io/projected/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-kube-api-access-nzd8q\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.753407 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.753366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.753407 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.753401    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.753595 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.753452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.753595 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.753514    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.753595 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.753558    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-metrics-client-ca\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.754765 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.754682    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-metrics-client-ca\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.756545 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.756516    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.756684 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.756528    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-thanos-querier-tls\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.757191 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.757168    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.757276 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.757241    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.757811 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.757789    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-grpc-tls\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.758019 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.757991    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.762336 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.762316    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzd8q\" (UniqueName: \"kubernetes.io/projected/73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703-kube-api-access-nzd8q\") pod \"thanos-querier-865d8fc895-7dxhx\" (UID: \"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703\") " pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:26.835008 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:26.834965    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:27.043502 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:27.043430    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:52:27.091171 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:27.091138    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bbd6cb97c-xz9sz"]
Jul 08 15:52:27.198787 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:27.198761    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:27.313426 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:27.313345    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:27.373057 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:27.373026    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:27.480047 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:27.480005    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:27.580144 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:27.580058    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:27.688163 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:27.688125    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:28.009551 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:28.009476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:29.315472 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:29.315431    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:29.416102 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:29.416061    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:29.583613 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:29.583503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:29.695528 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:29.695496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:29.770243 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:29.770206    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:29.927413 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:29.927340    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:29.991614 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:29.991565    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:30.820467 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.820429    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:30.829901 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.829870    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 15:52:30.856971 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.856934    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.862518 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.862388    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 15:52:30.862701 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.862655    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 15:52:30.863115 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.863087    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4lbu445ibac0r\""
Jul 08 15:52:30.864607 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.864417    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 15:52:30.864698 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.864678    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 15:52:30.864772 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.864678    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 15:52:30.864833 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.864809    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 15:52:30.865233 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.865213    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 15:52:30.865528 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.865513    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 15:52:30.866016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.865880    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 15:52:30.866016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.865952    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ljcz9\""
Jul 08 15:52:30.866366 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.866347    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 15:52:30.866471 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.866425    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 15:52:30.866533 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.866477    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 15:52:30.866617 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.866537    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 15:52:30.866617 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.866563    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 15:52:30.867853 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.867831    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 15:52:30.871356 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.871338    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 15:52:30.950905 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.950791    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6dc99fdc68-9gqbh"
Jul 08 15:52:30.995840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.994988    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.995840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995030    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-web-config\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.995840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.995840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995113    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.995840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995160    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.995840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995185    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.995840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-config\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.995840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995230    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.995840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995258    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.995840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995282    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.995840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995306    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qljmr\" (UniqueName: \"kubernetes.io/projected/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-kube-api-access-qljmr\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.995840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995344    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.995840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.995840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995425    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.995840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.995840 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995496    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.996793 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995521    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.996793 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995561    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.996793 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:30.996793 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:30.995627    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-config-out\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.056475 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.056448    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g82ql" event={"ID":"52bdeb88-c265-4960-8411-4ac5fde63982","Type":"ContainerStarted","Data":"15c78040bf48eaf3c769f35484d69d7e51468294210e84d3f3c071472688f10e"}
Jul 08 15:52:31.096844 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.096806    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.096844 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.096839    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097053 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.096890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097053 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.096915    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097053 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.096932    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097053 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.096947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097053 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.096990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097053 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.097010    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097053 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.097025    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-config-out\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097053 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.097057    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097520 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.097072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-web-config\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097520 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.097093    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097520 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.097136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097520 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.097173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097520 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.097190    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097520 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.097208    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-config\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097520 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.097222    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097520 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.097242    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097520 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.097258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.097520 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.097273    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qljmr\" (UniqueName: \"kubernetes.io/projected/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-kube-api-access-qljmr\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.098711 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.098311    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.099954 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.099528    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.099954 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.099917    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.100141 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.100113    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.103029 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.101272    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.103029 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.101797    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.103029 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.102247    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.103029 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.102364    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.103847 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.103611    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.103847 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.103801    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.106388 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.106351    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.107055 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.106989    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-config\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.108038 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.107980    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-web-config\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.108146 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.108092    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.108206 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.108176    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.108860 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.108532    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-config-out\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.108860 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.108820    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.109336 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.109168    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qljmr\" (UniqueName: \"kubernetes.io/projected/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-kube-api-access-qljmr\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.109336 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.109300    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.109945 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.109915    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.126721 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.126615    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 15:52:31.128492 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:52:31.128445    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf23e8478_c4b7_47f8_925f_de2f32c27be6.slice/crio-4d6a1d2742c0de33f96ccf13ea9c0d813d11b2301e3e011952af43250a6dd950 WatchSource:0}: Error finding container 4d6a1d2742c0de33f96ccf13ea9c0d813d11b2301e3e011952af43250a6dd950: Status 404 returned error can't find the container with id 4d6a1d2742c0de33f96ccf13ea9c0d813d11b2301e3e011952af43250a6dd950
Jul 08 15:52:31.130759 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.130732    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:31.168424 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.168390    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:31.195922 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.195891    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv"]
Jul 08 15:52:31.198259 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:52:31.198230    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf121f5_e8be_4e15_9a1e_6f68a834b89a.slice/crio-c4cdc85369922c0daaffb0bf7012e439b5fd836b8a55efa67b1b1f6dbb6c2172 WatchSource:0}: Error finding container c4cdc85369922c0daaffb0bf7012e439b5fd836b8a55efa67b1b1f6dbb6c2172: Status 404 returned error can't find the container with id c4cdc85369922c0daaffb0bf7012e439b5fd836b8a55efa67b1b1f6dbb6c2172
Jul 08 15:52:31.283599 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.280544    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:31.374381 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.374298    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk"]
Jul 08 15:52:31.376644 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.376620    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-865d8fc895-7dxhx"]
Jul 08 15:52:31.379908 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:52:31.379875    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73e1fbfa_e4b7_41c9_b63f_6f8bb24ca703.slice/crio-7a4d1722e50de94f41d9ddf2a26cdbd592780228b36b0df664a94e82f171a331 WatchSource:0}: Error finding container 7a4d1722e50de94f41d9ddf2a26cdbd592780228b36b0df664a94e82f171a331: Status 404 returned error can't find the container with id 7a4d1722e50de94f41d9ddf2a26cdbd592780228b36b0df664a94e82f171a331
Jul 08 15:52:31.381879 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:31.381784    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 15:52:31.384241 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:52:31.384210    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34229ef_0d67_4a10_84d0_7e61ac6c9aec.slice/crio-7b4fe0a46404e655b52e9db7180fb3b25783b603e607347ff6ea9ab9ff30f2ff WatchSource:0}: Error finding container 7b4fe0a46404e655b52e9db7180fb3b25783b603e607347ff6ea9ab9ff30f2ff: Status 404 returned error can't find the container with id 7b4fe0a46404e655b52e9db7180fb3b25783b603e607347ff6ea9ab9ff30f2ff
Jul 08 15:52:32.067613 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:32.065206    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-xbt6w" event={"ID":"dbf4d6fb-0a5f-43b8-b66a-95071d5c0882","Type":"ContainerStarted","Data":"8e75b7b6e5bfa502f10cbf3c4e36bc06fb905ac26c6f5c5fc042b16fa9c7d961"}
Jul 08 15:52:32.069129 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:32.068139    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-xbt6w"
Jul 08 15:52:32.072707 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:32.072676    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d34229ef-0d67-4a10-84d0-7e61ac6c9aec","Type":"ContainerStarted","Data":"7b4fe0a46404e655b52e9db7180fb3b25783b603e607347ff6ea9ab9ff30f2ff"}
Jul 08 15:52:32.076124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:32.075956    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk" event={"ID":"9a6c8c07-988c-4eb2-a6ca-0c63d6490652","Type":"ContainerStarted","Data":"fe6d1ff6ca807bcaeca3e267d05efb775c1d2cb47b99ed2909b4d318ad4af774"}
Jul 08 15:52:32.076124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:32.076011    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk" event={"ID":"9a6c8c07-988c-4eb2-a6ca-0c63d6490652","Type":"ContainerStarted","Data":"4011cc86ac8f4d9987f1d06f29fdf0400c5954a6fc8993abaa05458ba231f81b"}
Jul 08 15:52:32.076124 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:32.076039    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk" event={"ID":"9a6c8c07-988c-4eb2-a6ca-0c63d6490652","Type":"ContainerStarted","Data":"5e2cfd41961ef3195630105cfff292c1e62d90657605e2575aee7bdff4993d5a"}
Jul 08 15:52:32.077597 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:32.077541    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-xbt6w"
Jul 08 15:52:32.080292 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:32.080229    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv" event={"ID":"fbf121f5-e8be-4e15-9a1e-6f68a834b89a","Type":"ContainerStarted","Data":"c4cdc85369922c0daaffb0bf7012e439b5fd836b8a55efa67b1b1f6dbb6c2172"}
Jul 08 15:52:32.099659 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:32.089741    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-xbt6w" podStartSLOduration=2.179937282 podStartE2EDuration="24.089718802s" totalImagesPullingTime="21.90978152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:32.089048589 +0000 UTC m=+91.499713242" watchObservedRunningTime="2026-07-08 15:52:32.089718802 +0000 UTC m=+91.500383459"
Jul 08 15:52:32.109845 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:32.109799    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx" event={"ID":"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703","Type":"ContainerStarted","Data":"7a4d1722e50de94f41d9ddf2a26cdbd592780228b36b0df664a94e82f171a331"}
Jul 08 15:52:32.113499 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:32.113455    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxdfq" event={"ID":"de1a42ce-0b39-419a-a113-6cdc13b00ea9","Type":"ContainerStarted","Data":"55a249ad654ead2cfba815fc02c7ceffbd0100a0a6c3d4c2fbef49d119cd257e"}
Jul 08 15:52:32.116433 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:32.116403    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f23e8478-c4b7-47f8-925f-de2f32c27be6","Type":"ContainerStarted","Data":"4d6a1d2742c0de33f96ccf13ea9c0d813d11b2301e3e011952af43250a6dd950"}
Jul 08 15:52:32.714510 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:32.714472    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:32.815120 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:32.814950    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:33.613154 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:33.613118    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:33.830224 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:33.830171    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:34.987893 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:34.987853    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:35.065457 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:35.065417    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:36.142652 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:36.142618    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxdfq" event={"ID":"de1a42ce-0b39-419a-a113-6cdc13b00ea9","Type":"ContainerStarted","Data":"e5c2f9ae7015e134f43c9b01fe8e342353ef62f8cdb339889c9d107db7beca56"}
Jul 08 15:52:36.147315 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:36.147241    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f23e8478-c4b7-47f8-925f-de2f32c27be6","Type":"ContainerStarted","Data":"90da1e4ca228ad111348b7c3b530112df50b86023b912994ee504a26b659ea43"}
Jul 08 15:52:36.150886 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:36.150761    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g82ql" event={"ID":"52bdeb88-c265-4960-8411-4ac5fde63982","Type":"ContainerStarted","Data":"ad846b52e2fdc44e4f32613513d5f62bd29b24fbb3cde5626e2c062f64895455"}
Jul 08 15:52:37.163530 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:37.162129    2562 generic.go:356] "Generic (PLEG): container finished" podID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerID="59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6" exitCode=0
Jul 08 15:52:37.163530 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:37.162383    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d34229ef-0d67-4a10-84d0-7e61ac6c9aec","Type":"ContainerDied","Data":"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6"}
Jul 08 15:52:37.171065 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:37.171032    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk" event={"ID":"9a6c8c07-988c-4eb2-a6ca-0c63d6490652","Type":"ContainerStarted","Data":"673f0882574a5d24afbddde3ad74461e49b28e39a766d1c567ed8e4f5d998802"}
Jul 08 15:52:37.176025 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:37.175828    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv" event={"ID":"fbf121f5-e8be-4e15-9a1e-6f68a834b89a","Type":"ContainerStarted","Data":"55e8689fd22a0371a9b8e3c7679859978ee80c2dea38b79f9c07ef19d324ab00"}
Jul 08 15:52:37.176025 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:37.175890    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv" event={"ID":"fbf121f5-e8be-4e15-9a1e-6f68a834b89a","Type":"ContainerStarted","Data":"a1e8ebe36a204f409991fae622b7544fcff6de362990b4302087553edc1eef8b"}
Jul 08 15:52:37.176025 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:37.175921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv" event={"ID":"fbf121f5-e8be-4e15-9a1e-6f68a834b89a","Type":"ContainerStarted","Data":"9b93e5c785e5c5a346f8071aebfe88af2ced9afdaf4dbc2f97069c25651b367a"}
Jul 08 15:52:37.179709 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:37.179666    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx" event={"ID":"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703","Type":"ContainerStarted","Data":"53ee21fd50a945b25f18c8de952387515b4ffc9e72d0a1b07837dab0664662ed"}
Jul 08 15:52:37.179979 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:37.179904    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx" event={"ID":"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703","Type":"ContainerStarted","Data":"27fdd43b8693f9cd532d278c5b50b6509ecfea6cef11a960750533328c88469e"}
Jul 08 15:52:37.180130 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:37.180073    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx" event={"ID":"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703","Type":"ContainerStarted","Data":"a042c45ed4d25aa28af513213298159e05ec9ff4be2078e20d5a4769a22e8624"}
Jul 08 15:52:37.181937 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:37.181909    2562 generic.go:356] "Generic (PLEG): container finished" podID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerID="90da1e4ca228ad111348b7c3b530112df50b86023b912994ee504a26b659ea43" exitCode=0
Jul 08 15:52:37.182303 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:37.182229    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f23e8478-c4b7-47f8-925f-de2f32c27be6","Type":"ContainerDied","Data":"90da1e4ca228ad111348b7c3b530112df50b86023b912994ee504a26b659ea43"}
Jul 08 15:52:37.185351 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:37.185312    2562 generic.go:356] "Generic (PLEG): container finished" podID="52bdeb88-c265-4960-8411-4ac5fde63982" containerID="ad846b52e2fdc44e4f32613513d5f62bd29b24fbb3cde5626e2c062f64895455" exitCode=0
Jul 08 15:52:37.185612 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:37.185360    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g82ql" event={"ID":"52bdeb88-c265-4960-8411-4ac5fde63982","Type":"ContainerDied","Data":"ad846b52e2fdc44e4f32613513d5f62bd29b24fbb3cde5626e2c062f64895455"}
Jul 08 15:52:37.215014 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:37.214948    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-d7cpv" podStartSLOduration=8.699599814 podStartE2EDuration="13.214933086s" totalImagesPullingTime="4.515333272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:37.213212762 +0000 UTC m=+96.623877418" watchObservedRunningTime="2026-07-08 15:52:37.214933086 +0000 UTC m=+96.625597718"
Jul 08 15:52:37.285841 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:37.284478    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-dsvgk" podStartSLOduration=8.869954963 podStartE2EDuration="13.284455478s" totalImagesPullingTime="4.414500515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:37.27724894 +0000 UTC m=+96.687913596" watchObservedRunningTime="2026-07-08 15:52:37.284455478 +0000 UTC m=+96.695120133"
Jul 08 15:52:38.195719 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:38.195598    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g82ql" event={"ID":"52bdeb88-c265-4960-8411-4ac5fde63982","Type":"ContainerStarted","Data":"8983fcd6af1f18366543583290f7bca418bb870b4946f18c299bb0c1629e4aa1"}
Jul 08 15:52:38.196782 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:38.196755    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g82ql" event={"ID":"52bdeb88-c265-4960-8411-4ac5fde63982","Type":"ContainerStarted","Data":"ae937018df2a8e17dd474168a10235b2dbb670f399b8eb487db58b182bbde7e0"}
Jul 08 15:52:38.222885 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:38.222815    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g82ql" podStartSLOduration=9.286821418 podStartE2EDuration="14.222791917s" totalImagesPullingTime="4.782116261s" totalInitContainerRuntime="153.854238ms" isStatefulPod=true podCreationTimestamp="2026-07-08 15:52:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:38.220719522 +0000 UTC m=+97.631384179" watchObservedRunningTime="2026-07-08 15:52:38.222791917 +0000 UTC m=+97.633456572"
Jul 08 15:52:40.142167 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:40.142136    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:40.242593 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:40.242554    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:42.641378 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:42.641240    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:43.223536 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.223502    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d34229ef-0d67-4a10-84d0-7e61ac6c9aec","Type":"ContainerStarted","Data":"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d"}
Jul 08 15:52:43.223986 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.223598    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d34229ef-0d67-4a10-84d0-7e61ac6c9aec","Type":"ContainerStarted","Data":"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d"}
Jul 08 15:52:43.223986 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.223643    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d34229ef-0d67-4a10-84d0-7e61ac6c9aec","Type":"ContainerStarted","Data":"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4"}
Jul 08 15:52:43.223986 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.223667    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d34229ef-0d67-4a10-84d0-7e61ac6c9aec","Type":"ContainerStarted","Data":"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127"}
Jul 08 15:52:43.223986 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.223697    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d34229ef-0d67-4a10-84d0-7e61ac6c9aec","Type":"ContainerStarted","Data":"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e"}
Jul 08 15:52:43.223986 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.223729    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d34229ef-0d67-4a10-84d0-7e61ac6c9aec","Type":"ContainerStarted","Data":"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d"}
Jul 08 15:52:43.226299 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.226269    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx" event={"ID":"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703","Type":"ContainerStarted","Data":"6a3a547eea785cd341deecbcaba45c0709a282fb05960649d111dfe3cac2d017"}
Jul 08 15:52:43.226419 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.226340    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:43.226419 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.226378    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx" event={"ID":"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703","Type":"ContainerStarted","Data":"ae15f25d584f0c15eb6c1c261afbaf07845d37398d528eb47aef35d22b39318d"}
Jul 08 15:52:43.226419 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.226405    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx" event={"ID":"73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703","Type":"ContainerStarted","Data":"e567f36f3747dcc6403869573ba79e8c2f65baa3a29f3bb39c92713d6e99aab7"}
Jul 08 15:52:43.228595 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.228547    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-cxdfq" event={"ID":"de1a42ce-0b39-419a-a113-6cdc13b00ea9","Type":"ContainerStarted","Data":"3a91231495f7808bfcf870b93e674ec62014ffb7a17f70612dc07bd06945a8c0"}
Jul 08 15:52:43.232089 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.232062    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f23e8478-c4b7-47f8-925f-de2f32c27be6","Type":"ContainerStarted","Data":"b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a"}
Jul 08 15:52:43.232217 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.232116    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f23e8478-c4b7-47f8-925f-de2f32c27be6","Type":"ContainerStarted","Data":"ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce"}
Jul 08 15:52:43.232217 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.232141    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f23e8478-c4b7-47f8-925f-de2f32c27be6","Type":"ContainerStarted","Data":"4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610"}
Jul 08 15:52:43.232217 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.232169    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f23e8478-c4b7-47f8-925f-de2f32c27be6","Type":"ContainerStarted","Data":"3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c"}
Jul 08 15:52:43.232217 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.232206    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f23e8478-c4b7-47f8-925f-de2f32c27be6","Type":"ContainerStarted","Data":"555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad"}
Jul 08 15:52:43.232407 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.232245    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f23e8478-c4b7-47f8-925f-de2f32c27be6","Type":"ContainerStarted","Data":"c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88"}
Jul 08 15:52:43.232527 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.232511    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx"
Jul 08 15:52:43.255144 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.255079    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.705388298 podStartE2EDuration="13.255060295s" totalImagesPullingTime="9.528166017s" totalInitContainerRuntime="21.50598ms" isStatefulPod=false podCreationTimestamp="2026-07-08 15:52:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:43.253693482 +0000 UTC m=+102.664358136" watchObservedRunningTime="2026-07-08 15:52:43.255060295 +0000 UTC m=+102.665724950"
Jul 08 15:52:43.283976 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.283925    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.493099312 podStartE2EDuration="18.283910574s" totalImagesPullingTime="9.754575491s" totalInitContainerRuntime="36.235771ms" isStatefulPod=false podCreationTimestamp="2026-07-08 15:52:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:43.282273461 +0000 UTC m=+102.692938123" watchObservedRunningTime="2026-07-08 15:52:43.283910574 +0000 UTC m=+102.694575247"
Jul 08 15:52:43.287892 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.287857    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:43.307995 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.307943    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-865d8fc895-7dxhx" podStartSLOduration=6.942398167 podStartE2EDuration="17.30792391s" totalImagesPullingTime="10.365525743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:52:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:43.304450088 +0000 UTC m=+102.715114749" watchObservedRunningTime="2026-07-08 15:52:43.30792391 +0000 UTC m=+102.718588565"
Jul 08 15:52:43.323935 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.323891    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-cxdfq" podStartSLOduration=36.072899422 podStartE2EDuration="58.323875027s" totalImagesPullingTime="22.250975605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:51:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:52:43.323290577 +0000 UTC m=+102.733955232" watchObservedRunningTime="2026-07-08 15:52:43.323875027 +0000 UTC m=+102.734539681"
Jul 08 15:52:43.390368 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:43.390336    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:44.126910 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:44.126879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:44.227340 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:44.227310    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:45.781387 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:45.781351    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fb947dc78-4kzfx"]
Jul 08 15:52:45.985559 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:45.985527    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mq6mh"
Jul 08 15:52:46.052042 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:46.051963    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:46.152391 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:46.152359    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:46.168952 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:46.168920    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:52:52.114171 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.114105    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-bbd6cb97c-xz9sz" podUID="061749c8-4ff7-436d-96fe-3c6acd88cfa9" containerName="console" containerID="cri-o://c7106838049b3e0dbe42b1059315b108d82f9b4b541125ca6f5f3a611789b222" gracePeriod=15
Jul 08 15:52:52.273433 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.272097    2562 generic.go:356] "Generic (PLEG): container finished" podID="061749c8-4ff7-436d-96fe-3c6acd88cfa9" containerID="c7106838049b3e0dbe42b1059315b108d82f9b4b541125ca6f5f3a611789b222" exitCode=0
Jul 08 15:52:52.273433 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.272210    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbd6cb97c-xz9sz" event={"ID":"061749c8-4ff7-436d-96fe-3c6acd88cfa9","Type":"ContainerDied","Data":"c7106838049b3e0dbe42b1059315b108d82f9b4b541125ca6f5f3a611789b222"}
Jul 08 15:52:52.392708 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.392680    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:52.500724 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.500686    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdxg8\" (UniqueName: \"kubernetes.io/projected/061749c8-4ff7-436d-96fe-3c6acd88cfa9-kube-api-access-jdxg8\") pod \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") "
Jul 08 15:52:52.500904 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.500735    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-config\") pod \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") "
Jul 08 15:52:52.500904 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.500765    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-oauth-serving-cert\") pod \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") "
Jul 08 15:52:52.500904 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.500802    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-oauth-config\") pod \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") "
Jul 08 15:52:52.501055 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.500905    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-service-ca\") pod \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") "
Jul 08 15:52:52.501055 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.500940    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-serving-cert\") pod \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\" (UID: \"061749c8-4ff7-436d-96fe-3c6acd88cfa9\") "
Jul 08 15:52:52.501286 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.501252    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "061749c8-4ff7-436d-96fe-3c6acd88cfa9" (UID: "061749c8-4ff7-436d-96fe-3c6acd88cfa9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:52:52.501286 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.501272    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-config" (OuterVolumeSpecName: "console-config") pod "061749c8-4ff7-436d-96fe-3c6acd88cfa9" (UID: "061749c8-4ff7-436d-96fe-3c6acd88cfa9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:52:52.501425 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.501374    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-service-ca" (OuterVolumeSpecName: "service-ca") pod "061749c8-4ff7-436d-96fe-3c6acd88cfa9" (UID: "061749c8-4ff7-436d-96fe-3c6acd88cfa9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:52:52.503132 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.503102    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/061749c8-4ff7-436d-96fe-3c6acd88cfa9-kube-api-access-jdxg8" (OuterVolumeSpecName: "kube-api-access-jdxg8") pod "061749c8-4ff7-436d-96fe-3c6acd88cfa9" (UID: "061749c8-4ff7-436d-96fe-3c6acd88cfa9"). InnerVolumeSpecName "kube-api-access-jdxg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:52:52.503237 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.503138    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "061749c8-4ff7-436d-96fe-3c6acd88cfa9" (UID: "061749c8-4ff7-436d-96fe-3c6acd88cfa9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:52:52.503237 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.503211    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "061749c8-4ff7-436d-96fe-3c6acd88cfa9" (UID: "061749c8-4ff7-436d-96fe-3c6acd88cfa9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:52:52.601732 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.601699    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-oauth-config\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:52:52.601732 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.601728    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-service-ca\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:52:52.601732 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.601738    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-serving-cert\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:52:52.601966 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.601746    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdxg8\" (UniqueName: \"kubernetes.io/projected/061749c8-4ff7-436d-96fe-3c6acd88cfa9-kube-api-access-jdxg8\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:52:52.601966 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.601755    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-console-config\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:52:52.601966 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.601762    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/061749c8-4ff7-436d-96fe-3c6acd88cfa9-oauth-serving-cert\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:52:52.691860 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.691828    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:52.983071 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:52.982984    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:53.084905 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:53.084873    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:53.184934 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:53.184902    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:53.278154 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:53.278127    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bbd6cb97c-xz9sz"
Jul 08 15:52:53.278154 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:53.278145    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bbd6cb97c-xz9sz" event={"ID":"061749c8-4ff7-436d-96fe-3c6acd88cfa9","Type":"ContainerDied","Data":"171ff48c6c74a14ecde711505baf8ffd14ab0c9b8896417a92e7c7b45bff0d0d"}
Jul 08 15:52:53.278389 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:53.278221    2562 scope.go:117] "RemoveContainer" containerID="c7106838049b3e0dbe42b1059315b108d82f9b4b541125ca6f5f3a611789b222"
Jul 08 15:52:53.299128 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:53.299104    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bbd6cb97c-xz9sz"]
Jul 08 15:52:53.303662 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:53.303640    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bbd6cb97c-xz9sz"]
Jul 08 15:52:54.616451 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:54.616419    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="061749c8-4ff7-436d-96fe-3c6acd88cfa9" path="/var/lib/kubelet/pods/061749c8-4ff7-436d-96fe-3c6acd88cfa9/volumes"
Jul 08 15:52:58.313982 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:58.313936    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:52:58.405955 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:52:58.405920    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:53:10.802632 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:10.802554    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5fb947dc78-4kzfx" podUID="5bf998c2-788d-4334-8379-56296783f4ee" containerName="console" containerID="cri-o://ed8b14f6920cecc7d64a920e912df3a73f01bc49f64f973f72ab624ed539d877" gracePeriod=15
Jul 08 15:53:11.079408 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.079348    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:53:11.171342 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.171304    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bf998c2-788d-4334-8379-56296783f4ee-console-serving-cert\") pod \"5bf998c2-788d-4334-8379-56296783f4ee\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") "
Jul 08 15:53:11.171515 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.171353    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-console-config\") pod \"5bf998c2-788d-4334-8379-56296783f4ee\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") "
Jul 08 15:53:11.171515 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.171391    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-trusted-ca-bundle\") pod \"5bf998c2-788d-4334-8379-56296783f4ee\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") "
Jul 08 15:53:11.171515 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.171427    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-service-ca\") pod \"5bf998c2-788d-4334-8379-56296783f4ee\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") "
Jul 08 15:53:11.171515 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.171448    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bf998c2-788d-4334-8379-56296783f4ee-console-oauth-config\") pod \"5bf998c2-788d-4334-8379-56296783f4ee\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") "
Jul 08 15:53:11.171515 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.171489    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-oauth-serving-cert\") pod \"5bf998c2-788d-4334-8379-56296783f4ee\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") "
Jul 08 15:53:11.171817 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.171543    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmd74\" (UniqueName: \"kubernetes.io/projected/5bf998c2-788d-4334-8379-56296783f4ee-kube-api-access-bmd74\") pod \"5bf998c2-788d-4334-8379-56296783f4ee\" (UID: \"5bf998c2-788d-4334-8379-56296783f4ee\") "
Jul 08 15:53:11.171947 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.171914    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5bf998c2-788d-4334-8379-56296783f4ee" (UID: "5bf998c2-788d-4334-8379-56296783f4ee"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:53:11.172026 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.171953    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-service-ca" (OuterVolumeSpecName: "service-ca") pod "5bf998c2-788d-4334-8379-56296783f4ee" (UID: "5bf998c2-788d-4334-8379-56296783f4ee"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:53:11.172026 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.171963    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-console-config" (OuterVolumeSpecName: "console-config") pod "5bf998c2-788d-4334-8379-56296783f4ee" (UID: "5bf998c2-788d-4334-8379-56296783f4ee"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:53:11.172026 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.172002    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5bf998c2-788d-4334-8379-56296783f4ee" (UID: "5bf998c2-788d-4334-8379-56296783f4ee"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:53:11.173525 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.173501    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bf998c2-788d-4334-8379-56296783f4ee-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5bf998c2-788d-4334-8379-56296783f4ee" (UID: "5bf998c2-788d-4334-8379-56296783f4ee"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:11.173714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.173521    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bf998c2-788d-4334-8379-56296783f4ee-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5bf998c2-788d-4334-8379-56296783f4ee" (UID: "5bf998c2-788d-4334-8379-56296783f4ee"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:11.173714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.173602    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bf998c2-788d-4334-8379-56296783f4ee-kube-api-access-bmd74" (OuterVolumeSpecName: "kube-api-access-bmd74") pod "5bf998c2-788d-4334-8379-56296783f4ee" (UID: "5bf998c2-788d-4334-8379-56296783f4ee"). InnerVolumeSpecName "kube-api-access-bmd74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:53:11.272794 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.272750    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmd74\" (UniqueName: \"kubernetes.io/projected/5bf998c2-788d-4334-8379-56296783f4ee-kube-api-access-bmd74\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:11.272794 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.272786    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bf998c2-788d-4334-8379-56296783f4ee-console-serving-cert\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:11.272794 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.272798    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-console-config\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:11.273028 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.272811    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-trusted-ca-bundle\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:11.273028 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.272823    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-service-ca\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:11.273028 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.272833    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bf998c2-788d-4334-8379-56296783f4ee-console-oauth-config\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:11.273028 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.272844    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bf998c2-788d-4334-8379-56296783f4ee-oauth-serving-cert\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:11.350232 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.350143    2562 generic.go:356] "Generic (PLEG): container finished" podID="5bf998c2-788d-4334-8379-56296783f4ee" containerID="ed8b14f6920cecc7d64a920e912df3a73f01bc49f64f973f72ab624ed539d877" exitCode=0
Jul 08 15:53:11.350232 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.350205    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb947dc78-4kzfx"
Jul 08 15:53:11.350232 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.350221    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb947dc78-4kzfx" event={"ID":"5bf998c2-788d-4334-8379-56296783f4ee","Type":"ContainerDied","Data":"ed8b14f6920cecc7d64a920e912df3a73f01bc49f64f973f72ab624ed539d877"}
Jul 08 15:53:11.350490 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.350299    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb947dc78-4kzfx" event={"ID":"5bf998c2-788d-4334-8379-56296783f4ee","Type":"ContainerDied","Data":"b3a79f42568de562ddadeb60c06bdfee34e67571a415822b3ff15b8fa2d5d33c"}
Jul 08 15:53:11.350490 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.350326    2562 scope.go:117] "RemoveContainer" containerID="ed8b14f6920cecc7d64a920e912df3a73f01bc49f64f973f72ab624ed539d877"
Jul 08 15:53:11.358876 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.358855    2562 scope.go:117] "RemoveContainer" containerID="ed8b14f6920cecc7d64a920e912df3a73f01bc49f64f973f72ab624ed539d877"
Jul 08 15:53:11.359143 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:53:11.359123    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed8b14f6920cecc7d64a920e912df3a73f01bc49f64f973f72ab624ed539d877\": container with ID starting with ed8b14f6920cecc7d64a920e912df3a73f01bc49f64f973f72ab624ed539d877 not found: ID does not exist" containerID="ed8b14f6920cecc7d64a920e912df3a73f01bc49f64f973f72ab624ed539d877"
Jul 08 15:53:11.359189 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.359151    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed8b14f6920cecc7d64a920e912df3a73f01bc49f64f973f72ab624ed539d877"} err="failed to get container status \"ed8b14f6920cecc7d64a920e912df3a73f01bc49f64f973f72ab624ed539d877\": rpc error: code = NotFound desc = could not find container \"ed8b14f6920cecc7d64a920e912df3a73f01bc49f64f973f72ab624ed539d877\": container with ID starting with ed8b14f6920cecc7d64a920e912df3a73f01bc49f64f973f72ab624ed539d877 not found: ID does not exist"
Jul 08 15:53:11.372568 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.372539    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fb947dc78-4kzfx"]
Jul 08 15:53:11.377409 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:11.377389    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fb947dc78-4kzfx"]
Jul 08 15:53:12.616165 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:12.616124    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bf998c2-788d-4334-8379-56296783f4ee" path="/var/lib/kubelet/pods/5bf998c2-788d-4334-8379-56296783f4ee/volumes"
Jul 08 15:53:13.281649 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:13.281620    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:53:13.386856 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:13.386829    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:53:31.169485 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:31.169454    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:31.188109 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:31.188086    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:31.448783 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:31.448703    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:40.665561 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:40.665527    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:53:40.766920 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:40.766871    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:53:44.949945 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:44.949904    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 15:53:44.950428 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:44.950269    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="alertmanager" containerID="cri-o://c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88" gracePeriod=120
Jul 08 15:53:44.950428 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:44.950325    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="kube-rbac-proxy-web" containerID="cri-o://3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c" gracePeriod=120
Jul 08 15:53:44.950428 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:44.950354    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="prom-label-proxy" containerID="cri-o://b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a" gracePeriod=120
Jul 08 15:53:44.950428 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:44.950359    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="kube-rbac-proxy" containerID="cri-o://4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610" gracePeriod=120
Jul 08 15:53:44.950428 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:44.950325    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="kube-rbac-proxy-metric" containerID="cri-o://ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce" gracePeriod=120
Jul 08 15:53:44.950715 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:44.950354    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="config-reloader" containerID="cri-o://555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad" gracePeriod=120
Jul 08 15:53:45.496889 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:45.496852    2562 generic.go:356] "Generic (PLEG): container finished" podID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerID="b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a" exitCode=0
Jul 08 15:53:45.496889 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:45.496881    2562 generic.go:356] "Generic (PLEG): container finished" podID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerID="4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610" exitCode=0
Jul 08 15:53:45.496889 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:45.496889    2562 generic.go:356] "Generic (PLEG): container finished" podID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerID="555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad" exitCode=0
Jul 08 15:53:45.496889 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:45.496896    2562 generic.go:356] "Generic (PLEG): container finished" podID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerID="c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88" exitCode=0
Jul 08 15:53:45.497161 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:45.496922    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f23e8478-c4b7-47f8-925f-de2f32c27be6","Type":"ContainerDied","Data":"b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a"}
Jul 08 15:53:45.497161 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:45.496987    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f23e8478-c4b7-47f8-925f-de2f32c27be6","Type":"ContainerDied","Data":"4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610"}
Jul 08 15:53:45.497161 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:45.497015    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f23e8478-c4b7-47f8-925f-de2f32c27be6","Type":"ContainerDied","Data":"555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad"}
Jul 08 15:53:45.497161 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:45.497040    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f23e8478-c4b7-47f8-925f-de2f32c27be6","Type":"ContainerDied","Data":"c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88"}
Jul 08 15:53:46.197565 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.197539    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.292752 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.292670    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f23e8478-c4b7-47f8-925f-de2f32c27be6-alertmanager-trusted-ca-bundle\") pod \"f23e8478-c4b7-47f8-925f-de2f32c27be6\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") "
Jul 08 15:53:46.292752 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.292705    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f23e8478-c4b7-47f8-925f-de2f32c27be6-metrics-client-ca\") pod \"f23e8478-c4b7-47f8-925f-de2f32c27be6\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") "
Jul 08 15:53:46.292752 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.292741    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f23e8478-c4b7-47f8-925f-de2f32c27be6-tls-assets\") pod \"f23e8478-c4b7-47f8-925f-de2f32c27be6\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") "
Jul 08 15:53:46.293017 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.292758    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"f23e8478-c4b7-47f8-925f-de2f32c27be6\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") "
Jul 08 15:53:46.293017 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.292782    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy-web\") pod \"f23e8478-c4b7-47f8-925f-de2f32c27be6\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") "
Jul 08 15:53:46.293017 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.292808    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f23e8478-c4b7-47f8-925f-de2f32c27be6-config-out\") pod \"f23e8478-c4b7-47f8-925f-de2f32c27be6\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") "
Jul 08 15:53:46.293017 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.292832    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-main-tls\") pod \"f23e8478-c4b7-47f8-925f-de2f32c27be6\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") "
Jul 08 15:53:46.293017 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.292879    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf4r4\" (UniqueName: \"kubernetes.io/projected/f23e8478-c4b7-47f8-925f-de2f32c27be6-kube-api-access-bf4r4\") pod \"f23e8478-c4b7-47f8-925f-de2f32c27be6\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") "
Jul 08 15:53:46.293017 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.292903    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f23e8478-c4b7-47f8-925f-de2f32c27be6-alertmanager-main-db\") pod \"f23e8478-c4b7-47f8-925f-de2f32c27be6\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") "
Jul 08 15:53:46.293017 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.292931    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy\") pod \"f23e8478-c4b7-47f8-925f-de2f32c27be6\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") "
Jul 08 15:53:46.293017 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.292957    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-config-volume\") pod \"f23e8478-c4b7-47f8-925f-de2f32c27be6\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") "
Jul 08 15:53:46.293017 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.292996    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-web-config\") pod \"f23e8478-c4b7-47f8-925f-de2f32c27be6\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") "
Jul 08 15:53:46.293396 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.293152    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f23e8478-c4b7-47f8-925f-de2f32c27be6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "f23e8478-c4b7-47f8-925f-de2f32c27be6" (UID: "f23e8478-c4b7-47f8-925f-de2f32c27be6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:53:46.293396 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.293169    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-cluster-tls-config\") pod \"f23e8478-c4b7-47f8-925f-de2f32c27be6\" (UID: \"f23e8478-c4b7-47f8-925f-de2f32c27be6\") "
Jul 08 15:53:46.293396 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.293223    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f23e8478-c4b7-47f8-925f-de2f32c27be6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "f23e8478-c4b7-47f8-925f-de2f32c27be6" (UID: "f23e8478-c4b7-47f8-925f-de2f32c27be6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:53:46.294075 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.293693    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f23e8478-c4b7-47f8-925f-de2f32c27be6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "f23e8478-c4b7-47f8-925f-de2f32c27be6" (UID: "f23e8478-c4b7-47f8-925f-de2f32c27be6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 15:53:46.294075 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.293812    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f23e8478-c4b7-47f8-925f-de2f32c27be6-alertmanager-main-db\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:46.294075 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.293833    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f23e8478-c4b7-47f8-925f-de2f32c27be6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:46.294075 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.293849    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f23e8478-c4b7-47f8-925f-de2f32c27be6-metrics-client-ca\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:46.295607 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.295547    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "f23e8478-c4b7-47f8-925f-de2f32c27be6" (UID: "f23e8478-c4b7-47f8-925f-de2f32c27be6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:46.295892 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.295850    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "f23e8478-c4b7-47f8-925f-de2f32c27be6" (UID: "f23e8478-c4b7-47f8-925f-de2f32c27be6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:46.296241 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.296217    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f23e8478-c4b7-47f8-925f-de2f32c27be6-config-out" (OuterVolumeSpecName: "config-out") pod "f23e8478-c4b7-47f8-925f-de2f32c27be6" (UID: "f23e8478-c4b7-47f8-925f-de2f32c27be6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 15:53:46.296759 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.296729    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f23e8478-c4b7-47f8-925f-de2f32c27be6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f23e8478-c4b7-47f8-925f-de2f32c27be6" (UID: "f23e8478-c4b7-47f8-925f-de2f32c27be6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:53:46.296844 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.296773    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f23e8478-c4b7-47f8-925f-de2f32c27be6-kube-api-access-bf4r4" (OuterVolumeSpecName: "kube-api-access-bf4r4") pod "f23e8478-c4b7-47f8-925f-de2f32c27be6" (UID: "f23e8478-c4b7-47f8-925f-de2f32c27be6"). InnerVolumeSpecName "kube-api-access-bf4r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:53:46.296844 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.296787    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-config-volume" (OuterVolumeSpecName: "config-volume") pod "f23e8478-c4b7-47f8-925f-de2f32c27be6" (UID: "f23e8478-c4b7-47f8-925f-de2f32c27be6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:46.296949 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.296930    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "f23e8478-c4b7-47f8-925f-de2f32c27be6" (UID: "f23e8478-c4b7-47f8-925f-de2f32c27be6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:46.297370 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.297354    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "f23e8478-c4b7-47f8-925f-de2f32c27be6" (UID: "f23e8478-c4b7-47f8-925f-de2f32c27be6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:46.300105 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.300082    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "f23e8478-c4b7-47f8-925f-de2f32c27be6" (UID: "f23e8478-c4b7-47f8-925f-de2f32c27be6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:46.307064 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.307045    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-web-config" (OuterVolumeSpecName: "web-config") pod "f23e8478-c4b7-47f8-925f-de2f32c27be6" (UID: "f23e8478-c4b7-47f8-925f-de2f32c27be6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:46.394833 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.394788    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf4r4\" (UniqueName: \"kubernetes.io/projected/f23e8478-c4b7-47f8-925f-de2f32c27be6-kube-api-access-bf4r4\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:46.394833 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.394831    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:46.394833 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.394842    2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-config-volume\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:46.395068 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.394876    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-web-config\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:46.395068 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.394885    2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-cluster-tls-config\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:46.395068 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.394893    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f23e8478-c4b7-47f8-925f-de2f32c27be6-tls-assets\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:46.395068 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.394902    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:46.395068 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.394910    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:46.395068 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.394918    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f23e8478-c4b7-47f8-925f-de2f32c27be6-config-out\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:46.395068 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.394926    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f23e8478-c4b7-47f8-925f-de2f32c27be6-secret-alertmanager-main-tls\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:46.504984 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.504944    2562 generic.go:356] "Generic (PLEG): container finished" podID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerID="ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce" exitCode=0
Jul 08 15:53:46.504984 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.504977    2562 generic.go:356] "Generic (PLEG): container finished" podID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerID="3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c" exitCode=0
Jul 08 15:53:46.505181 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.505029    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f23e8478-c4b7-47f8-925f-de2f32c27be6","Type":"ContainerDied","Data":"ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce"}
Jul 08 15:53:46.505181 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.505048    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.505181 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.505137    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f23e8478-c4b7-47f8-925f-de2f32c27be6","Type":"ContainerDied","Data":"3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c"}
Jul 08 15:53:46.505181 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.505173    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f23e8478-c4b7-47f8-925f-de2f32c27be6","Type":"ContainerDied","Data":"4d6a1d2742c0de33f96ccf13ea9c0d813d11b2301e3e011952af43250a6dd950"}
Jul 08 15:53:46.505301 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.505208    2562 scope.go:117] "RemoveContainer" containerID="b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a"
Jul 08 15:53:46.513119 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.513076    2562 scope.go:117] "RemoveContainer" containerID="ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce"
Jul 08 15:53:46.520309 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.520292    2562 scope.go:117] "RemoveContainer" containerID="4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610"
Jul 08 15:53:46.527004 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.526986    2562 scope.go:117] "RemoveContainer" containerID="3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c"
Jul 08 15:53:46.530684 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.530663    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 15:53:46.534934 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.534916    2562 scope.go:117] "RemoveContainer" containerID="555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad"
Jul 08 15:53:46.535342 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.535319    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 15:53:46.541656 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.541640    2562 scope.go:117] "RemoveContainer" containerID="c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88"
Jul 08 15:53:46.548424 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.548409    2562 scope.go:117] "RemoveContainer" containerID="90da1e4ca228ad111348b7c3b530112df50b86023b912994ee504a26b659ea43"
Jul 08 15:53:46.555895 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.555878    2562 scope.go:117] "RemoveContainer" containerID="b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a"
Jul 08 15:53:46.556148 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:53:46.556129    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a\": container with ID starting with b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a not found: ID does not exist" containerID="b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a"
Jul 08 15:53:46.556204 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.556156    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a"} err="failed to get container status \"b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a\": rpc error: code = NotFound desc = could not find container \"b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a\": container with ID starting with b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a not found: ID does not exist"
Jul 08 15:53:46.556204 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.556174    2562 scope.go:117] "RemoveContainer" containerID="ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce"
Jul 08 15:53:46.556379 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:53:46.556357    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce\": container with ID starting with ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce not found: ID does not exist" containerID="ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce"
Jul 08 15:53:46.556441 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.556391    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce"} err="failed to get container status \"ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce\": rpc error: code = NotFound desc = could not find container \"ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce\": container with ID starting with ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce not found: ID does not exist"
Jul 08 15:53:46.556441 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.556417    2562 scope.go:117] "RemoveContainer" containerID="4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610"
Jul 08 15:53:46.556699 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:53:46.556681    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610\": container with ID starting with 4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610 not found: ID does not exist" containerID="4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610"
Jul 08 15:53:46.556746 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.556703    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610"} err="failed to get container status \"4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610\": rpc error: code = NotFound desc = could not find container \"4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610\": container with ID starting with 4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610 not found: ID does not exist"
Jul 08 15:53:46.556746 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.556717    2562 scope.go:117] "RemoveContainer" containerID="3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c"
Jul 08 15:53:46.556954 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:53:46.556933    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c\": container with ID starting with 3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c not found: ID does not exist" containerID="3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c"
Jul 08 15:53:46.557056 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.556958    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c"} err="failed to get container status \"3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c\": rpc error: code = NotFound desc = could not find container \"3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c\": container with ID starting with 3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c not found: ID does not exist"
Jul 08 15:53:46.557056 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.556972    2562 scope.go:117] "RemoveContainer" containerID="555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad"
Jul 08 15:53:46.557226 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:53:46.557207    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad\": container with ID starting with 555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad not found: ID does not exist" containerID="555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad"
Jul 08 15:53:46.557268 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.557232    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad"} err="failed to get container status \"555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad\": rpc error: code = NotFound desc = could not find container \"555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad\": container with ID starting with 555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad not found: ID does not exist"
Jul 08 15:53:46.557268 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.557250    2562 scope.go:117] "RemoveContainer" containerID="c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88"
Jul 08 15:53:46.557458 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:53:46.557442    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88\": container with ID starting with c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88 not found: ID does not exist" containerID="c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88"
Jul 08 15:53:46.557546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.557463    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88"} err="failed to get container status \"c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88\": rpc error: code = NotFound desc = could not find container \"c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88\": container with ID starting with c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88 not found: ID does not exist"
Jul 08 15:53:46.557546 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.557477    2562 scope.go:117] "RemoveContainer" containerID="90da1e4ca228ad111348b7c3b530112df50b86023b912994ee504a26b659ea43"
Jul 08 15:53:46.557942 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:53:46.557927    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90da1e4ca228ad111348b7c3b530112df50b86023b912994ee504a26b659ea43\": container with ID starting with 90da1e4ca228ad111348b7c3b530112df50b86023b912994ee504a26b659ea43 not found: ID does not exist" containerID="90da1e4ca228ad111348b7c3b530112df50b86023b912994ee504a26b659ea43"
Jul 08 15:53:46.557982 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.557945    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90da1e4ca228ad111348b7c3b530112df50b86023b912994ee504a26b659ea43"} err="failed to get container status \"90da1e4ca228ad111348b7c3b530112df50b86023b912994ee504a26b659ea43\": rpc error: code = NotFound desc = could not find container \"90da1e4ca228ad111348b7c3b530112df50b86023b912994ee504a26b659ea43\": container with ID starting with 90da1e4ca228ad111348b7c3b530112df50b86023b912994ee504a26b659ea43 not found: ID does not exist"
Jul 08 15:53:46.557982 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.557957    2562 scope.go:117] "RemoveContainer" containerID="b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a"
Jul 08 15:53:46.558138 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.558123    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a"} err="failed to get container status \"b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a\": rpc error: code = NotFound desc = could not find container \"b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a\": container with ID starting with b68b4a80e6328f3f86ae67e4f1607c9cc39638d260a4aea283558204a2612b1a not found: ID does not exist"
Jul 08 15:53:46.558178 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.558138    2562 scope.go:117] "RemoveContainer" containerID="ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce"
Jul 08 15:53:46.558345 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.558330    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce"} err="failed to get container status \"ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce\": rpc error: code = NotFound desc = could not find container \"ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce\": container with ID starting with ae4b22070fe020b54d46ceb33b6aefb26f083284ca227a16ee4349d8b4084fce not found: ID does not exist"
Jul 08 15:53:46.558387 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.558346    2562 scope.go:117] "RemoveContainer" containerID="4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610"
Jul 08 15:53:46.558568 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.558544    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610"} err="failed to get container status \"4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610\": rpc error: code = NotFound desc = could not find container \"4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610\": container with ID starting with 4f5a5dae5cc0491861247e6487f7ac258f13aa8f9966fac6a380288a72e45610 not found: ID does not exist"
Jul 08 15:53:46.558648 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.558568    2562 scope.go:117] "RemoveContainer" containerID="3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c"
Jul 08 15:53:46.558787 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.558771    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c"} err="failed to get container status \"3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c\": rpc error: code = NotFound desc = could not find container \"3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c\": container with ID starting with 3adb3c017c4259b50da6d4ac64f36bca1afa7c78a427c4e7b08c029ff7387b0c not found: ID does not exist"
Jul 08 15:53:46.558828 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.558787    2562 scope.go:117] "RemoveContainer" containerID="555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad"
Jul 08 15:53:46.558971 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.558948    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad"} err="failed to get container status \"555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad\": rpc error: code = NotFound desc = could not find container \"555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad\": container with ID starting with 555d67174ec91d0f7cd0a40b5b24336ca732690a7eed22bf4df999e524fdbaad not found: ID does not exist"
Jul 08 15:53:46.558971 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.558968    2562 scope.go:117] "RemoveContainer" containerID="c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88"
Jul 08 15:53:46.559190 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.559173    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88"} err="failed to get container status \"c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88\": rpc error: code = NotFound desc = could not find container \"c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88\": container with ID starting with c52de95bdff58406b7dc6a3f473eb5c73d097f896c9c16a8522216e0b0bf5c88 not found: ID does not exist"
Jul 08 15:53:46.559258 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.559191    2562 scope.go:117] "RemoveContainer" containerID="90da1e4ca228ad111348b7c3b530112df50b86023b912994ee504a26b659ea43"
Jul 08 15:53:46.559388 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.559370    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90da1e4ca228ad111348b7c3b530112df50b86023b912994ee504a26b659ea43"} err="failed to get container status \"90da1e4ca228ad111348b7c3b530112df50b86023b912994ee504a26b659ea43\": rpc error: code = NotFound desc = could not find container \"90da1e4ca228ad111348b7c3b530112df50b86023b912994ee504a26b659ea43\": container with ID starting with 90da1e4ca228ad111348b7c3b530112df50b86023b912994ee504a26b659ea43 not found: ID does not exist"
Jul 08 15:53:46.563006 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.562986    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 15:53:46.563279 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563267    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="init-config-reloader"
Jul 08 15:53:46.563315 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563280    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="init-config-reloader"
Jul 08 15:53:46.563315 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563293    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="kube-rbac-proxy-metric"
Jul 08 15:53:46.563315 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563299    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="kube-rbac-proxy-metric"
Jul 08 15:53:46.563315 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563306    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="061749c8-4ff7-436d-96fe-3c6acd88cfa9" containerName="console"
Jul 08 15:53:46.563315 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563312    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="061749c8-4ff7-436d-96fe-3c6acd88cfa9" containerName="console"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563319    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="prom-label-proxy"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563325    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="prom-label-proxy"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563331    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf998c2-788d-4334-8379-56296783f4ee" containerName="console"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563337    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf998c2-788d-4334-8379-56296783f4ee" containerName="console"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563343    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="config-reloader"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563348    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="config-reloader"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563354    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="kube-rbac-proxy"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563361    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="kube-rbac-proxy"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563371    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="alertmanager"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563377    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="alertmanager"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563388    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="kube-rbac-proxy-web"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563392    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="kube-rbac-proxy-web"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563436    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="alertmanager"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563442    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="kube-rbac-proxy-metric"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563450    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="061749c8-4ff7-436d-96fe-3c6acd88cfa9" containerName="console"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563456    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bf998c2-788d-4334-8379-56296783f4ee" containerName="console"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563462    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="kube-rbac-proxy-web"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563467    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="kube-rbac-proxy"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563473    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="prom-label-proxy"
Jul 08 15:53:46.563566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.563478    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" containerName="config-reloader"
Jul 08 15:53:46.567147 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.567130    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.569787 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.569764    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 08 15:53:46.569885 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.569795    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 08 15:53:46.569885 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.569796    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 08 15:53:46.569885 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.569864    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 08 15:53:46.569885 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.569877    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 08 15:53:46.570089 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.569888    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 08 15:53:46.570228 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.570211    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 08 15:53:46.570319 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.570301    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-2cqmt\""
Jul 08 15:53:46.570483 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.570467    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 08 15:53:46.576756 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.576737    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 08 15:53:46.588914 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.588891    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 15:53:46.617920 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.617883    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f23e8478-c4b7-47f8-925f-de2f32c27be6" path="/var/lib/kubelet/pods/f23e8478-c4b7-47f8-925f-de2f32c27be6/volumes"
Jul 08 15:53:46.697405 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.697371    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-web-config\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.697405 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.697415    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p49d\" (UniqueName: \"kubernetes.io/projected/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-kube-api-access-8p49d\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.697710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.697444    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.697710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.697518    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.697710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.697558    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.697710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.697615    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.697710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.697655    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.697710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.697672    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.697710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.697691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-config-out\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.697710 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.697707    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.697993 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.697736    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-config-volume\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.697993 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.697801    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.697993 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.697835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.799294 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.799211    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.799294 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.799272    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.799488 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.799301    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.799488 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.799322    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.799488 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.799341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.799488 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.799374    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-config-out\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.799488 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.799399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.799488 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.799437    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-config-volume\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.799488 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.799486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.799855 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.799528    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.799855 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.799570    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-web-config\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.799855 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.799629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p49d\" (UniqueName: \"kubernetes.io/projected/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-kube-api-access-8p49d\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.799855 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.799660    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.800470 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.800183    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.801011 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.800960    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.801194 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.801165    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.802198 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.802169    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-config-out\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.802518 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.802466    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.802638 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.802517    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-web-config\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.802907 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.802884    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.803028 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.803004    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.803115 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.803099    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.803521 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.803504    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.803568 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.803550    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.803916 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.803900    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-config-volume\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.809528 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.809511    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p49d\" (UniqueName: \"kubernetes.io/projected/85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b-kube-api-access-8p49d\") pod \"alertmanager-main-0\" (UID: \"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:46.876789 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:46.876753    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 08 15:53:47.011808 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:47.011779    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 08 15:53:47.014950 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:53:47.014918    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85fb267c_a0ed_40e3_a912_ebdf8f3e4b1b.slice/crio-e5e8c47eede6342a28e77bda369815ac566900de9dcc6b77a99f40458f2da263 WatchSource:0}: Error finding container e5e8c47eede6342a28e77bda369815ac566900de9dcc6b77a99f40458f2da263: Status 404 returned error can't find the container with id e5e8c47eede6342a28e77bda369815ac566900de9dcc6b77a99f40458f2da263
Jul 08 15:53:47.510613 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:47.510499    2562 generic.go:356] "Generic (PLEG): container finished" podID="85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b" containerID="fe72dbaa6fbbd3f6d5d7499bcb957d1dde717999bdccd4071539fe1a09209d10" exitCode=0
Jul 08 15:53:47.511025 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:47.510608    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b","Type":"ContainerDied","Data":"fe72dbaa6fbbd3f6d5d7499bcb957d1dde717999bdccd4071539fe1a09209d10"}
Jul 08 15:53:47.511025 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:47.510679    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b","Type":"ContainerStarted","Data":"e5e8c47eede6342a28e77bda369815ac566900de9dcc6b77a99f40458f2da263"}
Jul 08 15:53:48.519192 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:48.519160    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b","Type":"ContainerStarted","Data":"a62fcc1a1ff7f6ab895baf6ee2eb106bdaa3e73799cc3aa66bc78900b8563967"}
Jul 08 15:53:48.519609 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:48.519255    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b","Type":"ContainerStarted","Data":"7be1a58c4850dc7c53beb7e05acac57dd9d749e5b76becb829beedc06cda8d8d"}
Jul 08 15:53:48.519609 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:48.519283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b","Type":"ContainerStarted","Data":"ba8ff48b639ce120a79cd57dad4f37d12c264775dec8ac8c939e72291e5ae50a"}
Jul 08 15:53:48.519609 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:48.519308    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b","Type":"ContainerStarted","Data":"101a07aa90baf7c3026a1ca18b7467c59b45424a1906ad73cccd1972814e9431"}
Jul 08 15:53:48.519609 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:48.519344    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b","Type":"ContainerStarted","Data":"fa1fe6268d7213b0237d8f109fe712a96857c2811abd71fefc7f91ed007cdb1a"}
Jul 08 15:53:48.519609 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:48.519368    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b","Type":"ContainerStarted","Data":"babc4a79c64bea190ffc355883434594d218dc04e775d972736df223e6023baf"}
Jul 08 15:53:48.552923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:48.552867    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.5371072359999998 podStartE2EDuration="2.552847107s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.739871ms" isStatefulPod=false podCreationTimestamp="2026-07-08 15:53:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:53:48.550034852 +0000 UTC m=+167.960699508" watchObservedRunningTime="2026-07-08 15:53:48.552847107 +0000 UTC m=+167.963511761"
Jul 08 15:53:49.174882 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.174847    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 15:53:49.175177 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.175141    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="prometheus" containerID="cri-o://078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d" gracePeriod=600
Jul 08 15:53:49.175177 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.175153    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="kube-rbac-proxy" containerID="cri-o://39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d" gracePeriod=600
Jul 08 15:53:49.175372 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.175185    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="kube-rbac-proxy-thanos" containerID="cri-o://84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d" gracePeriod=600
Jul 08 15:53:49.175372 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.175165    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="config-reloader" containerID="cri-o://d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e" gracePeriod=600
Jul 08 15:53:49.175372 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.175187    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="kube-rbac-proxy-web" containerID="cri-o://b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4" gracePeriod=600
Jul 08 15:53:49.175372 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.175157    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="thanos-sidecar" containerID="cri-o://2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127" gracePeriod=600
Jul 08 15:53:49.412218 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.412193    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:49.520671 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.520647    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-web-config\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521116 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.520688    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521116 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.520713    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-kube-rbac-proxy\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521116 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.520745    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-2\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521116 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.520800    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-1\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521116 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.520832    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-db\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521116 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.520856    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-metrics-client-ca\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521116 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.520948    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-tls\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521116 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.520986    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-thanos-prometheus-http-client-file\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521116 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.521026    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-config\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521116 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.521104    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-tls-assets\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521647 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.521170    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-metrics-client-certs\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521647 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.521222    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-0\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521647 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.521221    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:53:49.521647 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.521250    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521647 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.521279    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-kubelet-serving-ca-bundle\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521647 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.521293    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:53:49.521647 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.521311    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-config-out\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521647 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.521336    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-grpc-tls\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521647 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.521374    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qljmr\" (UniqueName: \"kubernetes.io/projected/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-kube-api-access-qljmr\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521647 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.521405    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-serving-certs-ca-bundle\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.521647 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.521432    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-trusted-ca-bundle\") pod \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\" (UID: \"d34229ef-0d67-4a10-84d0-7e61ac6c9aec\") "
Jul 08 15:53:49.522020 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.521719    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-metrics-client-ca\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.522020 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.521737    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.522077 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.522052    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:53:49.522077 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.522064    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:53:49.523191 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.522898    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 15:53:49.523309 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.523196    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:49.523763 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.523493    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:53:49.523763 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.523521    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:49.524478 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.524444    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:49.524478 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.524463    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:49.525439 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.525413    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:53:49.525821 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.525793    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:49.525821 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.525808    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:53:49.526122 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.526086    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-config" (OuterVolumeSpecName: "config") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:49.526298 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.526265    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 08 15:53:49.526426 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.526401    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:49.526772 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.526746    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-kube-api-access-qljmr" (OuterVolumeSpecName: "kube-api-access-qljmr") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "kube-api-access-qljmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:53:49.527237 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.527215    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:49.527838 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.527817    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-config-out" (OuterVolumeSpecName: "config-out") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 15:53:49.529475 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.529455    2562 generic.go:356] "Generic (PLEG): container finished" podID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerID="84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d" exitCode=0
Jul 08 15:53:49.529475 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.529473    2562 generic.go:356] "Generic (PLEG): container finished" podID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerID="39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d" exitCode=0
Jul 08 15:53:49.529696 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.529481    2562 generic.go:356] "Generic (PLEG): container finished" podID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerID="b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4" exitCode=0
Jul 08 15:53:49.529696 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.529487    2562 generic.go:356] "Generic (PLEG): container finished" podID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerID="2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127" exitCode=0
Jul 08 15:53:49.529696 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.529493    2562 generic.go:356] "Generic (PLEG): container finished" podID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerID="d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e" exitCode=0
Jul 08 15:53:49.529696 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.529498    2562 generic.go:356] "Generic (PLEG): container finished" podID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerID="078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d" exitCode=0
Jul 08 15:53:49.529696 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.529526    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:49.529696 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.529544    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d34229ef-0d67-4a10-84d0-7e61ac6c9aec","Type":"ContainerDied","Data":"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d"}
Jul 08 15:53:49.529883 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.529766    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d34229ef-0d67-4a10-84d0-7e61ac6c9aec","Type":"ContainerDied","Data":"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d"}
Jul 08 15:53:49.529883 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.529815    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d34229ef-0d67-4a10-84d0-7e61ac6c9aec","Type":"ContainerDied","Data":"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4"}
Jul 08 15:53:49.529883 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.529831    2562 scope.go:117] "RemoveContainer" containerID="84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d"
Jul 08 15:53:49.529883 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.529856    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d34229ef-0d67-4a10-84d0-7e61ac6c9aec","Type":"ContainerDied","Data":"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127"}
Jul 08 15:53:49.530017 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.529898    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d34229ef-0d67-4a10-84d0-7e61ac6c9aec","Type":"ContainerDied","Data":"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e"}
Jul 08 15:53:49.530017 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.529939    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d34229ef-0d67-4a10-84d0-7e61ac6c9aec","Type":"ContainerDied","Data":"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d"}
Jul 08 15:53:49.530017 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.529980    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d34229ef-0d67-4a10-84d0-7e61ac6c9aec","Type":"ContainerDied","Data":"7b4fe0a46404e655b52e9db7180fb3b25783b603e607347ff6ea9ab9ff30f2ff"}
Jul 08 15:53:49.535669 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.535384    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-web-config" (OuterVolumeSpecName: "web-config") pod "d34229ef-0d67-4a10-84d0-7e61ac6c9aec" (UID: "d34229ef-0d67-4a10-84d0-7e61ac6c9aec"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 15:53:49.540337 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.538841    2562 scope.go:117] "RemoveContainer" containerID="39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d"
Jul 08 15:53:49.546951 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.546933    2562 scope.go:117] "RemoveContainer" containerID="b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4"
Jul 08 15:53:49.553563 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.553546    2562 scope.go:117] "RemoveContainer" containerID="2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127"
Jul 08 15:53:49.559951 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.559930    2562 scope.go:117] "RemoveContainer" containerID="d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e"
Jul 08 15:53:49.566434 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.566420    2562 scope.go:117] "RemoveContainer" containerID="078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d"
Jul 08 15:53:49.573341 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.573324    2562 scope.go:117] "RemoveContainer" containerID="59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6"
Jul 08 15:53:49.579464 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.579451    2562 scope.go:117] "RemoveContainer" containerID="84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d"
Jul 08 15:53:49.579719 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:53:49.579700    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d\": container with ID starting with 84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d not found: ID does not exist" containerID="84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d"
Jul 08 15:53:49.579771 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.579728    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d"} err="failed to get container status \"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d\": rpc error: code = NotFound desc = could not find container \"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d\": container with ID starting with 84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d not found: ID does not exist"
Jul 08 15:53:49.579771 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.579746    2562 scope.go:117] "RemoveContainer" containerID="39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d"
Jul 08 15:53:49.579965 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:53:49.579947    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d\": container with ID starting with 39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d not found: ID does not exist" containerID="39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d"
Jul 08 15:53:49.580016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.579971    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d"} err="failed to get container status \"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d\": rpc error: code = NotFound desc = could not find container \"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d\": container with ID starting with 39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d not found: ID does not exist"
Jul 08 15:53:49.580016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.579990    2562 scope.go:117] "RemoveContainer" containerID="b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4"
Jul 08 15:53:49.580200 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:53:49.580183    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4\": container with ID starting with b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4 not found: ID does not exist" containerID="b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4"
Jul 08 15:53:49.580239 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.580204    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4"} err="failed to get container status \"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4\": rpc error: code = NotFound desc = could not find container \"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4\": container with ID starting with b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4 not found: ID does not exist"
Jul 08 15:53:49.580239 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.580225    2562 scope.go:117] "RemoveContainer" containerID="2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127"
Jul 08 15:53:49.580420 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:53:49.580405    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127\": container with ID starting with 2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127 not found: ID does not exist" containerID="2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127"
Jul 08 15:53:49.580457 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.580425    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127"} err="failed to get container status \"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127\": rpc error: code = NotFound desc = could not find container \"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127\": container with ID starting with 2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127 not found: ID does not exist"
Jul 08 15:53:49.580457 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.580436    2562 scope.go:117] "RemoveContainer" containerID="d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e"
Jul 08 15:53:49.580670 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:53:49.580646    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e\": container with ID starting with d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e not found: ID does not exist" containerID="d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e"
Jul 08 15:53:49.580724 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.580678    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e"} err="failed to get container status \"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e\": rpc error: code = NotFound desc = could not find container \"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e\": container with ID starting with d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e not found: ID does not exist"
Jul 08 15:53:49.580724 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.580699    2562 scope.go:117] "RemoveContainer" containerID="078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d"
Jul 08 15:53:49.580918 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:53:49.580901    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d\": container with ID starting with 078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d not found: ID does not exist" containerID="078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d"
Jul 08 15:53:49.580974 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.580923    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d"} err="failed to get container status \"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d\": rpc error: code = NotFound desc = could not find container \"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d\": container with ID starting with 078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d not found: ID does not exist"
Jul 08 15:53:49.580974 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.580935    2562 scope.go:117] "RemoveContainer" containerID="59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6"
Jul 08 15:53:49.581178 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:53:49.581162    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6\": container with ID starting with 59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6 not found: ID does not exist" containerID="59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6"
Jul 08 15:53:49.581231 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.581182    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6"} err="failed to get container status \"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6\": rpc error: code = NotFound desc = could not find container \"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6\": container with ID starting with 59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6 not found: ID does not exist"
Jul 08 15:53:49.581231 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.581195    2562 scope.go:117] "RemoveContainer" containerID="84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d"
Jul 08 15:53:49.581408 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.581392    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d"} err="failed to get container status \"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d\": rpc error: code = NotFound desc = could not find container \"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d\": container with ID starting with 84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d not found: ID does not exist"
Jul 08 15:53:49.581449 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.581408    2562 scope.go:117] "RemoveContainer" containerID="39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d"
Jul 08 15:53:49.581667 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.581651    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d"} err="failed to get container status \"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d\": rpc error: code = NotFound desc = could not find container \"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d\": container with ID starting with 39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d not found: ID does not exist"
Jul 08 15:53:49.581714 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.581666    2562 scope.go:117] "RemoveContainer" containerID="b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4"
Jul 08 15:53:49.581879 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.581836    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4"} err="failed to get container status \"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4\": rpc error: code = NotFound desc = could not find container \"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4\": container with ID starting with b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4 not found: ID does not exist"
Jul 08 15:53:49.581921 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.581880    2562 scope.go:117] "RemoveContainer" containerID="2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127"
Jul 08 15:53:49.582084 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.582070    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127"} err="failed to get container status \"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127\": rpc error: code = NotFound desc = could not find container \"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127\": container with ID starting with 2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127 not found: ID does not exist"
Jul 08 15:53:49.582084 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.582083    2562 scope.go:117] "RemoveContainer" containerID="d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e"
Jul 08 15:53:49.582299 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.582279    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e"} err="failed to get container status \"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e\": rpc error: code = NotFound desc = could not find container \"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e\": container with ID starting with d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e not found: ID does not exist"
Jul 08 15:53:49.582345 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.582302    2562 scope.go:117] "RemoveContainer" containerID="078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d"
Jul 08 15:53:49.582501 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.582486    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d"} err="failed to get container status \"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d\": rpc error: code = NotFound desc = could not find container \"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d\": container with ID starting with 078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d not found: ID does not exist"
Jul 08 15:53:49.582561 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.582500    2562 scope.go:117] "RemoveContainer" containerID="59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6"
Jul 08 15:53:49.582707 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.582693    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6"} err="failed to get container status \"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6\": rpc error: code = NotFound desc = could not find container \"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6\": container with ID starting with 59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6 not found: ID does not exist"
Jul 08 15:53:49.582707 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.582706    2562 scope.go:117] "RemoveContainer" containerID="84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d"
Jul 08 15:53:49.582906 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.582885    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d"} err="failed to get container status \"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d\": rpc error: code = NotFound desc = could not find container \"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d\": container with ID starting with 84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d not found: ID does not exist"
Jul 08 15:53:49.582906 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.582905    2562 scope.go:117] "RemoveContainer" containerID="39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d"
Jul 08 15:53:49.583154 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.583134    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d"} err="failed to get container status \"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d\": rpc error: code = NotFound desc = could not find container \"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d\": container with ID starting with 39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d not found: ID does not exist"
Jul 08 15:53:49.583202 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.583155    2562 scope.go:117] "RemoveContainer" containerID="b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4"
Jul 08 15:53:49.583348 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.583331    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4"} err="failed to get container status \"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4\": rpc error: code = NotFound desc = could not find container \"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4\": container with ID starting with b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4 not found: ID does not exist"
Jul 08 15:53:49.583405 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.583349    2562 scope.go:117] "RemoveContainer" containerID="2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127"
Jul 08 15:53:49.583592 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.583563    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127"} err="failed to get container status \"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127\": rpc error: code = NotFound desc = could not find container \"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127\": container with ID starting with 2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127 not found: ID does not exist"
Jul 08 15:53:49.583637 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.583595    2562 scope.go:117] "RemoveContainer" containerID="d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e"
Jul 08 15:53:49.583832 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.583816    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e"} err="failed to get container status \"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e\": rpc error: code = NotFound desc = could not find container \"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e\": container with ID starting with d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e not found: ID does not exist"
Jul 08 15:53:49.583867 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.583834    2562 scope.go:117] "RemoveContainer" containerID="078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d"
Jul 08 15:53:49.584052 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.584035    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d"} err="failed to get container status \"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d\": rpc error: code = NotFound desc = could not find container \"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d\": container with ID starting with 078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d not found: ID does not exist"
Jul 08 15:53:49.584114 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.584054    2562 scope.go:117] "RemoveContainer" containerID="59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6"
Jul 08 15:53:49.584257 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.584243    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6"} err="failed to get container status \"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6\": rpc error: code = NotFound desc = could not find container \"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6\": container with ID starting with 59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6 not found: ID does not exist"
Jul 08 15:53:49.584295 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.584258    2562 scope.go:117] "RemoveContainer" containerID="84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d"
Jul 08 15:53:49.584455 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.584439    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d"} err="failed to get container status \"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d\": rpc error: code = NotFound desc = could not find container \"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d\": container with ID starting with 84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d not found: ID does not exist"
Jul 08 15:53:49.584492 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.584455    2562 scope.go:117] "RemoveContainer" containerID="39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d"
Jul 08 15:53:49.584681 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.584664    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d"} err="failed to get container status \"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d\": rpc error: code = NotFound desc = could not find container \"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d\": container with ID starting with 39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d not found: ID does not exist"
Jul 08 15:53:49.584743 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.584682    2562 scope.go:117] "RemoveContainer" containerID="b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4"
Jul 08 15:53:49.584871 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.584854    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4"} err="failed to get container status \"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4\": rpc error: code = NotFound desc = could not find container \"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4\": container with ID starting with b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4 not found: ID does not exist"
Jul 08 15:53:49.584917 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.584872    2562 scope.go:117] "RemoveContainer" containerID="2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127"
Jul 08 15:53:49.585045 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.585030    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127"} err="failed to get container status \"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127\": rpc error: code = NotFound desc = could not find container \"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127\": container with ID starting with 2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127 not found: ID does not exist"
Jul 08 15:53:49.585081 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.585045    2562 scope.go:117] "RemoveContainer" containerID="d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e"
Jul 08 15:53:49.585257 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.585242    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e"} err="failed to get container status \"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e\": rpc error: code = NotFound desc = could not find container \"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e\": container with ID starting with d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e not found: ID does not exist"
Jul 08 15:53:49.585299 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.585257    2562 scope.go:117] "RemoveContainer" containerID="078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d"
Jul 08 15:53:49.585449 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.585430    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d"} err="failed to get container status \"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d\": rpc error: code = NotFound desc = could not find container \"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d\": container with ID starting with 078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d not found: ID does not exist"
Jul 08 15:53:49.585491 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.585450    2562 scope.go:117] "RemoveContainer" containerID="59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6"
Jul 08 15:53:49.585720 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.585704    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6"} err="failed to get container status \"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6\": rpc error: code = NotFound desc = could not find container \"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6\": container with ID starting with 59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6 not found: ID does not exist"
Jul 08 15:53:49.585720 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.585720    2562 scope.go:117] "RemoveContainer" containerID="84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d"
Jul 08 15:53:49.585897 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.585881    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d"} err="failed to get container status \"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d\": rpc error: code = NotFound desc = could not find container \"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d\": container with ID starting with 84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d not found: ID does not exist"
Jul 08 15:53:49.585935 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.585898    2562 scope.go:117] "RemoveContainer" containerID="39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d"
Jul 08 15:53:49.586107 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.586091    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d"} err="failed to get container status \"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d\": rpc error: code = NotFound desc = could not find container \"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d\": container with ID starting with 39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d not found: ID does not exist"
Jul 08 15:53:49.586178 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.586108    2562 scope.go:117] "RemoveContainer" containerID="b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4"
Jul 08 15:53:49.586318 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.586303    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4"} err="failed to get container status \"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4\": rpc error: code = NotFound desc = could not find container \"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4\": container with ID starting with b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4 not found: ID does not exist"
Jul 08 15:53:49.586318 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.586318    2562 scope.go:117] "RemoveContainer" containerID="2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127"
Jul 08 15:53:49.586487 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.586466    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127"} err="failed to get container status \"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127\": rpc error: code = NotFound desc = could not find container \"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127\": container with ID starting with 2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127 not found: ID does not exist"
Jul 08 15:53:49.586529 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.586488    2562 scope.go:117] "RemoveContainer" containerID="d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e"
Jul 08 15:53:49.586702 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.586678    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e"} err="failed to get container status \"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e\": rpc error: code = NotFound desc = could not find container \"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e\": container with ID starting with d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e not found: ID does not exist"
Jul 08 15:53:49.586757 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.586702    2562 scope.go:117] "RemoveContainer" containerID="078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d"
Jul 08 15:53:49.586875 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.586861    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d"} err="failed to get container status \"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d\": rpc error: code = NotFound desc = could not find container \"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d\": container with ID starting with 078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d not found: ID does not exist"
Jul 08 15:53:49.586911 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.586876    2562 scope.go:117] "RemoveContainer" containerID="59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6"
Jul 08 15:53:49.587076 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.587061    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6"} err="failed to get container status \"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6\": rpc error: code = NotFound desc = could not find container \"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6\": container with ID starting with 59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6 not found: ID does not exist"
Jul 08 15:53:49.587117 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.587076    2562 scope.go:117] "RemoveContainer" containerID="84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d"
Jul 08 15:53:49.587268 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.587250    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d"} err="failed to get container status \"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d\": rpc error: code = NotFound desc = could not find container \"84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d\": container with ID starting with 84b5a706e1d4e7ae1bec33eb501a676c16fb6cb1ae3dba1682131afe7b78033d not found: ID does not exist"
Jul 08 15:53:49.587312 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.587268    2562 scope.go:117] "RemoveContainer" containerID="39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d"
Jul 08 15:53:49.587441 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.587426    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d"} err="failed to get container status \"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d\": rpc error: code = NotFound desc = could not find container \"39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d\": container with ID starting with 39df0ba9f9bebef60e814d8510e349d6c96f01029d6a8c471bc09cfe6586ba7d not found: ID does not exist"
Jul 08 15:53:49.587441 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.587440    2562 scope.go:117] "RemoveContainer" containerID="b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4"
Jul 08 15:53:49.587637 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.587619    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4"} err="failed to get container status \"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4\": rpc error: code = NotFound desc = could not find container \"b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4\": container with ID starting with b63349c9d7e4f53915792f4bf4e79849ef534f2cbe221e99456cee0748fab2d4 not found: ID does not exist"
Jul 08 15:53:49.587695 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.587636    2562 scope.go:117] "RemoveContainer" containerID="2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127"
Jul 08 15:53:49.587860 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.587844    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127"} err="failed to get container status \"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127\": rpc error: code = NotFound desc = could not find container \"2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127\": container with ID starting with 2231500dcaf9eb9359de88bc616cd624d32a58d997152589a7e780a57f960127 not found: ID does not exist"
Jul 08 15:53:49.587897 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.587861    2562 scope.go:117] "RemoveContainer" containerID="d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e"
Jul 08 15:53:49.588062 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.588045    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e"} err="failed to get container status \"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e\": rpc error: code = NotFound desc = could not find container \"d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e\": container with ID starting with d492ec0aa0ea76cbcd4d2bb0cf2b5015f50aa175ef4f1b3f0636b2e9e6c0bc1e not found: ID does not exist"
Jul 08 15:53:49.588101 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.588063    2562 scope.go:117] "RemoveContainer" containerID="078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d"
Jul 08 15:53:49.588249 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.588234    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d"} err="failed to get container status \"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d\": rpc error: code = NotFound desc = could not find container \"078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d\": container with ID starting with 078c78b2b3b4224be7839d54d1eda9ee0580cbb02f7490ac364849f066632f9d not found: ID does not exist"
Jul 08 15:53:49.588290 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.588249    2562 scope.go:117] "RemoveContainer" containerID="59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6"
Jul 08 15:53:49.588411 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.588395    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6"} err="failed to get container status \"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6\": rpc error: code = NotFound desc = could not find container \"59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6\": container with ID starting with 59925dd2f153a3b89dad1a12ca42bea5f7f7ca2ac0b321ff60cb2daee8b53aa6 not found: ID does not exist"
Jul 08 15:53:49.622801 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.622702    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.622801 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.622746    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.622993 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.622926    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.622993 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.622946    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-config-out\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.622993 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.622964    2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-grpc-tls\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.622993 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.622976    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qljmr\" (UniqueName: \"kubernetes.io/projected/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-kube-api-access-qljmr\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.622993 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.622987    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.622993 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.622996    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.623177 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.623005    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-web-config\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.623177 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.623014    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.623177 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.623028    2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-kube-rbac-proxy\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.623177 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.623040    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.623177 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.623048    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-prometheus-k8s-db\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.623177 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.623056    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.623177 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.623064    2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.623177 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.623073    2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-config\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.623177 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.623080    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-tls-assets\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.623177 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.623088    2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d34229ef-0d67-4a10-84d0-7e61ac6c9aec-secret-metrics-client-certs\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:53:49.855285 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.855253    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 15:53:49.859934 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.859906    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 15:53:49.886074 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886047    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 15:53:49.886326 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886314    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="config-reloader"
Jul 08 15:53:49.886364 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886328    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="config-reloader"
Jul 08 15:53:49.886364 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886337    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="init-config-reloader"
Jul 08 15:53:49.886364 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886343    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="init-config-reloader"
Jul 08 15:53:49.886364 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886351    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="kube-rbac-proxy"
Jul 08 15:53:49.886364 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886356    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="kube-rbac-proxy"
Jul 08 15:53:49.886506 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886366    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="kube-rbac-proxy-thanos"
Jul 08 15:53:49.886506 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886372    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="kube-rbac-proxy-thanos"
Jul 08 15:53:49.886506 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886385    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="thanos-sidecar"
Jul 08 15:53:49.886506 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886390    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="thanos-sidecar"
Jul 08 15:53:49.886506 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886397    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="kube-rbac-proxy-web"
Jul 08 15:53:49.886506 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886402    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="kube-rbac-proxy-web"
Jul 08 15:53:49.886506 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886409    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="prometheus"
Jul 08 15:53:49.886506 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886414    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="prometheus"
Jul 08 15:53:49.886506 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886461    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="kube-rbac-proxy-thanos"
Jul 08 15:53:49.886506 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886469    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="thanos-sidecar"
Jul 08 15:53:49.886506 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886475    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="kube-rbac-proxy-web"
Jul 08 15:53:49.886506 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886481    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="kube-rbac-proxy"
Jul 08 15:53:49.886506 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886487    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="config-reloader"
Jul 08 15:53:49.886506 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.886492    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" containerName="prometheus"
Jul 08 15:53:49.890168 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.890149    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:49.893072 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.893049    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 08 15:53:49.893192 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.893113    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 08 15:53:49.893351 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.893335    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 08 15:53:49.893465 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.893401    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 08 15:53:49.893465 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.893419    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 08 15:53:49.893465 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.893423    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 08 15:53:49.893675 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.893405    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ljcz9\""
Jul 08 15:53:49.893734 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.893681    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 08 15:53:49.893799 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.893752    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 08 15:53:49.893868 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.893812    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4lbu445ibac0r\""
Jul 08 15:53:49.893868 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.893859    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 08 15:53:49.893965 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.893934    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 08 15:53:49.893965 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.893954    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 08 15:53:49.894150 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.894002    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 08 15:53:49.894208 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.894160    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 08 15:53:49.897212 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.897188    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 08 15:53:49.899376 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.899357    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 08 15:53:49.911738 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:49.911717    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 15:53:50.027072 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027023    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027072 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027074    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027303 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027110    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027303 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027153    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b91f70ea-1dab-4963-a9c6-55eb5645755f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027303 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027180    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b91f70ea-1dab-4963-a9c6-55eb5645755f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027303 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027220    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027303 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027286    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b91f70ea-1dab-4963-a9c6-55eb5645755f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027494 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027324    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-config\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027494 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027494 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027378    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027494 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027417    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027494 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027482    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027767 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027512    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027767 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027767 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027565    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027767 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027615    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027767 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027640    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027767 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tt5n\" (UniqueName: \"kubernetes.io/projected/b91f70ea-1dab-4963-a9c6-55eb5645755f-kube-api-access-4tt5n\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027767 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.027767 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.027719    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.128883 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.128802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.128883 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.128838    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.128883 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.128855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.128883 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.128872    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129166 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.128891    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b91f70ea-1dab-4963-a9c6-55eb5645755f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129166 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.128908    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b91f70ea-1dab-4963-a9c6-55eb5645755f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129166 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129034    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129166 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129094    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b91f70ea-1dab-4963-a9c6-55eb5645755f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129166 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129132    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-config\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129395 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129159    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129395 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129194    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129395 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129395 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129253    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129395 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129281    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129395 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129307    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129395 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129336    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129395 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129395 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129382    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129929 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129407    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tt5n\" (UniqueName: \"kubernetes.io/projected/b91f70ea-1dab-4963-a9c6-55eb5645755f-kube-api-access-4tt5n\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129929 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129416    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b91f70ea-1dab-4963-a9c6-55eb5645755f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129929 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129929 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129533    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129929 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129715    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.129929 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.129914    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.130225 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.130135    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.131536 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.131432    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.131536 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.131483    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.132554 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.132528    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.132669 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.132567    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.133000 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.132976    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-config\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.133143 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.133117    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.133565 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.133500    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.133800 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.133761    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.133937 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.133913    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b91f70ea-1dab-4963-a9c6-55eb5645755f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.134131 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.134115    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.134566 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.134546    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b91f70ea-1dab-4963-a9c6-55eb5645755f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.134713 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.134697    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.134977 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.134955    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b91f70ea-1dab-4963-a9c6-55eb5645755f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.135138 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.135120    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b91f70ea-1dab-4963-a9c6-55eb5645755f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.138402 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.138385    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tt5n\" (UniqueName: \"kubernetes.io/projected/b91f70ea-1dab-4963-a9c6-55eb5645755f-kube-api-access-4tt5n\") pod \"prometheus-k8s-0\" (UID: \"b91f70ea-1dab-4963-a9c6-55eb5645755f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.200466 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.200447    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:50.334749 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.334709    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 08 15:53:50.337435 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:53:50.337411    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91f70ea_1dab_4963_a9c6_55eb5645755f.slice/crio-f99f241be5d287afc2449641b67d663a4f0688c7df2a5ce5a432a13eda43d223 WatchSource:0}: Error finding container f99f241be5d287afc2449641b67d663a4f0688c7df2a5ce5a432a13eda43d223: Status 404 returned error can't find the container with id f99f241be5d287afc2449641b67d663a4f0688c7df2a5ce5a432a13eda43d223
Jul 08 15:53:50.535863 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.535829    2562 generic.go:356] "Generic (PLEG): container finished" podID="b91f70ea-1dab-4963-a9c6-55eb5645755f" containerID="ad9bb310f09b8186f1cd6b103d2558b1d0a3a630b79fd6905b52b08211a060f6" exitCode=0
Jul 08 15:53:50.536239 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.535916    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b91f70ea-1dab-4963-a9c6-55eb5645755f","Type":"ContainerDied","Data":"ad9bb310f09b8186f1cd6b103d2558b1d0a3a630b79fd6905b52b08211a060f6"}
Jul 08 15:53:50.536239 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.536027    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b91f70ea-1dab-4963-a9c6-55eb5645755f","Type":"ContainerStarted","Data":"f99f241be5d287afc2449641b67d663a4f0688c7df2a5ce5a432a13eda43d223"}
Jul 08 15:53:50.617071 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:50.617046    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d34229ef-0d67-4a10-84d0-7e61ac6c9aec" path="/var/lib/kubelet/pods/d34229ef-0d67-4a10-84d0-7e61ac6c9aec/volumes"
Jul 08 15:53:51.544511 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:51.544473    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b91f70ea-1dab-4963-a9c6-55eb5645755f","Type":"ContainerStarted","Data":"8e9d84792debb854364144d68e1d67d2726b32c4ee41bf117547b70d15853056"}
Jul 08 15:53:51.544978 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:51.544606    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b91f70ea-1dab-4963-a9c6-55eb5645755f","Type":"ContainerStarted","Data":"cc88a8f8ed440980f1e0fb985a7fe66ab7d65a6060c662a7985469bf82a62e7c"}
Jul 08 15:53:51.544978 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:51.544654    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b91f70ea-1dab-4963-a9c6-55eb5645755f","Type":"ContainerStarted","Data":"f6d97d949b1b43def0811e36546ef6450a243f057700bad1203a29517cfe24f7"}
Jul 08 15:53:51.544978 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:51.544693    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b91f70ea-1dab-4963-a9c6-55eb5645755f","Type":"ContainerStarted","Data":"3c68aaa95cd18e046ea3590244e131597fef2245ac442908c5a2b8e41113b3c5"}
Jul 08 15:53:51.544978 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:51.544729    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b91f70ea-1dab-4963-a9c6-55eb5645755f","Type":"ContainerStarted","Data":"4aae2f63b879290bcd362b61db8ca0e94aab3126b15a3a4594d70daff4a493e3"}
Jul 08 15:53:51.544978 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:51.544765    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b91f70ea-1dab-4963-a9c6-55eb5645755f","Type":"ContainerStarted","Data":"eb06fc86f2e5862d21da722152a6d5edefcc5b9a65971f44ca80ead952125faf"}
Jul 08 15:53:51.581103 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:51.581052    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.562068023 podStartE2EDuration="2.581036602s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.968579ms" isStatefulPod=false podCreationTimestamp="2026-07-08 15:53:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:53:51.578571813 +0000 UTC m=+170.989236468" watchObservedRunningTime="2026-07-08 15:53:51.581036602 +0000 UTC m=+170.991701256"
Jul 08 15:53:52.611490 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:52.611454    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:53:52.666910 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:52.666877    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:53:55.201315 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:55.201280    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:53:58.304115 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:58.304080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:53:58.402904 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:53:58.402877    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:54:00.239102 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:54:00.239070    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:54:00.367256 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:54:00.367219    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:54:00.427692 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:54:00.427661    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:54:01.001304 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:54:01.001273    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:54:01.102935 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:54:01.102900    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:54:11.294309 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:54:11.294275    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:54:11.395271 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:54:11.395237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:54:11.460593 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:54:11.460562    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:54:40.619322 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:54:40.619285    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:54:40.693511 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:54:40.693481    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:54:50.201032 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:54:50.200988    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:54:50.216569 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:54:50.216543    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:54:50.788787 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:54:50.788760    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 08 15:55:04.574553 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:04.574518    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:04.674174 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:04.674118    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:31.519157 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:31.519120    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:32.337928 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:32.337895    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:32.464324 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:32.464287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:35.319024 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:35.318989    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:35.432032 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:35.431999    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:37.077695 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:37.077660    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:37.276079 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:37.276044    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:39.379733 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:39.379702    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:39.576724 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:39.576698    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:42.107958 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:42.107924    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:42.407260 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:42.407184    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:46.572469 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:46.572435    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:49.606128 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:49.606087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:49.705826 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:49.705792    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:51.990543 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:51.990508    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:55.192344 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:55.192307    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:55:56.760393 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:55:56.760358    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:02.070265 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:02.070221    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:02.187669 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:02.187640    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:02.479752 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:02.479673    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 08 15:56:04.525163 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:04.525130    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:09.507227 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:09.507181    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:14.382785 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.382744    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:14.430640 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.430612    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"]
Jul 08 15:56:14.432962 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.432941    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"
Jul 08 15:56:14.436695 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.436669    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 08 15:56:14.436809 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.436696    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 08 15:56:14.436809 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.436742    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 08 15:56:14.436929 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.436806    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 08 15:56:14.437030 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.437015    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jcrsn\""
Jul 08 15:56:14.437097 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.437044    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 08 15:56:14.445475 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.445453    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"]
Jul 08 15:56:14.457404 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.457382    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:14.530020 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.529988    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84nr2\" (UniqueName: \"kubernetes.io/projected/c938985f-3962-4cbd-b18c-08246c3aa072-kube-api-access-84nr2\") pod \"lws-controller-manager-57b64f8b44-j72ds\" (UID: \"c938985f-3962-4cbd-b18c-08246c3aa072\") " pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"
Jul 08 15:56:14.530207 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.530028    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c938985f-3962-4cbd-b18c-08246c3aa072-metrics-cert\") pod \"lws-controller-manager-57b64f8b44-j72ds\" (UID: \"c938985f-3962-4cbd-b18c-08246c3aa072\") " pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"
Jul 08 15:56:14.530207 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.530046    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c938985f-3962-4cbd-b18c-08246c3aa072-manager-config\") pod \"lws-controller-manager-57b64f8b44-j72ds\" (UID: \"c938985f-3962-4cbd-b18c-08246c3aa072\") " pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"
Jul 08 15:56:14.530207 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.530120    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c938985f-3962-4cbd-b18c-08246c3aa072-cert\") pod \"lws-controller-manager-57b64f8b44-j72ds\" (UID: \"c938985f-3962-4cbd-b18c-08246c3aa072\") " pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"
Jul 08 15:56:14.630868 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.630838    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c938985f-3962-4cbd-b18c-08246c3aa072-cert\") pod \"lws-controller-manager-57b64f8b44-j72ds\" (UID: \"c938985f-3962-4cbd-b18c-08246c3aa072\") " pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"
Jul 08 15:56:14.631043 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.630893    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84nr2\" (UniqueName: \"kubernetes.io/projected/c938985f-3962-4cbd-b18c-08246c3aa072-kube-api-access-84nr2\") pod \"lws-controller-manager-57b64f8b44-j72ds\" (UID: \"c938985f-3962-4cbd-b18c-08246c3aa072\") " pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"
Jul 08 15:56:14.631043 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.630913    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c938985f-3962-4cbd-b18c-08246c3aa072-metrics-cert\") pod \"lws-controller-manager-57b64f8b44-j72ds\" (UID: \"c938985f-3962-4cbd-b18c-08246c3aa072\") " pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"
Jul 08 15:56:14.631043 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.630930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c938985f-3962-4cbd-b18c-08246c3aa072-manager-config\") pod \"lws-controller-manager-57b64f8b44-j72ds\" (UID: \"c938985f-3962-4cbd-b18c-08246c3aa072\") " pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"
Jul 08 15:56:14.631611 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.631569    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c938985f-3962-4cbd-b18c-08246c3aa072-manager-config\") pod \"lws-controller-manager-57b64f8b44-j72ds\" (UID: \"c938985f-3962-4cbd-b18c-08246c3aa072\") " pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"
Jul 08 15:56:14.633372 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.633324    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c938985f-3962-4cbd-b18c-08246c3aa072-metrics-cert\") pod \"lws-controller-manager-57b64f8b44-j72ds\" (UID: \"c938985f-3962-4cbd-b18c-08246c3aa072\") " pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"
Jul 08 15:56:14.633372 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.633365    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c938985f-3962-4cbd-b18c-08246c3aa072-cert\") pod \"lws-controller-manager-57b64f8b44-j72ds\" (UID: \"c938985f-3962-4cbd-b18c-08246c3aa072\") " pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"
Jul 08 15:56:14.640015 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.639990    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84nr2\" (UniqueName: \"kubernetes.io/projected/c938985f-3962-4cbd-b18c-08246c3aa072-kube-api-access-84nr2\") pod \"lws-controller-manager-57b64f8b44-j72ds\" (UID: \"c938985f-3962-4cbd-b18c-08246c3aa072\") " pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"
Jul 08 15:56:14.742222 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.742187    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"
Jul 08 15:56:14.868886 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.868817    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"]
Jul 08 15:56:14.871315 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:56:14.871290    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc938985f_3962_4cbd_b18c_08246c3aa072.slice/crio-f286a5d8e2da58c8a51e4933295e89e09da458925c7ec135bddc49d1de57af34 WatchSource:0}: Error finding container f286a5d8e2da58c8a51e4933295e89e09da458925c7ec135bddc49d1de57af34: Status 404 returned error can't find the container with id f286a5d8e2da58c8a51e4933295e89e09da458925c7ec135bddc49d1de57af34
Jul 08 15:56:14.873149 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:14.873129    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 15:56:15.106684 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:15.106638    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds" event={"ID":"c938985f-3962-4cbd-b18c-08246c3aa072","Type":"ContainerStarted","Data":"f286a5d8e2da58c8a51e4933295e89e09da458925c7ec135bddc49d1de57af34"}
Jul 08 15:56:18.125016 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:18.124984    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds" event={"ID":"c938985f-3962-4cbd-b18c-08246c3aa072","Type":"ContainerStarted","Data":"b15f2c7ff0395a9dace9601e351c7f74a2a558df434e69fab30be7143aa0e225"}
Jul 08 15:56:18.125393 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:18.125114    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"
Jul 08 15:56:18.145320 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:18.145279    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds" podStartSLOduration=1.358266038 podStartE2EDuration="4.145264878s" totalImagesPullingTime="2.78699884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:18.145108427 +0000 UTC m=+317.555773081" watchObservedRunningTime="2026-07-08 15:56:18.145264878 +0000 UTC m=+317.555929566"
Jul 08 15:56:18.758285 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:18.758246    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:18.857747 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:18.857714    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:19.382232 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:19.382201    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:19.913803 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:19.913767    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:20.021038 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.021010    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:20.055445 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.055414    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"]
Jul 08 15:56:20.061989 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.061965    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:20.065725 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.065701    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 08 15:56:20.065880 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.065735    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 08 15:56:20.065880 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.065847    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 08 15:56:20.066197 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.066182    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-g2rr9\""
Jul 08 15:56:20.066251 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.066230    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 08 15:56:20.075237 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.075219    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"]
Jul 08 15:56:20.178753 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.178668    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c02467b-0358-45ec-841c-ab92725a7d3d-webhook-cert\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-cd6md\" (UID: \"0c02467b-0358-45ec-841c-ab92725a7d3d\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:20.178753 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.178728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8mqd\" (UniqueName: \"kubernetes.io/projected/0c02467b-0358-45ec-841c-ab92725a7d3d-kube-api-access-t8mqd\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-cd6md\" (UID: \"0c02467b-0358-45ec-841c-ab92725a7d3d\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:20.179120 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.178761    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c02467b-0358-45ec-841c-ab92725a7d3d-manifests\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-cd6md\" (UID: \"0c02467b-0358-45ec-841c-ab92725a7d3d\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:20.179120 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.178790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c02467b-0358-45ec-841c-ab92725a7d3d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-cd6md\" (UID: \"0c02467b-0358-45ec-841c-ab92725a7d3d\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:20.179120 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.178806    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c02467b-0358-45ec-841c-ab92725a7d3d-tmp\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-cd6md\" (UID: \"0c02467b-0358-45ec-841c-ab92725a7d3d\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:20.184072 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.184049    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:20.279492 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.279448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c02467b-0358-45ec-841c-ab92725a7d3d-tmp\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-cd6md\" (UID: \"0c02467b-0358-45ec-841c-ab92725a7d3d\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:20.279696 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.279522    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c02467b-0358-45ec-841c-ab92725a7d3d-webhook-cert\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-cd6md\" (UID: \"0c02467b-0358-45ec-841c-ab92725a7d3d\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:20.279696 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.279573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8mqd\" (UniqueName: \"kubernetes.io/projected/0c02467b-0358-45ec-841c-ab92725a7d3d-kube-api-access-t8mqd\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-cd6md\" (UID: \"0c02467b-0358-45ec-841c-ab92725a7d3d\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:20.279696 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.279629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c02467b-0358-45ec-841c-ab92725a7d3d-manifests\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-cd6md\" (UID: \"0c02467b-0358-45ec-841c-ab92725a7d3d\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:20.279696 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.279653    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c02467b-0358-45ec-841c-ab92725a7d3d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-cd6md\" (UID: \"0c02467b-0358-45ec-841c-ab92725a7d3d\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:20.280042 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.280012    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c02467b-0358-45ec-841c-ab92725a7d3d-manifests\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-cd6md\" (UID: \"0c02467b-0358-45ec-841c-ab92725a7d3d\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:20.281748 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.281728    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c02467b-0358-45ec-841c-ab92725a7d3d-tmp\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-cd6md\" (UID: \"0c02467b-0358-45ec-841c-ab92725a7d3d\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:20.281968 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.281952    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c02467b-0358-45ec-841c-ab92725a7d3d-webhook-cert\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-cd6md\" (UID: \"0c02467b-0358-45ec-841c-ab92725a7d3d\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:20.282100 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.282080    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c02467b-0358-45ec-841c-ab92725a7d3d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-cd6md\" (UID: \"0c02467b-0358-45ec-841c-ab92725a7d3d\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:20.302475 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.302449    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8mqd\" (UniqueName: \"kubernetes.io/projected/0c02467b-0358-45ec-841c-ab92725a7d3d-kube-api-access-t8mqd\") pod \"opendatahub-operator-controller-manager-86c94cb7c4-cd6md\" (UID: \"0c02467b-0358-45ec-841c-ab92725a7d3d\") " pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:20.303882 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.303847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:20.373172 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.373138    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:20.392946 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.392922    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:20.477267 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.477225    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:20.513805 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.513666    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"]
Jul 08 15:56:20.516482 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:56:20.516453    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c02467b_0358_45ec_841c_ab92725a7d3d.slice/crio-6be6496180465123f0285327b4efb4b5ed6aad48c43729551477dfd830843948 WatchSource:0}: Error finding container 6be6496180465123f0285327b4efb4b5ed6aad48c43729551477dfd830843948: Status 404 returned error can't find the container with id 6be6496180465123f0285327b4efb4b5ed6aad48c43729551477dfd830843948
Jul 08 15:56:20.536752 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.536723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:20.640630 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.640597    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:20.741832 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:20.741744    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:21.139097 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:21.139051    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md" event={"ID":"0c02467b-0358-45ec-841c-ab92725a7d3d","Type":"ContainerStarted","Data":"6be6496180465123f0285327b4efb4b5ed6aad48c43729551477dfd830843948"}
Jul 08 15:56:24.160055 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:24.160014    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md" event={"ID":"0c02467b-0358-45ec-841c-ab92725a7d3d","Type":"ContainerStarted","Data":"4fcf81854572d9a3d555427e009e6d711878c0563249047c9e9e21ce383de859"}
Jul 08 15:56:25.165757 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:25.165717    2562 generic.go:356] "Generic (PLEG): container finished" podID="0c02467b-0358-45ec-841c-ab92725a7d3d" containerID="4fcf81854572d9a3d555427e009e6d711878c0563249047c9e9e21ce383de859" exitCode=0
Jul 08 15:56:25.166168 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:25.165787    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md" event={"ID":"0c02467b-0358-45ec-841c-ab92725a7d3d","Type":"ContainerDied","Data":"4fcf81854572d9a3d555427e009e6d711878c0563249047c9e9e21ce383de859"}
Jul 08 15:56:26.174069 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:26.174024    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md" event={"ID":"0c02467b-0358-45ec-841c-ab92725a7d3d","Type":"ContainerStarted","Data":"6b5b4e1bcd8ec3aebf65491471a290acb4eaf4948232847b48227406dba73257"}
Jul 08 15:56:26.174490 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:26.174190    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:26.201136 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:26.201086    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md" podStartSLOduration=1.702215427 podStartE2EDuration="6.201068537s" totalImagesPullingTime="3.462842721s" totalInitContainerRuntime="1.036010389s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:56:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:26.199507172 +0000 UTC m=+325.610171826" watchObservedRunningTime="2026-07-08 15:56:26.201068537 +0000 UTC m=+325.611733191"
Jul 08 15:56:29.131107 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:29.131078    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-57b64f8b44-j72ds"
Jul 08 15:56:37.181168 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:37.181140    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86c94cb7c4-cd6md"
Jul 08 15:56:39.374212 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:39.374171    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:39.596916 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:39.596887    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:39.941129 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:39.941097    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:40.182401 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.182364    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-777c755669-tth2b"]
Jul 08 15:56:40.193691 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.193627    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-777c755669-tth2b"
Jul 08 15:56:40.196828 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.196805    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-v5sbg\""
Jul 08 15:56:40.196828 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.196821    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 08 15:56:40.197720 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.197697    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 08 15:56:40.197830 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.197731    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 08 15:56:40.197830 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.197735    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 08 15:56:40.208031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.208008    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-777c755669-tth2b"]
Jul 08 15:56:40.240531 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.240502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:40.355676 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.355644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/242b23c4-5723-47f8-be11-a3a20ceec4e6-tmp\") pod \"kube-auth-proxy-777c755669-tth2b\" (UID: \"242b23c4-5723-47f8-be11-a3a20ceec4e6\") " pod="openshift-ingress/kube-auth-proxy-777c755669-tth2b"
Jul 08 15:56:40.355676 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.355691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/242b23c4-5723-47f8-be11-a3a20ceec4e6-tls-certs\") pod \"kube-auth-proxy-777c755669-tth2b\" (UID: \"242b23c4-5723-47f8-be11-a3a20ceec4e6\") " pod="openshift-ingress/kube-auth-proxy-777c755669-tth2b"
Jul 08 15:56:40.355917 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.355718    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8m9l\" (UniqueName: \"kubernetes.io/projected/242b23c4-5723-47f8-be11-a3a20ceec4e6-kube-api-access-k8m9l\") pod \"kube-auth-proxy-777c755669-tth2b\" (UID: \"242b23c4-5723-47f8-be11-a3a20ceec4e6\") " pod="openshift-ingress/kube-auth-proxy-777c755669-tth2b"
Jul 08 15:56:40.396898 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.396871    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:40.457199 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.457111    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/242b23c4-5723-47f8-be11-a3a20ceec4e6-tmp\") pod \"kube-auth-proxy-777c755669-tth2b\" (UID: \"242b23c4-5723-47f8-be11-a3a20ceec4e6\") " pod="openshift-ingress/kube-auth-proxy-777c755669-tth2b"
Jul 08 15:56:40.457199 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.457150    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/242b23c4-5723-47f8-be11-a3a20ceec4e6-tls-certs\") pod \"kube-auth-proxy-777c755669-tth2b\" (UID: \"242b23c4-5723-47f8-be11-a3a20ceec4e6\") " pod="openshift-ingress/kube-auth-proxy-777c755669-tth2b"
Jul 08 15:56:40.457199 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.457175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8m9l\" (UniqueName: \"kubernetes.io/projected/242b23c4-5723-47f8-be11-a3a20ceec4e6-kube-api-access-k8m9l\") pod \"kube-auth-proxy-777c755669-tth2b\" (UID: \"242b23c4-5723-47f8-be11-a3a20ceec4e6\") " pod="openshift-ingress/kube-auth-proxy-777c755669-tth2b"
Jul 08 15:56:40.459385 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.459359    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/242b23c4-5723-47f8-be11-a3a20ceec4e6-tmp\") pod \"kube-auth-proxy-777c755669-tth2b\" (UID: \"242b23c4-5723-47f8-be11-a3a20ceec4e6\") " pod="openshift-ingress/kube-auth-proxy-777c755669-tth2b"
Jul 08 15:56:40.459737 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.459713    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/242b23c4-5723-47f8-be11-a3a20ceec4e6-tls-certs\") pod \"kube-auth-proxy-777c755669-tth2b\" (UID: \"242b23c4-5723-47f8-be11-a3a20ceec4e6\") " pod="openshift-ingress/kube-auth-proxy-777c755669-tth2b"
Jul 08 15:56:40.506031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.506001    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8m9l\" (UniqueName: \"kubernetes.io/projected/242b23c4-5723-47f8-be11-a3a20ceec4e6-kube-api-access-k8m9l\") pod \"kube-auth-proxy-777c755669-tth2b\" (UID: \"242b23c4-5723-47f8-be11-a3a20ceec4e6\") " pod="openshift-ingress/kube-auth-proxy-777c755669-tth2b"
Jul 08 15:56:40.594980 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.594949    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:40.721881 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.721801    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:40.804881 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.804847    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-777c755669-tth2b"
Jul 08 15:56:40.837251 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.837218    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:40.965074 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:40.965034    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-777c755669-tth2b"]
Jul 08 15:56:40.976373 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:56:40.976329    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod242b23c4_5723_47f8_be11_a3a20ceec4e6.slice/crio-132b8c21c5de3c3ac987e95d444a3509fb6d5a774f1397b2fb59bbd8e1e93972 WatchSource:0}: Error finding container 132b8c21c5de3c3ac987e95d444a3509fb6d5a774f1397b2fb59bbd8e1e93972: Status 404 returned error can't find the container with id 132b8c21c5de3c3ac987e95d444a3509fb6d5a774f1397b2fb59bbd8e1e93972
Jul 08 15:56:41.237027 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:41.236930    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-777c755669-tth2b" event={"ID":"242b23c4-5723-47f8-be11-a3a20ceec4e6","Type":"ContainerStarted","Data":"132b8c21c5de3c3ac987e95d444a3509fb6d5a774f1397b2fb59bbd8e1e93972"}
Jul 08 15:56:41.610117 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:41.610087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:41.930934 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:41.930852    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:42.083481 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:42.083441    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:42.182361 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:42.182288    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:43.168740 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:43.168699    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:44.262906 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:44.262866    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-777c755669-tth2b" event={"ID":"242b23c4-5723-47f8-be11-a3a20ceec4e6","Type":"ContainerStarted","Data":"d96a8dbb6b079d74b9af456c65e85695c67d718d720d779ae072595137641e13"}
Jul 08 15:56:44.282781 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:44.282726    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-777c755669-tth2b" podStartSLOduration=1.097000817 podStartE2EDuration="4.282710411s" totalImagesPullingTime="3.185709594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:56:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:44.281316572 +0000 UTC m=+343.691981232" watchObservedRunningTime="2026-07-08 15:56:44.282710411 +0000 UTC m=+343.693375064"
Jul 08 15:56:47.499717 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:47.499677    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:48.448742 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:48.448700    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:48.879086 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:48.879053    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:49.208834 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:49.208757    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:51.593908 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:51.593870    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:51.740918 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:51.740885    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:51.923186 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:51.923105    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:52.060019 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:52.059978    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:52.333762 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:52.333732    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:56:52.413386 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:56:52.413352    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:57:28.268049 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:57:28.267975    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:57:41.020122 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:57:41.020082    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:57:41.110849 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:57:41.110810    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:57:41.269129 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:57:41.269092    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:57:55.478727 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:57:55.478695    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:57:55.579359 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:57:55.579320    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:57:57.329137 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:57:57.329103    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:57:57.389852 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:57:57.389814    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:00.943819 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:00.943786    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:01.064083 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:01.064056    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:10.282060 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:10.282025    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:12.064986 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:12.064952    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:12.164994 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:12.164952    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:12.225031 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:12.224996    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:14.432128 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:14.432091    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:15.514049 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:15.514008    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:15.606650 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:15.606613    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:16.883144 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:16.883104    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:17.019847 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:17.019807    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:18.299457 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:18.299427    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:21.498055 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:21.498020    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:21.954741 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:21.954708    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:22.229828 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:22.229748    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:22.335681 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:22.335648    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:24.938284 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:24.938206    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:26.239882 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:26.239851    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:26.340965 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:26.340931    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:30.061635 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:30.061600    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:30.202142 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:30.202100    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:31.386706 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.386665    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj"]
Jul 08 15:58:31.389794 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.389778    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj"
Jul 08 15:58:31.392911 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.392886    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 08 15:58:31.393068 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.392918    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 08 15:58:31.393068 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.392976    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9xp52\""
Jul 08 15:58:31.394074 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.394056    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 08 15:58:31.394165 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.394093    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 08 15:58:31.401432 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.401412    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj"]
Jul 08 15:58:31.405716 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.405698    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:31.430888 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.430865    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7l5n\" (UniqueName: \"kubernetes.io/projected/2580f8e1-5769-4a15-97b6-de1049d36747-kube-api-access-g7l5n\") pod \"kuadrant-console-plugin-66b5774985-qntmj\" (UID: \"2580f8e1-5769-4a15-97b6-de1049d36747\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj"
Jul 08 15:58:31.431010 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.430903    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2580f8e1-5769-4a15-97b6-de1049d36747-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qntmj\" (UID: \"2580f8e1-5769-4a15-97b6-de1049d36747\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj"
Jul 08 15:58:31.431010 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.430991    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2580f8e1-5769-4a15-97b6-de1049d36747-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qntmj\" (UID: \"2580f8e1-5769-4a15-97b6-de1049d36747\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj"
Jul 08 15:58:31.532270 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.532239    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2580f8e1-5769-4a15-97b6-de1049d36747-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qntmj\" (UID: \"2580f8e1-5769-4a15-97b6-de1049d36747\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj"
Jul 08 15:58:31.532439 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.532288    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7l5n\" (UniqueName: \"kubernetes.io/projected/2580f8e1-5769-4a15-97b6-de1049d36747-kube-api-access-g7l5n\") pod \"kuadrant-console-plugin-66b5774985-qntmj\" (UID: \"2580f8e1-5769-4a15-97b6-de1049d36747\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj"
Jul 08 15:58:31.532439 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.532318    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2580f8e1-5769-4a15-97b6-de1049d36747-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qntmj\" (UID: \"2580f8e1-5769-4a15-97b6-de1049d36747\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj"
Jul 08 15:58:31.532439 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:58:31.532398    2562 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 08 15:58:31.532540 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:58:31.532488    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2580f8e1-5769-4a15-97b6-de1049d36747-plugin-serving-cert podName:2580f8e1-5769-4a15-97b6-de1049d36747 nodeName:}" failed. No retries permitted until 2026-07-08 15:58:32.032469248 +0000 UTC m=+451.443133880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/2580f8e1-5769-4a15-97b6-de1049d36747-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-qntmj" (UID: "2580f8e1-5769-4a15-97b6-de1049d36747") : secret "plugin-serving-cert" not found
Jul 08 15:58:31.532892 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.532876    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2580f8e1-5769-4a15-97b6-de1049d36747-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-qntmj\" (UID: \"2580f8e1-5769-4a15-97b6-de1049d36747\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj"
Jul 08 15:58:31.541241 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.541218    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7l5n\" (UniqueName: \"kubernetes.io/projected/2580f8e1-5769-4a15-97b6-de1049d36747-kube-api-access-g7l5n\") pod \"kuadrant-console-plugin-66b5774985-qntmj\" (UID: \"2580f8e1-5769-4a15-97b6-de1049d36747\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj"
Jul 08 15:58:31.702657 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:31.702542    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:32.037560 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:32.037518    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2580f8e1-5769-4a15-97b6-de1049d36747-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qntmj\" (UID: \"2580f8e1-5769-4a15-97b6-de1049d36747\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj"
Jul 08 15:58:32.039921 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:32.039896    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/2580f8e1-5769-4a15-97b6-de1049d36747-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-qntmj\" (UID: \"2580f8e1-5769-4a15-97b6-de1049d36747\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj"
Jul 08 15:58:32.317847 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:32.317762    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj"
Jul 08 15:58:32.448825 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:32.448801    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj"]
Jul 08 15:58:32.450871 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:58:32.450841    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2580f8e1_5769_4a15_97b6_de1049d36747.slice/crio-fa1e0e1292412e5a59e9341dd2be3bf22999362477516db363692a40c4afa1b5 WatchSource:0}: Error finding container fa1e0e1292412e5a59e9341dd2be3bf22999362477516db363692a40c4afa1b5: Status 404 returned error can't find the container with id fa1e0e1292412e5a59e9341dd2be3bf22999362477516db363692a40c4afa1b5
Jul 08 15:58:32.726448 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:32.726356    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj" event={"ID":"2580f8e1-5769-4a15-97b6-de1049d36747","Type":"ContainerStarted","Data":"fa1e0e1292412e5a59e9341dd2be3bf22999362477516db363692a40c4afa1b5"}
Jul 08 15:58:33.429306 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:33.429267    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:33.539057 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:33.538999    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:41.428810 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:41.428769    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:41.531938 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:41.531888    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:41.888625 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:41.888522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:42.000398 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:42.000364    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:42.140472 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:42.140388    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:44.407498 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:44.407448    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:44.508954 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:44.508917    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:47.247311 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:47.247278    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:47.349511 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:47.349475    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:50.978923 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:50.978892    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:51.074885 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:51.074847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:55.846961 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:55.846923    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj" event={"ID":"2580f8e1-5769-4a15-97b6-de1049d36747","Type":"ContainerStarted","Data":"f629cce7d2349e9a4e92f73df13bd53aecd5721824b6a4119bfb061d7b90bd8a"}
Jul 08 15:58:55.864949 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:55.864880    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-qntmj" podStartSLOduration=1.933626774 podStartE2EDuration="24.864865074s" totalImagesPullingTime="22.9312383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:55.863806901 +0000 UTC m=+475.274471556" watchObservedRunningTime="2026-07-08 15:58:55.864865074 +0000 UTC m=+475.275529728"
Jul 08 15:58:59.808193 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:59.808156    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:58:59.914984 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:58:59.914940    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:00.008927 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:00.008890    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:02.404088 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:02.404056    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:02.505700 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:02.505669    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:06.417472 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:06.417431    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:06.520040 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:06.520006    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:10.023980 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:10.023942    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:10.100403 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:10.100360    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:10.636838 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:10.636789    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:11.266247 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:11.266212    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:20.874192 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:20.874157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:20.970841 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:20.970783    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:21.415393 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:21.415357    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:21.516531 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:21.516494    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:24.301448 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:24.301412    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:24.584032 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:24.583948    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:24.684944 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:24.684904    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:24.796020 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:24.795987    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 15:59:24.822216 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:24.822174    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 15:59:24.822394 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:24.822309    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"
Jul 08 15:59:24.825226 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:24.825203    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 08 15:59:24.832198 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:24.832170    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 15:59:24.921109 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:24.921035    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2pll\" (UniqueName: \"kubernetes.io/projected/9e4f23c8-5c8b-4ea6-8245-c4d9de609f6d-kube-api-access-f2pll\") pod \"limitador-limitador-54d6d988d5-mq9nd\" (UID: \"9e4f23c8-5c8b-4ea6-8245-c4d9de609f6d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"
Jul 08 15:59:24.921258 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:24.921113    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e4f23c8-5c8b-4ea6-8245-c4d9de609f6d-config-file\") pod \"limitador-limitador-54d6d988d5-mq9nd\" (UID: \"9e4f23c8-5c8b-4ea6-8245-c4d9de609f6d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"
Jul 08 15:59:25.022033 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.021998    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2pll\" (UniqueName: \"kubernetes.io/projected/9e4f23c8-5c8b-4ea6-8245-c4d9de609f6d-kube-api-access-f2pll\") pod \"limitador-limitador-54d6d988d5-mq9nd\" (UID: \"9e4f23c8-5c8b-4ea6-8245-c4d9de609f6d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"
Jul 08 15:59:25.022214 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.022067    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e4f23c8-5c8b-4ea6-8245-c4d9de609f6d-config-file\") pod \"limitador-limitador-54d6d988d5-mq9nd\" (UID: \"9e4f23c8-5c8b-4ea6-8245-c4d9de609f6d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"
Jul 08 15:59:25.022835 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.022808    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9e4f23c8-5c8b-4ea6-8245-c4d9de609f6d-config-file\") pod \"limitador-limitador-54d6d988d5-mq9nd\" (UID: \"9e4f23c8-5c8b-4ea6-8245-c4d9de609f6d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"
Jul 08 15:59:25.031349 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.031320    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2pll\" (UniqueName: \"kubernetes.io/projected/9e4f23c8-5c8b-4ea6-8245-c4d9de609f6d-kube-api-access-f2pll\") pod \"limitador-limitador-54d6d988d5-mq9nd\" (UID: \"9e4f23c8-5c8b-4ea6-8245-c4d9de609f6d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"
Jul 08 15:59:25.133806 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.133771    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"
Jul 08 15:59:25.173369 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.173292    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-bpkg5"]
Jul 08 15:59:25.205944 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.205913    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:25.209594 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.209546    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bpkg5"]
Jul 08 15:59:25.209742 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.209696    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bpkg5"
Jul 08 15:59:25.212687 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.212641    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-664lc\""
Jul 08 15:59:25.319654 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.319617    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:25.324793 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.324771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nbz2\" (UniqueName: \"kubernetes.io/projected/77b5f34e-1499-4f85-b6a1-85e4ad5203bf-kube-api-access-2nbz2\") pod \"authorino-58cd955675-bpkg5\" (UID: \"77b5f34e-1499-4f85-b6a1-85e4ad5203bf\") " pod="kuadrant-system/authorino-58cd955675-bpkg5"
Jul 08 15:59:25.333941 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.333917    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 15:59:25.335731 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:59:25.335708    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e4f23c8_5c8b_4ea6_8245_c4d9de609f6d.slice/crio-0e40d8d703a45c2dc584c6f5e7b9f905bc9e10755600e6c0a2ffef35a685f88b WatchSource:0}: Error finding container 0e40d8d703a45c2dc584c6f5e7b9f905bc9e10755600e6c0a2ffef35a685f88b: Status 404 returned error can't find the container with id 0e40d8d703a45c2dc584c6f5e7b9f905bc9e10755600e6c0a2ffef35a685f88b
Jul 08 15:59:25.425984 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.425914    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nbz2\" (UniqueName: \"kubernetes.io/projected/77b5f34e-1499-4f85-b6a1-85e4ad5203bf-kube-api-access-2nbz2\") pod \"authorino-58cd955675-bpkg5\" (UID: \"77b5f34e-1499-4f85-b6a1-85e4ad5203bf\") " pod="kuadrant-system/authorino-58cd955675-bpkg5"
Jul 08 15:59:25.435279 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.435253    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nbz2\" (UniqueName: \"kubernetes.io/projected/77b5f34e-1499-4f85-b6a1-85e4ad5203bf-kube-api-access-2nbz2\") pod \"authorino-58cd955675-bpkg5\" (UID: \"77b5f34e-1499-4f85-b6a1-85e4ad5203bf\") " pod="kuadrant-system/authorino-58cd955675-bpkg5"
Jul 08 15:59:25.531435 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.531399    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bpkg5"
Jul 08 15:59:25.710281 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.710133    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-bpkg5"]
Jul 08 15:59:25.712799 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:59:25.712772    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77b5f34e_1499_4f85_b6a1_85e4ad5203bf.slice/crio-2494fba2ab388ba5aef51b007ac1fe78295ffbb15d8b56b192945c75a477e47a WatchSource:0}: Error finding container 2494fba2ab388ba5aef51b007ac1fe78295ffbb15d8b56b192945c75a477e47a: Status 404 returned error can't find the container with id 2494fba2ab388ba5aef51b007ac1fe78295ffbb15d8b56b192945c75a477e47a
Jul 08 15:59:25.984632 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.984512    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bpkg5" event={"ID":"77b5f34e-1499-4f85-b6a1-85e4ad5203bf","Type":"ContainerStarted","Data":"2494fba2ab388ba5aef51b007ac1fe78295ffbb15d8b56b192945c75a477e47a"}
Jul 08 15:59:25.986399 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:25.986192    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mq9nd" event={"ID":"9e4f23c8-5c8b-4ea6-8245-c4d9de609f6d","Type":"ContainerStarted","Data":"0e40d8d703a45c2dc584c6f5e7b9f905bc9e10755600e6c0a2ffef35a685f88b"}
Jul 08 15:59:30.008804 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:30.008767    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bpkg5" event={"ID":"77b5f34e-1499-4f85-b6a1-85e4ad5203bf","Type":"ContainerStarted","Data":"5a21f3dc9fbc75485980a6bbd39c0265a201cb81f4616a73e9768ec54ab9ac1f"}
Jul 08 15:59:30.010302 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:30.010279    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mq9nd" event={"ID":"9e4f23c8-5c8b-4ea6-8245-c4d9de609f6d","Type":"ContainerStarted","Data":"9645ed268a6ece723571f152bd38220be6f0a5a985189986c2ef34913d35cb98"}
Jul 08 15:59:30.010418 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:30.010356    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"
Jul 08 15:59:30.027445 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:30.027392    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-bpkg5" podStartSLOduration=0.926258513 podStartE2EDuration="5.027377199s" totalImagesPullingTime="4.101118686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:59:30.026191014 +0000 UTC m=+509.436855669" watchObservedRunningTime="2026-07-08 15:59:30.027377199 +0000 UTC m=+509.438041852"
Jul 08 15:59:30.360617 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:30.360544    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-mq9nd" podStartSLOduration=1.88418825 podStartE2EDuration="6.360528121s" totalImagesPullingTime="4.476339871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:59:30.097296505 +0000 UTC m=+509.507961140" watchObservedRunningTime="2026-07-08 15:59:30.360528121 +0000 UTC m=+509.771192774"
Jul 08 15:59:30.360980 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:30.360963    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bpkg5"]
Jul 08 15:59:32.019150 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:32.019113    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-bpkg5" podUID="77b5f34e-1499-4f85-b6a1-85e4ad5203bf" containerName="authorino" containerID="cri-o://5a21f3dc9fbc75485980a6bbd39c0265a201cb81f4616a73e9768ec54ab9ac1f" gracePeriod=30
Jul 08 15:59:32.268280 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:32.268255    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bpkg5"
Jul 08 15:59:32.391425 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:32.391337    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nbz2\" (UniqueName: \"kubernetes.io/projected/77b5f34e-1499-4f85-b6a1-85e4ad5203bf-kube-api-access-2nbz2\") pod \"77b5f34e-1499-4f85-b6a1-85e4ad5203bf\" (UID: \"77b5f34e-1499-4f85-b6a1-85e4ad5203bf\") "
Jul 08 15:59:32.393528 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:32.393493    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77b5f34e-1499-4f85-b6a1-85e4ad5203bf-kube-api-access-2nbz2" (OuterVolumeSpecName: "kube-api-access-2nbz2") pod "77b5f34e-1499-4f85-b6a1-85e4ad5203bf" (UID: "77b5f34e-1499-4f85-b6a1-85e4ad5203bf"). InnerVolumeSpecName "kube-api-access-2nbz2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:59:32.492706 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:32.492671    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nbz2\" (UniqueName: \"kubernetes.io/projected/77b5f34e-1499-4f85-b6a1-85e4ad5203bf-kube-api-access-2nbz2\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 15:59:33.024312 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:33.024279    2562 generic.go:356] "Generic (PLEG): container finished" podID="77b5f34e-1499-4f85-b6a1-85e4ad5203bf" containerID="5a21f3dc9fbc75485980a6bbd39c0265a201cb81f4616a73e9768ec54ab9ac1f" exitCode=0
Jul 08 15:59:33.024782 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:33.024319    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-bpkg5"
Jul 08 15:59:33.024782 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:33.024362    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bpkg5" event={"ID":"77b5f34e-1499-4f85-b6a1-85e4ad5203bf","Type":"ContainerDied","Data":"5a21f3dc9fbc75485980a6bbd39c0265a201cb81f4616a73e9768ec54ab9ac1f"}
Jul 08 15:59:33.024782 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:33.024406    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-bpkg5" event={"ID":"77b5f34e-1499-4f85-b6a1-85e4ad5203bf","Type":"ContainerDied","Data":"2494fba2ab388ba5aef51b007ac1fe78295ffbb15d8b56b192945c75a477e47a"}
Jul 08 15:59:33.024782 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:33.024424    2562 scope.go:117] "RemoveContainer" containerID="5a21f3dc9fbc75485980a6bbd39c0265a201cb81f4616a73e9768ec54ab9ac1f"
Jul 08 15:59:33.032671 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:33.032653    2562 scope.go:117] "RemoveContainer" containerID="5a21f3dc9fbc75485980a6bbd39c0265a201cb81f4616a73e9768ec54ab9ac1f"
Jul 08 15:59:33.032947 ip-10-0-131-108 kubenswrapper[2562]: E0708 15:59:33.032926    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a21f3dc9fbc75485980a6bbd39c0265a201cb81f4616a73e9768ec54ab9ac1f\": container with ID starting with 5a21f3dc9fbc75485980a6bbd39c0265a201cb81f4616a73e9768ec54ab9ac1f not found: ID does not exist" containerID="5a21f3dc9fbc75485980a6bbd39c0265a201cb81f4616a73e9768ec54ab9ac1f"
Jul 08 15:59:33.033005 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:33.032956    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a21f3dc9fbc75485980a6bbd39c0265a201cb81f4616a73e9768ec54ab9ac1f"} err="failed to get container status \"5a21f3dc9fbc75485980a6bbd39c0265a201cb81f4616a73e9768ec54ab9ac1f\": rpc error: code = NotFound desc = could not find container \"5a21f3dc9fbc75485980a6bbd39c0265a201cb81f4616a73e9768ec54ab9ac1f\": container with ID starting with 5a21f3dc9fbc75485980a6bbd39c0265a201cb81f4616a73e9768ec54ab9ac1f not found: ID does not exist"
Jul 08 15:59:33.044433 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:33.044409    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-bpkg5"]
Jul 08 15:59:33.048470 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:33.048451    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-bpkg5"]
Jul 08 15:59:34.617362 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:34.617324    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77b5f34e-1499-4f85-b6a1-85e4ad5203bf" path="/var/lib/kubelet/pods/77b5f34e-1499-4f85-b6a1-85e4ad5203bf/volumes"
Jul 08 15:59:41.015694 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:41.015653    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"
Jul 08 15:59:43.779135 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:43.779100    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:43.873549 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:43.873517    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:44.302015 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:44.301983    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:56.757462 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:56.757383    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:57.291081 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.291044    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-767b957f76-4r75w"]
Jul 08 15:59:57.291425 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.291411    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77b5f34e-1499-4f85-b6a1-85e4ad5203bf" containerName="authorino"
Jul 08 15:59:57.291472 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.291426    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="77b5f34e-1499-4f85-b6a1-85e4ad5203bf" containerName="authorino"
Jul 08 15:59:57.291507 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.291499    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="77b5f34e-1499-4f85-b6a1-85e4ad5203bf" containerName="authorino"
Jul 08 15:59:57.293746 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.293732    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-767b957f76-4r75w"
Jul 08 15:59:57.296679 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.296656    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-664lc\""
Jul 08 15:59:57.304169 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.304148    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-767b957f76-4r75w"]
Jul 08 15:59:57.310970 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.310949    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr84d\" (UniqueName: \"kubernetes.io/projected/855d03e7-83e4-4d3a-bb98-28b1441e6e26-kube-api-access-vr84d\") pod \"authorino-767b957f76-4r75w\" (UID: \"855d03e7-83e4-4d3a-bb98-28b1441e6e26\") " pod="kuadrant-system/authorino-767b957f76-4r75w"
Jul 08 15:59:57.376917 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.376889    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 15:59:57.411569 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.411540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr84d\" (UniqueName: \"kubernetes.io/projected/855d03e7-83e4-4d3a-bb98-28b1441e6e26-kube-api-access-vr84d\") pod \"authorino-767b957f76-4r75w\" (UID: \"855d03e7-83e4-4d3a-bb98-28b1441e6e26\") " pod="kuadrant-system/authorino-767b957f76-4r75w"
Jul 08 15:59:57.426638 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.426604    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr84d\" (UniqueName: \"kubernetes.io/projected/855d03e7-83e4-4d3a-bb98-28b1441e6e26-kube-api-access-vr84d\") pod \"authorino-767b957f76-4r75w\" (UID: \"855d03e7-83e4-4d3a-bb98-28b1441e6e26\") " pod="kuadrant-system/authorino-767b957f76-4r75w"
Jul 08 15:59:57.602791 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.602711    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-767b957f76-4r75w"
Jul 08 15:59:57.613821 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.613792    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-767b957f76-4r75w"]
Jul 08 15:59:57.645947 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.645916    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5ddb6bcc9b-svps2"]
Jul 08 15:59:57.648366 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.648349    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5ddb6bcc9b-svps2"
Jul 08 15:59:57.651849 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.651810    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 08 15:59:57.659552 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.659525    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5ddb6bcc9b-svps2"]
Jul 08 15:59:57.714496 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.714465    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd-tls-cert\") pod \"authorino-5ddb6bcc9b-svps2\" (UID: \"5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd\") " pod="kuadrant-system/authorino-5ddb6bcc9b-svps2"
Jul 08 15:59:57.714749 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.714547    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8t59\" (UniqueName: \"kubernetes.io/projected/5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd-kube-api-access-j8t59\") pod \"authorino-5ddb6bcc9b-svps2\" (UID: \"5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd\") " pod="kuadrant-system/authorino-5ddb6bcc9b-svps2"
Jul 08 15:59:57.745538 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.745511    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-767b957f76-4r75w"]
Jul 08 15:59:57.747342 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:59:57.747307    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod855d03e7_83e4_4d3a_bb98_28b1441e6e26.slice/crio-bcd162f3c1d08e24f655bedb3629a8191a166fd9221b4aed025551bb64aa89e7 WatchSource:0}: Error finding container bcd162f3c1d08e24f655bedb3629a8191a166fd9221b4aed025551bb64aa89e7: Status 404 returned error can't find the container with id bcd162f3c1d08e24f655bedb3629a8191a166fd9221b4aed025551bb64aa89e7
Jul 08 15:59:57.815418 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.815385    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8t59\" (UniqueName: \"kubernetes.io/projected/5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd-kube-api-access-j8t59\") pod \"authorino-5ddb6bcc9b-svps2\" (UID: \"5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd\") " pod="kuadrant-system/authorino-5ddb6bcc9b-svps2"
Jul 08 15:59:57.815827 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.815444    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd-tls-cert\") pod \"authorino-5ddb6bcc9b-svps2\" (UID: \"5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd\") " pod="kuadrant-system/authorino-5ddb6bcc9b-svps2"
Jul 08 15:59:57.817812 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.817790    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd-tls-cert\") pod \"authorino-5ddb6bcc9b-svps2\" (UID: \"5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd\") " pod="kuadrant-system/authorino-5ddb6bcc9b-svps2"
Jul 08 15:59:57.824910 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.824887    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8t59\" (UniqueName: \"kubernetes.io/projected/5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd-kube-api-access-j8t59\") pod \"authorino-5ddb6bcc9b-svps2\" (UID: \"5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd\") " pod="kuadrant-system/authorino-5ddb6bcc9b-svps2"
Jul 08 15:59:57.959903 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:57.959804    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5ddb6bcc9b-svps2"
Jul 08 15:59:58.091508 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:58.091481    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5ddb6bcc9b-svps2"]
Jul 08 15:59:58.093606 ip-10-0-131-108 kubenswrapper[2562]: W0708 15:59:58.093567    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b8d2ab6_6428_4fa3_b2e7_db3e9dc7a5fd.slice/crio-94bd2b3a7e01eb55b9d85e66a055a34a625bffeaa78c7521df6f79940e0b01d8 WatchSource:0}: Error finding container 94bd2b3a7e01eb55b9d85e66a055a34a625bffeaa78c7521df6f79940e0b01d8: Status 404 returned error can't find the container with id 94bd2b3a7e01eb55b9d85e66a055a34a625bffeaa78c7521df6f79940e0b01d8
Jul 08 15:59:58.142074 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:58.142039    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-767b957f76-4r75w" event={"ID":"855d03e7-83e4-4d3a-bb98-28b1441e6e26","Type":"ContainerStarted","Data":"bcd162f3c1d08e24f655bedb3629a8191a166fd9221b4aed025551bb64aa89e7"}
Jul 08 15:59:58.143258 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:58.143226    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5ddb6bcc9b-svps2" event={"ID":"5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd","Type":"ContainerStarted","Data":"94bd2b3a7e01eb55b9d85e66a055a34a625bffeaa78c7521df6f79940e0b01d8"}
Jul 08 15:59:59.149205 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:59.149170    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5ddb6bcc9b-svps2" event={"ID":"5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd","Type":"ContainerStarted","Data":"6c5be8662f3a159d808e94060aeeaaaf92bb61c756d717a328156a4eed85bce2"}
Jul 08 15:59:59.150600 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:59.150551    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-767b957f76-4r75w" event={"ID":"855d03e7-83e4-4d3a-bb98-28b1441e6e26","Type":"ContainerStarted","Data":"45a6e96e8f38702b129cf9870d3b02ccba3680ca68e3a69ba1729ec6fc6b7f55"}
Jul 08 15:59:59.150742 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:59.150625    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-767b957f76-4r75w" podUID="855d03e7-83e4-4d3a-bb98-28b1441e6e26" containerName="authorino" containerID="cri-o://45a6e96e8f38702b129cf9870d3b02ccba3680ca68e3a69ba1729ec6fc6b7f55" gracePeriod=30
Jul 08 15:59:59.168192 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:59.168145    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5ddb6bcc9b-svps2" podStartSLOduration=1.619298939 podStartE2EDuration="2.168128331s" totalImagesPullingTime="548.829392ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:59:59.166972981 +0000 UTC m=+538.577637635" watchObservedRunningTime="2026-07-08 15:59:59.168128331 +0000 UTC m=+538.578792984"
Jul 08 15:59:59.187405 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:59.187347    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-767b957f76-4r75w" podStartSLOduration=1.792006036 podStartE2EDuration="2.187325881s" totalImagesPullingTime="395.319845ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:59:59.184945071 +0000 UTC m=+538.595609725" watchObservedRunningTime="2026-07-08 15:59:59.187325881 +0000 UTC m=+538.597990539"
Jul 08 15:59:59.425951 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:59.425877    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-767b957f76-4r75w"
Jul 08 15:59:59.534396 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:59.534353    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr84d\" (UniqueName: \"kubernetes.io/projected/855d03e7-83e4-4d3a-bb98-28b1441e6e26-kube-api-access-vr84d\") pod \"855d03e7-83e4-4d3a-bb98-28b1441e6e26\" (UID: \"855d03e7-83e4-4d3a-bb98-28b1441e6e26\") "
Jul 08 15:59:59.536457 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:59.536430    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/855d03e7-83e4-4d3a-bb98-28b1441e6e26-kube-api-access-vr84d" (OuterVolumeSpecName: "kube-api-access-vr84d") pod "855d03e7-83e4-4d3a-bb98-28b1441e6e26" (UID: "855d03e7-83e4-4d3a-bb98-28b1441e6e26"). InnerVolumeSpecName "kube-api-access-vr84d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 15:59:59.635514 ip-10-0-131-108 kubenswrapper[2562]: I0708 15:59:59.635475    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr84d\" (UniqueName: \"kubernetes.io/projected/855d03e7-83e4-4d3a-bb98-28b1441e6e26-kube-api-access-vr84d\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:00:00.157901 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:00.157862    2562 generic.go:356] "Generic (PLEG): container finished" podID="855d03e7-83e4-4d3a-bb98-28b1441e6e26" containerID="45a6e96e8f38702b129cf9870d3b02ccba3680ca68e3a69ba1729ec6fc6b7f55" exitCode=0
Jul 08 16:00:00.158359 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:00.157911    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-767b957f76-4r75w"
Jul 08 16:00:00.158359 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:00.157951    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-767b957f76-4r75w" event={"ID":"855d03e7-83e4-4d3a-bb98-28b1441e6e26","Type":"ContainerDied","Data":"45a6e96e8f38702b129cf9870d3b02ccba3680ca68e3a69ba1729ec6fc6b7f55"}
Jul 08 16:00:00.158359 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:00.157995    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-767b957f76-4r75w" event={"ID":"855d03e7-83e4-4d3a-bb98-28b1441e6e26","Type":"ContainerDied","Data":"bcd162f3c1d08e24f655bedb3629a8191a166fd9221b4aed025551bb64aa89e7"}
Jul 08 16:00:00.158359 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:00.158015    2562 scope.go:117] "RemoveContainer" containerID="45a6e96e8f38702b129cf9870d3b02ccba3680ca68e3a69ba1729ec6fc6b7f55"
Jul 08 16:00:00.166825 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:00.166791    2562 scope.go:117] "RemoveContainer" containerID="45a6e96e8f38702b129cf9870d3b02ccba3680ca68e3a69ba1729ec6fc6b7f55"
Jul 08 16:00:00.167094 ip-10-0-131-108 kubenswrapper[2562]: E0708 16:00:00.167078    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45a6e96e8f38702b129cf9870d3b02ccba3680ca68e3a69ba1729ec6fc6b7f55\": container with ID starting with 45a6e96e8f38702b129cf9870d3b02ccba3680ca68e3a69ba1729ec6fc6b7f55 not found: ID does not exist" containerID="45a6e96e8f38702b129cf9870d3b02ccba3680ca68e3a69ba1729ec6fc6b7f55"
Jul 08 16:00:00.167148 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:00.167103    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45a6e96e8f38702b129cf9870d3b02ccba3680ca68e3a69ba1729ec6fc6b7f55"} err="failed to get container status \"45a6e96e8f38702b129cf9870d3b02ccba3680ca68e3a69ba1729ec6fc6b7f55\": rpc error: code = NotFound desc = could not find container \"45a6e96e8f38702b129cf9870d3b02ccba3680ca68e3a69ba1729ec6fc6b7f55\": container with ID starting with 45a6e96e8f38702b129cf9870d3b02ccba3680ca68e3a69ba1729ec6fc6b7f55 not found: ID does not exist"
Jul 08 16:00:00.180624 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:00.180594    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-767b957f76-4r75w"]
Jul 08 16:00:00.187430 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:00.187405    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-767b957f76-4r75w"]
Jul 08 16:00:00.616967 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:00.616934    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="855d03e7-83e4-4d3a-bb98-28b1441e6e26" path="/var/lib/kubelet/pods/855d03e7-83e4-4d3a-bb98-28b1441e6e26/volumes"
Jul 08 16:00:03.692177 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:03.692141    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:00:03.790988 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:03.790939    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:00:03.891225 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:03.891193    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:00:04.343034 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:04.342999    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:00:07.373622 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:07.373535    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:00:07.484182 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:07.484148    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:00:23.305797 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:23.305764    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:00:39.795078 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:39.795038    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:00:40.255812 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:40.255723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:00:40.572922 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:40.572887    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:00:40.823928 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:40.823846    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:00:40.922955 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:40.922918    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:00:41.125418 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:41.125323    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:00:51.746438 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:51.746401    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:00:51.846231 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:00:51.846200    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:01:01.223361 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:01.223327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:01:01.595727 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:01.595686    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:01:12.845003 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:12.844965    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:01:12.945311 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:12.945280    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:01:13.814370 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:13.814330    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:01:14.591013 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:14.590971    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:01:29.933043 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:29.932961    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:01:30.694532 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:30.694495    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:01:31.088611 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:31.088557    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:01:50.751272 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.751236    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"]
Jul 08 16:01:50.751769 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.751626    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="855d03e7-83e4-4d3a-bb98-28b1441e6e26" containerName="authorino"
Jul 08 16:01:50.751769 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.751639    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="855d03e7-83e4-4d3a-bb98-28b1441e6e26" containerName="authorino"
Jul 08 16:01:50.751769 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.751701    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="855d03e7-83e4-4d3a-bb98-28b1441e6e26" containerName="authorino"
Jul 08 16:01:50.753825 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.753808    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.756831 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.756789    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 08 16:01:50.757870 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.757856    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 08 16:01:50.757978 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.757895    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 08 16:01:50.758711 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.758697    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gjc5h\""
Jul 08 16:01:50.778699 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.778670    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"]
Jul 08 16:01:50.814304 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.814263    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:01:50.817480 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.817451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.817681 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.817661    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7xg7\" (UniqueName: \"kubernetes.io/projected/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-kube-api-access-z7xg7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.817767 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.817742    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.817850 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.817779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.817850 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.817811    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.817850 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.817845    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.919318 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.919277    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.919318 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.919324    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.919630 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.919350    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.919630 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.919431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7xg7\" (UniqueName: \"kubernetes.io/projected/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-kube-api-access-z7xg7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.919630 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.919488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.919630 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.919511    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.919849 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.919804    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.919849 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.919825    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.919941 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.919880    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.921811 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.921784    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.922002 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.921983    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:50.928460 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:50.928433    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7xg7\" (UniqueName: \"kubernetes.io/projected/3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9-kube-api-access-z7xg7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t\" (UID: \"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:51.064155 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:51.064114    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:01:51.200094 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:51.200066    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"]
Jul 08 16:01:51.202900 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:01:51.202873    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c0e80f6_4c3b_48eb_a2a1_3bc1bbbd59f9.slice/crio-54e9e2d90e70bcaf9fe58aa2f00a3ad4e2ec791a00b0cf62731e0bae215a82a8 WatchSource:0}: Error finding container 54e9e2d90e70bcaf9fe58aa2f00a3ad4e2ec791a00b0cf62731e0bae215a82a8: Status 404 returned error can't find the container with id 54e9e2d90e70bcaf9fe58aa2f00a3ad4e2ec791a00b0cf62731e0bae215a82a8
Jul 08 16:01:51.204330 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:51.204309    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:01:51.667415 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:51.667352    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t" event={"ID":"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9","Type":"ContainerStarted","Data":"54e9e2d90e70bcaf9fe58aa2f00a3ad4e2ec791a00b0cf62731e0bae215a82a8"}
Jul 08 16:01:52.296624 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:52.296561    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:01:52.674353 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:52.674317    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t" event={"ID":"3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9","Type":"ContainerStarted","Data":"a1483e12f69dccdc71c689f368194373d7f3636a93becc7317f48205078c63c9"}
Jul 08 16:01:53.494841 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:53.494804    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:01:59.989382 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:59.989321    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t" podStartSLOduration=8.963173583 podStartE2EDuration="9.989304716s" totalImagesPullingTime="1.026131133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:01:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:01:52.695053668 +0000 UTC m=+652.105718324" watchObservedRunningTime="2026-07-08 16:01:59.989304716 +0000 UTC m=+659.399969371"
Jul 08 16:01:59.990015 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:01:59.989606    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:02:01.065266 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:02:01.065230    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:02:01.065815 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:02:01.065314    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:02:01.077898 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:02:01.077874    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:02:01.717675 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:02:01.717635    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:02:01.730910 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:02:01.730882    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t"
Jul 08 16:02:09.402108 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:02:09.402067    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:02:15.388347 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:02:15.388298    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:02:36.384339 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:02:36.384307    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:02:36.444046 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:02:36.444012    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:03:28.512415 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:28.512329    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-55c4b955b5-gfpbb"]
Jul 08 16:03:28.514939 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:28.514912    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55c4b955b5-gfpbb"
Jul 08 16:03:28.515888 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:28.515862    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55c4b955b5-gfpbb"]
Jul 08 16:03:28.623080 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:28.623047    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v4r9\" (UniqueName: \"kubernetes.io/projected/c0487e3e-0c35-4ed2-a121-25e12b954e4c-kube-api-access-2v4r9\") pod \"authorino-55c4b955b5-gfpbb\" (UID: \"c0487e3e-0c35-4ed2-a121-25e12b954e4c\") " pod="kuadrant-system/authorino-55c4b955b5-gfpbb"
Jul 08 16:03:28.623262 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:28.623131    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c0487e3e-0c35-4ed2-a121-25e12b954e4c-tls-cert\") pod \"authorino-55c4b955b5-gfpbb\" (UID: \"c0487e3e-0c35-4ed2-a121-25e12b954e4c\") " pod="kuadrant-system/authorino-55c4b955b5-gfpbb"
Jul 08 16:03:28.724398 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:28.724358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v4r9\" (UniqueName: \"kubernetes.io/projected/c0487e3e-0c35-4ed2-a121-25e12b954e4c-kube-api-access-2v4r9\") pod \"authorino-55c4b955b5-gfpbb\" (UID: \"c0487e3e-0c35-4ed2-a121-25e12b954e4c\") " pod="kuadrant-system/authorino-55c4b955b5-gfpbb"
Jul 08 16:03:28.724570 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:28.724463    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c0487e3e-0c35-4ed2-a121-25e12b954e4c-tls-cert\") pod \"authorino-55c4b955b5-gfpbb\" (UID: \"c0487e3e-0c35-4ed2-a121-25e12b954e4c\") " pod="kuadrant-system/authorino-55c4b955b5-gfpbb"
Jul 08 16:03:28.726973 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:28.726945    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c0487e3e-0c35-4ed2-a121-25e12b954e4c-tls-cert\") pod \"authorino-55c4b955b5-gfpbb\" (UID: \"c0487e3e-0c35-4ed2-a121-25e12b954e4c\") " pod="kuadrant-system/authorino-55c4b955b5-gfpbb"
Jul 08 16:03:28.734603 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:28.734565    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v4r9\" (UniqueName: \"kubernetes.io/projected/c0487e3e-0c35-4ed2-a121-25e12b954e4c-kube-api-access-2v4r9\") pod \"authorino-55c4b955b5-gfpbb\" (UID: \"c0487e3e-0c35-4ed2-a121-25e12b954e4c\") " pod="kuadrant-system/authorino-55c4b955b5-gfpbb"
Jul 08 16:03:28.825286 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:28.825193    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55c4b955b5-gfpbb"
Jul 08 16:03:28.972712 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:28.972677    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55c4b955b5-gfpbb"]
Jul 08 16:03:28.976188 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:03:28.976150    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0487e3e_0c35_4ed2_a121_25e12b954e4c.slice/crio-95670e39e5d03642927c870e780800973ffa07f486b5ec23c88fa00b0cc7ae84 WatchSource:0}: Error finding container 95670e39e5d03642927c870e780800973ffa07f486b5ec23c88fa00b0cc7ae84: Status 404 returned error can't find the container with id 95670e39e5d03642927c870e780800973ffa07f486b5ec23c88fa00b0cc7ae84
Jul 08 16:03:29.030049 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:29.029972    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:03:29.116345 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:29.116258    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55c4b955b5-gfpbb" event={"ID":"c0487e3e-0c35-4ed2-a121-25e12b954e4c","Type":"ContainerStarted","Data":"95670e39e5d03642927c870e780800973ffa07f486b5ec23c88fa00b0cc7ae84"}
Jul 08 16:03:29.154896 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:29.154859    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:03:30.123965 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:30.123920    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55c4b955b5-gfpbb" event={"ID":"c0487e3e-0c35-4ed2-a121-25e12b954e4c","Type":"ContainerStarted","Data":"6fe15be3f11f746865a3cee550d903794f3d336bb14a8965769bdf464a56414d"}
Jul 08 16:03:30.152151 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:30.152089    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-55c4b955b5-gfpbb" podStartSLOduration=1.604017289 podStartE2EDuration="2.152067644s" totalImagesPullingTime="548.050355ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:03:30.150681936 +0000 UTC m=+749.561346591" watchObservedRunningTime="2026-07-08 16:03:30.152067644 +0000 UTC m=+749.562732298"
Jul 08 16:03:30.226493 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:30.219747    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:03:30.238292 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:30.235699    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5ddb6bcc9b-svps2"]
Jul 08 16:03:30.238292 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:30.235912    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5ddb6bcc9b-svps2" podUID="5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd" containerName="authorino" containerID="cri-o://6c5be8662f3a159d808e94060aeeaaaf92bb61c756d717a328156a4eed85bce2" gracePeriod=30
Jul 08 16:03:30.310218 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:30.310183    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:03:30.520009 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:30.519983    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5ddb6bcc9b-svps2"
Jul 08 16:03:30.644541 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:30.644504    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8t59\" (UniqueName: \"kubernetes.io/projected/5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd-kube-api-access-j8t59\") pod \"5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd\" (UID: \"5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd\") "
Jul 08 16:03:30.644751 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:30.644710    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd-tls-cert\") pod \"5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd\" (UID: \"5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd\") "
Jul 08 16:03:30.646679 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:30.646646    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd-kube-api-access-j8t59" (OuterVolumeSpecName: "kube-api-access-j8t59") pod "5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd" (UID: "5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd"). InnerVolumeSpecName "kube-api-access-j8t59". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:03:30.654971 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:30.654938    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd" (UID: "5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:03:30.746285 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:30.746236    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd-tls-cert\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:03:30.746285 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:30.746275    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8t59\" (UniqueName: \"kubernetes.io/projected/5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd-kube-api-access-j8t59\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:03:31.130381 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:31.130342    2562 generic.go:356] "Generic (PLEG): container finished" podID="5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd" containerID="6c5be8662f3a159d808e94060aeeaaaf92bb61c756d717a328156a4eed85bce2" exitCode=0
Jul 08 16:03:31.130904 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:31.130389    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5ddb6bcc9b-svps2"
Jul 08 16:03:31.130904 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:31.130388    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5ddb6bcc9b-svps2" event={"ID":"5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd","Type":"ContainerDied","Data":"6c5be8662f3a159d808e94060aeeaaaf92bb61c756d717a328156a4eed85bce2"}
Jul 08 16:03:31.130904 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:31.130501    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5ddb6bcc9b-svps2" event={"ID":"5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd","Type":"ContainerDied","Data":"94bd2b3a7e01eb55b9d85e66a055a34a625bffeaa78c7521df6f79940e0b01d8"}
Jul 08 16:03:31.130904 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:31.130523    2562 scope.go:117] "RemoveContainer" containerID="6c5be8662f3a159d808e94060aeeaaaf92bb61c756d717a328156a4eed85bce2"
Jul 08 16:03:31.140187 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:31.140170    2562 scope.go:117] "RemoveContainer" containerID="6c5be8662f3a159d808e94060aeeaaaf92bb61c756d717a328156a4eed85bce2"
Jul 08 16:03:31.140460 ip-10-0-131-108 kubenswrapper[2562]: E0708 16:03:31.140441    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c5be8662f3a159d808e94060aeeaaaf92bb61c756d717a328156a4eed85bce2\": container with ID starting with 6c5be8662f3a159d808e94060aeeaaaf92bb61c756d717a328156a4eed85bce2 not found: ID does not exist" containerID="6c5be8662f3a159d808e94060aeeaaaf92bb61c756d717a328156a4eed85bce2"
Jul 08 16:03:31.140512 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:31.140470    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c5be8662f3a159d808e94060aeeaaaf92bb61c756d717a328156a4eed85bce2"} err="failed to get container status \"6c5be8662f3a159d808e94060aeeaaaf92bb61c756d717a328156a4eed85bce2\": rpc error: code = NotFound desc = could not find container \"6c5be8662f3a159d808e94060aeeaaaf92bb61c756d717a328156a4eed85bce2\": container with ID starting with 6c5be8662f3a159d808e94060aeeaaaf92bb61c756d717a328156a4eed85bce2 not found: ID does not exist"
Jul 08 16:03:31.156486 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:31.156451    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5ddb6bcc9b-svps2"]
Jul 08 16:03:31.160374 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:31.160350    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5ddb6bcc9b-svps2"]
Jul 08 16:03:32.617336 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:32.617302    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd" path="/var/lib/kubelet/pods/5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd/volumes"
Jul 08 16:03:58.792979 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:03:58.792941    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:04:08.702709 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:04:08.702670    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:04:18.897477 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:04:18.897443    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:04:25.597495 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:04:25.597417    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:04:35.203763 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:04:35.203731    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:04:41.403124 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:04:41.403093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:04:42.799827 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:04:42.799789    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:04:44.099625 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:04:44.099573    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:05:05.794459 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:05:05.794417    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:05:19.194892 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:05:19.194857    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:05:24.150419 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:05:24.150382    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:05:24.250106 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:05:24.250073    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:05:24.360324 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:05:24.360289    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:05:30.598669 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:05:30.598632    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:05:30.701136 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:05:30.701103    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:05:30.800315 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:05:30.800270    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:05:31.184710 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:05:31.184677    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:05:36.940051 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:05:36.940020    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:05:37.009907 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:05:37.009878    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:05:38.514016 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:05:38.513977    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:05:53.484733 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:05:53.484653    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:06:03.492127 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:06:03.492088    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:06:11.794863 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:06:11.794826    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:06:20.799088 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:06:20.799056    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:06:31.818117 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:06:31.818075    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:06:40.904365 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:06:40.904330    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:06:52.389242 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:06:52.389200    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:07:02.093004 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:07:02.092963    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:07:27.701565 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:07:27.701471    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:07:39.192432 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:07:39.192396    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:07:45.814832 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:07:45.814771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:07:47.259415 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:07:47.259376    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:08:03.306258 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:08:03.306226    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:08:13.691183 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:08:13.691146    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:08:28.996705 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:08:28.996664    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:08:40.193071 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:08:40.193033    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:08:49.689290 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:08:49.689251    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:08:58.895110 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:08:58.895031    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:09:07.889113 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:09:07.889080    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:09:26.772829 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:09:26.772792    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:09:26.859153 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:09:26.859114    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:10:57.820093 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:10:57.820055    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:11:06.796552 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:11:06.796509    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:11:20.400109 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:11:20.400074    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:11:31.605564 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:11:31.605530    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:11:43.002950 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:11:43.002913    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:11:52.696521 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:11:52.696482    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:11:52.967346 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:11:52.967234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:12:02.094895 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:12:02.094859    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:12:09.882763 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:12:09.882725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:12:12.792519 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:12:12.792485    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:12:23.501986 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:12:23.501951    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:12:33.198537 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:12:33.198503    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:12:43.490992 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:12:43.490951    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:13:05.403244 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:13:05.403209    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:13:14.104624 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:13:14.104569    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:13:26.390136 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:13:26.390055    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:13:38.398590 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:13:38.398554    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:13:55.977524 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:13:55.977475    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:14:05.590426 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:14:05.590394    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:14:14.396997 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:14:14.396957    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:14:25.891503 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:14:25.891459    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:14:35.395922 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:14:35.395875    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:14:44.694742 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:14:44.694707    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:14:49.417464 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:14:49.417426    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:14:57.808941 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:14:57.808863    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:15:00.152214 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:00.152180    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq"]
Jul 08 16:15:00.152609 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:00.152547    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd" containerName="authorino"
Jul 08 16:15:00.152609 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:00.152558    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd" containerName="authorino"
Jul 08 16:15:00.152695 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:00.152632    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b8d2ab6-6428-4fa3-b2e7-db3e9dc7a5fd" containerName="authorino"
Jul 08 16:15:00.155800 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:00.155784    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq"
Jul 08 16:15:00.158736 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:00.158716    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4gvf8\""
Jul 08 16:15:00.158941 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:00.158742    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 16:15:00.159863 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:00.159843    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 16:15:00.176504 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:00.176479    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq"]
Jul 08 16:15:00.230758 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:00.230725    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtmtr\" (UniqueName: \"kubernetes.io/projected/067b392b-8b09-4de6-8c1f-0196b70b9ea9-kube-api-access-jtmtr\") pod \"maas-api-key-cleanup-29725455-8gllq\" (UID: \"067b392b-8b09-4de6-8c1f-0196b70b9ea9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq"
Jul 08 16:15:00.331174 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:00.331144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtmtr\" (UniqueName: \"kubernetes.io/projected/067b392b-8b09-4de6-8c1f-0196b70b9ea9-kube-api-access-jtmtr\") pod \"maas-api-key-cleanup-29725455-8gllq\" (UID: \"067b392b-8b09-4de6-8c1f-0196b70b9ea9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq"
Jul 08 16:15:00.340120 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:00.340094    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtmtr\" (UniqueName: \"kubernetes.io/projected/067b392b-8b09-4de6-8c1f-0196b70b9ea9-kube-api-access-jtmtr\") pod \"maas-api-key-cleanup-29725455-8gllq\" (UID: \"067b392b-8b09-4de6-8c1f-0196b70b9ea9\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq"
Jul 08 16:15:00.465883 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:00.465789    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq"
Jul 08 16:15:00.598526 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:00.598444    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq"]
Jul 08 16:15:00.602185 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:15:00.602155    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod067b392b_8b09_4de6_8c1f_0196b70b9ea9.slice/crio-2d725838f9c1bb33120ff4aae70bedc5d4fd8e3bf89d8803af5b91b8d82aa686 WatchSource:0}: Error finding container 2d725838f9c1bb33120ff4aae70bedc5d4fd8e3bf89d8803af5b91b8d82aa686: Status 404 returned error can't find the container with id 2d725838f9c1bb33120ff4aae70bedc5d4fd8e3bf89d8803af5b91b8d82aa686
Jul 08 16:15:00.604776 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:00.604758    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:15:01.307828 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:01.307794    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq" event={"ID":"067b392b-8b09-4de6-8c1f-0196b70b9ea9","Type":"ContainerStarted","Data":"2d725838f9c1bb33120ff4aae70bedc5d4fd8e3bf89d8803af5b91b8d82aa686"}
Jul 08 16:15:03.320561 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:03.320522    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq" event={"ID":"067b392b-8b09-4de6-8c1f-0196b70b9ea9","Type":"ContainerStarted","Data":"fe8d4878e983e08c44327fb1f4661a40497263380e1b1336f49a59ff692c5af6"}
Jul 08 16:15:03.339955 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:03.339902    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq" podStartSLOduration=0.998637818 podStartE2EDuration="3.339884329s" totalImagesPullingTime="2.341246511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:15:03.337309779 +0000 UTC m=+1442.747974434" watchObservedRunningTime="2026-07-08 16:15:03.339884329 +0000 UTC m=+1442.750548983"
Jul 08 16:15:07.193545 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:07.193506    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:15:16.705786 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:16.705745    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:15:28.597918 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:28.597880    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:15:37.700689 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:37.700651    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:15:44.295185 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:44.295145    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:15:59.997559 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:15:59.997523    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:16:00.009751 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:00.009724    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq"]
Jul 08 16:16:00.009937 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:00.009901    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq" podUID="067b392b-8b09-4de6-8c1f-0196b70b9ea9" containerName="cleanup" containerID="cri-o://fe8d4878e983e08c44327fb1f4661a40497263380e1b1336f49a59ff692c5af6" gracePeriod=30
Jul 08 16:16:02.959096 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:02.959065    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:11.401080 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:11.401046    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:16:22.094023 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:22.093985    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:16:24.145090 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:24.145058    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:30.202849 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:30.202813    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq"
Jul 08 16:16:30.361330 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:30.361227    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtmtr\" (UniqueName: \"kubernetes.io/projected/067b392b-8b09-4de6-8c1f-0196b70b9ea9-kube-api-access-jtmtr\") pod \"067b392b-8b09-4de6-8c1f-0196b70b9ea9\" (UID: \"067b392b-8b09-4de6-8c1f-0196b70b9ea9\") "
Jul 08 16:16:30.363480 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:30.363449    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/067b392b-8b09-4de6-8c1f-0196b70b9ea9-kube-api-access-jtmtr" (OuterVolumeSpecName: "kube-api-access-jtmtr") pod "067b392b-8b09-4de6-8c1f-0196b70b9ea9" (UID: "067b392b-8b09-4de6-8c1f-0196b70b9ea9"). InnerVolumeSpecName "kube-api-access-jtmtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:16:30.462216 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:30.462174    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtmtr\" (UniqueName: \"kubernetes.io/projected/067b392b-8b09-4de6-8c1f-0196b70b9ea9-kube-api-access-jtmtr\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:16:30.732306 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:30.732269    2562 generic.go:356] "Generic (PLEG): container finished" podID="067b392b-8b09-4de6-8c1f-0196b70b9ea9" containerID="fe8d4878e983e08c44327fb1f4661a40497263380e1b1336f49a59ff692c5af6" exitCode=137
Jul 08 16:16:30.732498 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:30.732313    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq"
Jul 08 16:16:30.732498 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:30.732353    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq" event={"ID":"067b392b-8b09-4de6-8c1f-0196b70b9ea9","Type":"ContainerDied","Data":"fe8d4878e983e08c44327fb1f4661a40497263380e1b1336f49a59ff692c5af6"}
Jul 08 16:16:30.732498 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:30.732403    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq" event={"ID":"067b392b-8b09-4de6-8c1f-0196b70b9ea9","Type":"ContainerDied","Data":"2d725838f9c1bb33120ff4aae70bedc5d4fd8e3bf89d8803af5b91b8d82aa686"}
Jul 08 16:16:30.732498 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:30.732425    2562 scope.go:117] "RemoveContainer" containerID="fe8d4878e983e08c44327fb1f4661a40497263380e1b1336f49a59ff692c5af6"
Jul 08 16:16:30.740767 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:30.740750    2562 scope.go:117] "RemoveContainer" containerID="fe8d4878e983e08c44327fb1f4661a40497263380e1b1336f49a59ff692c5af6"
Jul 08 16:16:30.741065 ip-10-0-131-108 kubenswrapper[2562]: E0708 16:16:30.741043    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe8d4878e983e08c44327fb1f4661a40497263380e1b1336f49a59ff692c5af6\": container with ID starting with fe8d4878e983e08c44327fb1f4661a40497263380e1b1336f49a59ff692c5af6 not found: ID does not exist" containerID="fe8d4878e983e08c44327fb1f4661a40497263380e1b1336f49a59ff692c5af6"
Jul 08 16:16:30.741126 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:30.741075    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe8d4878e983e08c44327fb1f4661a40497263380e1b1336f49a59ff692c5af6"} err="failed to get container status \"fe8d4878e983e08c44327fb1f4661a40497263380e1b1336f49a59ff692c5af6\": rpc error: code = NotFound desc = could not find container \"fe8d4878e983e08c44327fb1f4661a40497263380e1b1336f49a59ff692c5af6\": container with ID starting with fe8d4878e983e08c44327fb1f4661a40497263380e1b1336f49a59ff692c5af6 not found: ID does not exist"
Jul 08 16:16:30.749244 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:30.749211    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq"]
Jul 08 16:16:30.756228 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:30.756201    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725455-8gllq"]
Jul 08 16:16:31.974700 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:31.974665    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:32.617034 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:32.617003    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="067b392b-8b09-4de6-8c1f-0196b70b9ea9" path="/var/lib/kubelet/pods/067b392b-8b09-4de6-8c1f-0196b70b9ea9/volumes"
Jul 08 16:16:34.400271 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:34.400232    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:16:40.245152 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:40.245090    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:45.338215 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:45.338176    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:45.690721 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:45.690620    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:16:48.252667 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:48.252627    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:48.348793 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:48.348757    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:48.723069 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:48.723030    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:54.593541 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:54.593501    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:54.698759 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:54.698725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:54.810533 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:54.810503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:54.913776 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:54.913701    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:54.999566 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:54.999536    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:16:55.918948 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:55.918906    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:56.231149 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:56.231069    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:56.330949 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:56.330912    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:56.451711 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:56.451678    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:56.664298 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:56.664260    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:56.767999 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:56.767962    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:16:58.330535 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:16:58.330502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:01.197377 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:01.197342    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:01.294838 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:01.294807    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:01.396562 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:01.396526    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:01.640156 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:01.640121    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:02.766412 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:02.766385    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:07.310340 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:07.310309    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:07.378740 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:07.378707    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:07.554335 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:07.554302    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:07.651744 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:07.651662    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:08.741278 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:08.741216    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:08.952111 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:08.952079    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:09.049689 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:09.049654    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:09.428783 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:09.428702    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:09.675160 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:09.675130    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:10.731396 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:10.731365    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:11.797560 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:11.797526    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:17:13.756744 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:13.756709    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:14.476949 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:14.476914    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:19.869850 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:19.869816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:19.982105 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:19.982078    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:22.602863 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:22.602828    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:17:23.968239 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:23.968209    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:26.294054 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:26.294020    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:26.363189 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:26.363155    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:26.546158 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:26.546080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:26.648384 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:26.648346    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:27.766687 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:27.766648    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:27.860107 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:27.860070    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:28.036610 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:28.036508    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:28.391955 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:28.391867    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:28.813781 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:28.813743    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:29.145777 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:29.145687    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:29.985387 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:29.985352    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:32.077376 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:32.077345    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:32.205355 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:32.205322    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:17:32.438092 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:32.438009    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:32.536461 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:32.536430    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:33.892978 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:33.892945    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:39.015432 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:39.015398    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:39.085391 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:39.085359    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:39.714719 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:39.714687    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:39.811200 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:39.811170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:41.105263 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:41.105234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:42.693792 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:42.693760    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:17:47.238661 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:47.238627    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:47.377181 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:47.377153    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:47.613855 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:47.613816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:17:48.007446 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:17:48.007350    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:18:13.939923 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:18:13.939847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:18:19.940823 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:18:19.940761    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:18:20.052700 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:18:20.052664    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:18:20.148921 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:18:20.148893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:18:36.078415 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:18:36.078377    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:18:42.062973 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:18:42.062943    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:18:42.127129 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:18:42.127095    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:18:42.214868 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:18:42.214833    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:18:42.314860 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:18:42.314781    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:18:52.776376 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:18:52.776340    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:18:53.598274 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:18:53.598235    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:18:59.704461 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:18:59.704424    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:18:59.772249 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:18:59.772218    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:18:59.847350 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:18:59.847313    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:18:59.947594 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:18:59.947549    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:00.047619 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:00.047562    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:00.760022 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:00.759983    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:00.922698 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:00.922660    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:01.018321 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:01.018293    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:02.196428 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:02.196392    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:19:02.596754 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:02.596717    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:08.545304 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:08.545269    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:08.618173 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:08.618140    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:09.213268 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:09.213237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:09.499842 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:09.499763    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:19:15.425308 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:15.425276    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:15.525117 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:15.525086    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:15.663728 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:15.663690    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:15.961651 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:15.961622    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:16.635833 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:16.635800    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:18.395014 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:18.394981    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:19:18.762601 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:18.762538    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:18.856356 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:18.856327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:18.956872 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:18.956837    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:19.057647 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:19.057532    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:19.427774 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:19.427689    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:19.529452 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:19.529418    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:23.168094 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:23.168013    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:23.835722 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:23.835681    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:23.923221 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:23.923188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:24.275703 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:24.275671    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:28.396953 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:28.396915    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:19:30.299771 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:30.299729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:30.399923 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:30.399892    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:30.815162 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:30.815134    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:31.244484 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:31.244392    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:31.311589 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:31.311555    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:35.286640 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:35.286600    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:19:37.070147 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:37.070113    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:37.169964 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:37.169930    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:37.337267 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:37.337175    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:37.785159 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:37.785130    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:37.881557 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:37.881519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:38.076542 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:38.076454    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:43.938176 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:43.938141    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:44.003716 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:44.003687    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:44.096217 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:44.096183    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:44.196365 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:44.196282    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:44.296222 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:44.296191    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:50.384706 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:50.384672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:50.456017 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:50.455984    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:57.440070 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:57.440036    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:19:59.379407 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:19:59.379368    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:20:00.614713 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:00.614673    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:20:00.692503 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:00.692469    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:20:00.855750 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:00.855719    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:20:01.070953 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:01.070915    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:20:01.419354 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:01.419270    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:20:01.519379 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:01.519342    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:20:04.464903 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:04.464866    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:20:04.524397 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:04.524349    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:20:05.130022 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:05.129990    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:20:06.257097 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:06.257066    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:20:16.678942 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.678907    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"]
Jul 08 16:20:16.679514 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.679498    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="067b392b-8b09-4de6-8c1f-0196b70b9ea9" containerName="cleanup"
Jul 08 16:20:16.679563 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.679519    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="067b392b-8b09-4de6-8c1f-0196b70b9ea9" containerName="cleanup"
Jul 08 16:20:16.679679 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.679664    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="067b392b-8b09-4de6-8c1f-0196b70b9ea9" containerName="cleanup"
Jul 08 16:20:16.683177 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.683160    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.686154 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.686134    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-68603676\"/\"openshift-service-ca.crt\""
Jul 08 16:20:16.687194 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.687173    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-68603676\"/\"default-dockercfg-lh98d\""
Jul 08 16:20:16.687318 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.687200    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-68603676\"/\"kube-root-ca.crt\""
Jul 08 16:20:16.687318 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.687233    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-68603676\"/\"e2e-lifecycle-model-68603676-kserve-self-signed-certs\""
Jul 08 16:20:16.693234 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.693212    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"]
Jul 08 16:20:16.755480 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.755448    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:20:16.796247 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.796214    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-model-cache\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.796411 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.796257    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-tmp-dir\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.796411 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.796294    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-home\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.796411 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.796340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcfdc\" (UniqueName: \"kubernetes.io/projected/51dea967-0c32-4544-8b2a-19d27f14638b-kube-api-access-kcfdc\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.796411 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.796395    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51dea967-0c32-4544-8b2a-19d27f14638b-tls-certs\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.796604 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.796430    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-dshm\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.897377 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.897339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcfdc\" (UniqueName: \"kubernetes.io/projected/51dea967-0c32-4544-8b2a-19d27f14638b-kube-api-access-kcfdc\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.897549 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.897395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51dea967-0c32-4544-8b2a-19d27f14638b-tls-certs\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.897640 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.897571    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-dshm\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.897705 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.897649    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-model-cache\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.897705 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.897680    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-tmp-dir\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.897813 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.897710    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-home\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.898062 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.898038    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-model-cache\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.898062 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.898055    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-tmp-dir\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.898184 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.898110    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-home\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.899662 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.899643    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-dshm\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.899783 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.899766    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51dea967-0c32-4544-8b2a-19d27f14638b-tls-certs\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.905630 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.905606    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcfdc\" (UniqueName: \"kubernetes.io/projected/51dea967-0c32-4544-8b2a-19d27f14638b-kube-api-access-kcfdc\") pod \"e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") " pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:16.993199 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:16.993115    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:17.126683 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:17.126645    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"]
Jul 08 16:20:17.127077 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:20:17.127055    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51dea967_0c32_4544_8b2a_19d27f14638b.slice/crio-bd1a83d101a397726d989f803caa44e5977833bb22af9136fa9f769fc64cdaeb WatchSource:0}: Error finding container bd1a83d101a397726d989f803caa44e5977833bb22af9136fa9f769fc64cdaeb: Status 404 returned error can't find the container with id bd1a83d101a397726d989f803caa44e5977833bb22af9136fa9f769fc64cdaeb
Jul 08 16:20:17.762080 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:17.762042    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn" event={"ID":"51dea967-0c32-4544-8b2a-19d27f14638b","Type":"ContainerStarted","Data":"7a4ce731dedf87238415df67d73f26b9585bbcc75356f364fa6639b792485b38"}
Jul 08 16:20:17.762563 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:17.762091    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn" event={"ID":"51dea967-0c32-4544-8b2a-19d27f14638b","Type":"ContainerStarted","Data":"bd1a83d101a397726d989f803caa44e5977833bb22af9136fa9f769fc64cdaeb"}
Jul 08 16:20:17.782296 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:17.782250    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn" podStartSLOduration=1.782237343 podStartE2EDuration="1.782237343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:20:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:20:17.78115892 +0000 UTC m=+1757.191823574" watchObservedRunningTime="2026-07-08 16:20:17.782237343 +0000 UTC m=+1757.192901996"
Jul 08 16:20:19.798436 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:19.798404    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:20:22.153253 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:22.153219    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:20:22.255084 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:22.255050    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:20:26.994175 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:26.994140    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:26.994758 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:26.994198    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:27.006123 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:27.006100    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:27.819312 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:27.819284    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:20:45.295212 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:45.295168    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:20:47.832646 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:47.832616    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:20:48.222340 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:48.222252    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:20:53.911080 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:53.911007    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:20:58.889437 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:58.889345    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"]
Jul 08 16:20:58.905994 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:58.905966    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:20:58.984833 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:20:58.984791    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:13.910510 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:13.910461    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn" podUID="51dea967-0c32-4544-8b2a-19d27f14638b" containerName="main" containerID="cri-o://7a4ce731dedf87238415df67d73f26b9585bbcc75356f364fa6639b792485b38" gracePeriod=45
Jul 08 16:21:14.159135 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.159110    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:21:14.306459 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.306425    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-home\") pod \"51dea967-0c32-4544-8b2a-19d27f14638b\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") "
Jul 08 16:21:14.306683 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.306469    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-dshm\") pod \"51dea967-0c32-4544-8b2a-19d27f14638b\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") "
Jul 08 16:21:14.306683 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.306495    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-tmp-dir\") pod \"51dea967-0c32-4544-8b2a-19d27f14638b\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") "
Jul 08 16:21:14.306683 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.306531    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-model-cache\") pod \"51dea967-0c32-4544-8b2a-19d27f14638b\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") "
Jul 08 16:21:14.306683 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.306561    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51dea967-0c32-4544-8b2a-19d27f14638b-tls-certs\") pod \"51dea967-0c32-4544-8b2a-19d27f14638b\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") "
Jul 08 16:21:14.306683 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.306621    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcfdc\" (UniqueName: \"kubernetes.io/projected/51dea967-0c32-4544-8b2a-19d27f14638b-kube-api-access-kcfdc\") pod \"51dea967-0c32-4544-8b2a-19d27f14638b\" (UID: \"51dea967-0c32-4544-8b2a-19d27f14638b\") "
Jul 08 16:21:14.306927 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.306804    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-home" (OuterVolumeSpecName: "home") pod "51dea967-0c32-4544-8b2a-19d27f14638b" (UID: "51dea967-0c32-4544-8b2a-19d27f14638b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:21:14.306927 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.306822    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "51dea967-0c32-4544-8b2a-19d27f14638b" (UID: "51dea967-0c32-4544-8b2a-19d27f14638b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:21:14.306927 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.306852    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-model-cache" (OuterVolumeSpecName: "model-cache") pod "51dea967-0c32-4544-8b2a-19d27f14638b" (UID: "51dea967-0c32-4544-8b2a-19d27f14638b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:21:14.308721 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.308699    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-dshm" (OuterVolumeSpecName: "dshm") pod "51dea967-0c32-4544-8b2a-19d27f14638b" (UID: "51dea967-0c32-4544-8b2a-19d27f14638b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:21:14.308830 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.308800    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51dea967-0c32-4544-8b2a-19d27f14638b-kube-api-access-kcfdc" (OuterVolumeSpecName: "kube-api-access-kcfdc") pod "51dea967-0c32-4544-8b2a-19d27f14638b" (UID: "51dea967-0c32-4544-8b2a-19d27f14638b"). InnerVolumeSpecName "kube-api-access-kcfdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:21:14.308830 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.308806    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51dea967-0c32-4544-8b2a-19d27f14638b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "51dea967-0c32-4544-8b2a-19d27f14638b" (UID: "51dea967-0c32-4544-8b2a-19d27f14638b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:21:14.407980 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.407944    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51dea967-0c32-4544-8b2a-19d27f14638b-tls-certs\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:21:14.407980 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.407974    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcfdc\" (UniqueName: \"kubernetes.io/projected/51dea967-0c32-4544-8b2a-19d27f14638b-kube-api-access-kcfdc\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:21:14.407980 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.407987    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-home\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:21:14.408207 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.407999    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-dshm\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:21:14.408207 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.408010    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-tmp-dir\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:21:14.408207 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:14.408022    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51dea967-0c32-4544-8b2a-19d27f14638b-model-cache\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:21:15.031035 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:15.030994    2562 generic.go:356] "Generic (PLEG): container finished" podID="51dea967-0c32-4544-8b2a-19d27f14638b" containerID="7a4ce731dedf87238415df67d73f26b9585bbcc75356f364fa6639b792485b38" exitCode=0
Jul 08 16:21:15.031456 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:15.031047    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"
Jul 08 16:21:15.031456 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:15.031077    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn" event={"ID":"51dea967-0c32-4544-8b2a-19d27f14638b","Type":"ContainerDied","Data":"7a4ce731dedf87238415df67d73f26b9585bbcc75356f364fa6639b792485b38"}
Jul 08 16:21:15.031456 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:15.031120    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn" event={"ID":"51dea967-0c32-4544-8b2a-19d27f14638b","Type":"ContainerDied","Data":"bd1a83d101a397726d989f803caa44e5977833bb22af9136fa9f769fc64cdaeb"}
Jul 08 16:21:15.031456 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:15.031138    2562 scope.go:117] "RemoveContainer" containerID="7a4ce731dedf87238415df67d73f26b9585bbcc75356f364fa6639b792485b38"
Jul 08 16:21:15.039482 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:15.039467    2562 scope.go:117] "RemoveContainer" containerID="7a4ce731dedf87238415df67d73f26b9585bbcc75356f364fa6639b792485b38"
Jul 08 16:21:15.039753 ip-10-0-131-108 kubenswrapper[2562]: E0708 16:21:15.039733    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a4ce731dedf87238415df67d73f26b9585bbcc75356f364fa6639b792485b38\": container with ID starting with 7a4ce731dedf87238415df67d73f26b9585bbcc75356f364fa6639b792485b38 not found: ID does not exist" containerID="7a4ce731dedf87238415df67d73f26b9585bbcc75356f364fa6639b792485b38"
Jul 08 16:21:15.039827 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:15.039761    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a4ce731dedf87238415df67d73f26b9585bbcc75356f364fa6639b792485b38"} err="failed to get container status \"7a4ce731dedf87238415df67d73f26b9585bbcc75356f364fa6639b792485b38\": rpc error: code = NotFound desc = could not find container \"7a4ce731dedf87238415df67d73f26b9585bbcc75356f364fa6639b792485b38\": container with ID starting with 7a4ce731dedf87238415df67d73f26b9585bbcc75356f364fa6639b792485b38 not found: ID does not exist"
Jul 08 16:21:15.048963 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:15.048941    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"]
Jul 08 16:21:15.053476 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:15.053453    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-68603676/e2e-lifecycle-model-68603676-kserve-6f5888cbcf-s77fn"]
Jul 08 16:21:16.617117 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:16.617085    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51dea967-0c32-4544-8b2a-19d27f14638b" path="/var/lib/kubelet/pods/51dea967-0c32-4544-8b2a-19d27f14638b/volumes"
Jul 08 16:21:19.200939 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:19.200904    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:19.281411 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:19.281379    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:35.404086 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:35.404045    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:36.345133 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:36.345091    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:38.595259 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:38.595219    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:21:41.862447 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:41.862403    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:44.026366 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:44.026333    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:47.605599 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:47.605532    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:47.706378 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:47.706341    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:47.893788 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:47.893701    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:49.204995 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:49.204962    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:49.302300 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:49.302244    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:49.401981 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:49.401947    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:50.187772 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:50.187736    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:50.290925 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:50.290888    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:50.389126 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:50.389081    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:51.807923 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:51.807874    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:52.796630 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:52.796595    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:21:57.665057 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:57.665022    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:57.765877 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:57.765847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:21:58.342530 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:21:58.342489    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:04.379033 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:04.378995    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:04.461283 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:04.461238    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:04.581853 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:04.581818    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:04.684866 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:04.684778    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:05.793785 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:05.793755    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:22:15.136278 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:15.136242    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:15.478929 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:15.478839    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:36.464285 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:36.464248    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:42.942044 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:42.942003    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:43.012057 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:43.012019    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:43.304396 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:43.304359    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:43.627082 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:43.626996    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:43.721778 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:43.721739    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:46.511192 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:46.511150    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:46.579856 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:46.579820    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:46.759282 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:46.759240    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:47.304561 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:47.304528    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:47.405292 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:47.405263    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:47.538397 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:47.538362    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:51.065942 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:51.065906    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:51.389787 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:51.389702    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:51.703242 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:51.703149    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:51.877102 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:51.877073    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:55.079255 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:55.079216    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:55.124751 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:55.124709    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:22:55.206651 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:55.206624    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:55.309531 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:55.309496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:55.462049 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:55.461966    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:55.815839 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:55.815810    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:55.916701 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:55.916664    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:22:59.582131 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:22:59.582099    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:23:07.193066 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:07.193034    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:23:08.034122 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:08.034088    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:23:08.134933 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:08.134901    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:23:16.806788 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:16.806752    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:23:16.911053 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:16.911024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:23:17.595723 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.595689    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"]
Jul 08 16:23:17.596060 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.596046    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51dea967-0c32-4544-8b2a-19d27f14638b" containerName="main"
Jul 08 16:23:17.596129 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.596060    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="51dea967-0c32-4544-8b2a-19d27f14638b" containerName="main"
Jul 08 16:23:17.596129 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.596128    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="51dea967-0c32-4544-8b2a-19d27f14638b" containerName="main"
Jul 08 16:23:17.599327 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.599304    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.602514 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.602487    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2139f3\"/\"openshift-service-ca.crt\""
Jul 08 16:23:17.603907 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.603870    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2139f3\"/\"test-model-2139f3-kserve-self-signed-certs\""
Jul 08 16:23:17.603907 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.603889    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2139f3\"/\"default-dockercfg-xn9dq\""
Jul 08 16:23:17.604072 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.603921    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2139f3\"/\"kube-root-ca.crt\""
Jul 08 16:23:17.610188 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.610168    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"]
Jul 08 16:23:17.632553 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.632518    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:23:17.684424 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.684388    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-tmp-dir\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.684612 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.684451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-dshm\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.684612 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.684568    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-model-cache\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.684697 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.684631    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b866643a-950f-4742-87f4-e1caaa88c489-tls-certs\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.684697 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.684651    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftszw\" (UniqueName: \"kubernetes.io/projected/b866643a-950f-4742-87f4-e1caaa88c489-kube-api-access-ftszw\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.684813 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.684759    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-home\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.785599 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.785533    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-tmp-dir\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.785777 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.785653    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-dshm\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.785777 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.785694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-model-cache\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.785777 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.785728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b866643a-950f-4742-87f4-e1caaa88c489-tls-certs\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.785777 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.785752    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftszw\" (UniqueName: \"kubernetes.io/projected/b866643a-950f-4742-87f4-e1caaa88c489-kube-api-access-ftszw\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.786008 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.785824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-home\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.786071 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.786020    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-tmp-dir\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.786163 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.786063    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-model-cache\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.786163 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.786136    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-home\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.787896 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.787869    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-dshm\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.788195 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.788177    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b866643a-950f-4742-87f4-e1caaa88c489-tls-certs\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.794265 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.794241    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftszw\" (UniqueName: \"kubernetes.io/projected/b866643a-950f-4742-87f4-e1caaa88c489-kube-api-access-ftszw\") pod \"test-model-2139f3-kserve-7bb8859945-hdr9v\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") " pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:17.909216 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:17.909127    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:18.045488 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:18.045459    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"]
Jul 08 16:23:18.047447 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:23:18.047406    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb866643a_950f_4742_87f4_e1caaa88c489.slice/crio-99cb2676eb6337bf916cea9fd930425d8d7b8d2b622aa37e841f2b4383367389 WatchSource:0}: Error finding container 99cb2676eb6337bf916cea9fd930425d8d7b8d2b622aa37e841f2b4383367389: Status 404 returned error can't find the container with id 99cb2676eb6337bf916cea9fd930425d8d7b8d2b622aa37e841f2b4383367389
Jul 08 16:23:18.584163 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:18.584128    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v" event={"ID":"b866643a-950f-4742-87f4-e1caaa88c489","Type":"ContainerStarted","Data":"dbeed6d035a3351aab854bd277dbc705c0fc162647b534984ffae9d5bdba8c3e"}
Jul 08 16:23:18.584163 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:18.584171    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v" event={"ID":"b866643a-950f-4742-87f4-e1caaa88c489","Type":"ContainerStarted","Data":"99cb2676eb6337bf916cea9fd930425d8d7b8d2b622aa37e841f2b4383367389"}
Jul 08 16:23:18.606363 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:18.606304    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v" podStartSLOduration=1.6062877279999999 podStartE2EDuration="1.606287728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:23:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:23:18.604694929 +0000 UTC m=+1938.015359583" watchObservedRunningTime="2026-07-08 16:23:18.606287728 +0000 UTC m=+1938.016952382"
Jul 08 16:23:21.396140 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:21.396103    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:23:27.909544 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:27.909512    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:27.910063 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:27.909570    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:27.923281 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:27.923253    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:28.639221 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:28.639178    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:23:35.094685 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:35.094644    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:23:40.703722 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.703685    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"]
Jul 08 16:23:40.707119 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.707101    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.712926 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.712902    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-029815\"/\"openshift-service-ca.crt\""
Jul 08 16:23:40.713050 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.712906    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-029815\"/\"test-model-029815-kserve-self-signed-certs\""
Jul 08 16:23:40.714216 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.714200    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-029815\"/\"kube-root-ca.crt\""
Jul 08 16:23:40.714295 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.714283    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-029815\"/\"default-dockercfg-qt9rg\""
Jul 08 16:23:40.721495 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.721472    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"]
Jul 08 16:23:40.742328 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.742298    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:23:40.780063 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.780036    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-home\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.780063 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.780066    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-dshm\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.780243 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.780221    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qb2d\" (UniqueName: \"kubernetes.io/projected/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-kube-api-access-7qb2d\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.780281 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.780265    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-tls-certs\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.780349 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.780335    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-tmp-dir\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.780388 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.780375    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-model-cache\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.880839 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.880798    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qb2d\" (UniqueName: \"kubernetes.io/projected/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-kube-api-access-7qb2d\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.880839 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.880843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-tls-certs\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.881115 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.880878    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-tmp-dir\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.881115 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.880909    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-model-cache\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.881115 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.880933    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-home\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.881115 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.880947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-dshm\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.881397 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.881368    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-home\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.881537 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.881404    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-tmp-dir\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.881537 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.881440    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-model-cache\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.883301 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.883285    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-dshm\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.883380 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.883301    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-tls-certs\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:40.889294 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:40.889273    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qb2d\" (UniqueName: \"kubernetes.io/projected/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-kube-api-access-7qb2d\") pod \"test-model-029815-kserve-fbf545d7f-2mgzf\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") " pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:41.016737 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:41.016706    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:41.150680 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:41.150648    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"]
Jul 08 16:23:41.152518 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:23:41.152485    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4af4a3a_1c1a_40dd_9b74_94d5a2fcd389.slice/crio-ba8b8dedaaf348e329fd232daf5848401dd77f64b7233a9e7de2d4a1663471d1 WatchSource:0}: Error finding container ba8b8dedaaf348e329fd232daf5848401dd77f64b7233a9e7de2d4a1663471d1: Status 404 returned error can't find the container with id ba8b8dedaaf348e329fd232daf5848401dd77f64b7233a9e7de2d4a1663471d1
Jul 08 16:23:41.690371 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:41.690334    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf" event={"ID":"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389","Type":"ContainerStarted","Data":"41745d4e55d7d0040d4ffe9f5fc8218dc8a4b8e6d1ee8d08b92abff5b429b04d"}
Jul 08 16:23:41.690371 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:41.690378    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf" event={"ID":"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389","Type":"ContainerStarted","Data":"ba8b8dedaaf348e329fd232daf5848401dd77f64b7233a9e7de2d4a1663471d1"}
Jul 08 16:23:41.710631 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:41.710570    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf" podStartSLOduration=1.710553856 podStartE2EDuration="1.710553856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:23:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:23:41.709802349 +0000 UTC m=+1961.120467002" watchObservedRunningTime="2026-07-08 16:23:41.710553856 +0000 UTC m=+1961.121218510"
Jul 08 16:23:47.405167 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:47.405126    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:23:51.017674 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:51.017637    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:51.018087 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:51.017758    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:51.029953 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:51.029925    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:23:51.749751 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:23:51.749721    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:24:03.896845 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:03.896765    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"]
Jul 08 16:24:03.916826 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:03.916789    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:04.813223 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:04.813191    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"]
Jul 08 16:24:04.833200 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:04.833169    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:05.005678 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:05.005639    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:05.510546 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:05.510507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:05.616689 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:05.616656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:05.809190 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:05.809158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:10.499771 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:10.499731    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:11.397198 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:11.397165    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:24:18.916768 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:18.916702    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v" podUID="b866643a-950f-4742-87f4-e1caaa88c489" containerName="main" containerID="cri-o://dbeed6d035a3351aab854bd277dbc705c0fc162647b534984ffae9d5bdba8c3e" gracePeriod=45
Jul 08 16:24:19.177897 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.177821    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:24:19.231710 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.231669    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-model-cache\") pod \"b866643a-950f-4742-87f4-e1caaa88c489\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") "
Jul 08 16:24:19.231710 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.231719    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b866643a-950f-4742-87f4-e1caaa88c489-tls-certs\") pod \"b866643a-950f-4742-87f4-e1caaa88c489\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") "
Jul 08 16:24:19.231979 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.231765    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftszw\" (UniqueName: \"kubernetes.io/projected/b866643a-950f-4742-87f4-e1caaa88c489-kube-api-access-ftszw\") pod \"b866643a-950f-4742-87f4-e1caaa88c489\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") "
Jul 08 16:24:19.231979 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.231783    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-home\") pod \"b866643a-950f-4742-87f4-e1caaa88c489\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") "
Jul 08 16:24:19.231979 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.231838    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-tmp-dir\") pod \"b866643a-950f-4742-87f4-e1caaa88c489\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") "
Jul 08 16:24:19.231979 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.231883    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-dshm\") pod \"b866643a-950f-4742-87f4-e1caaa88c489\" (UID: \"b866643a-950f-4742-87f4-e1caaa88c489\") "
Jul 08 16:24:19.232204 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.232017    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-model-cache" (OuterVolumeSpecName: "model-cache") pod "b866643a-950f-4742-87f4-e1caaa88c489" (UID: "b866643a-950f-4742-87f4-e1caaa88c489"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:24:19.232204 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.232135    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-model-cache\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:24:19.232359 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.232333    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-home" (OuterVolumeSpecName: "home") pod "b866643a-950f-4742-87f4-e1caaa88c489" (UID: "b866643a-950f-4742-87f4-e1caaa88c489"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:24:19.232436 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.232345    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b866643a-950f-4742-87f4-e1caaa88c489" (UID: "b866643a-950f-4742-87f4-e1caaa88c489"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:24:19.234649 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.234616    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b866643a-950f-4742-87f4-e1caaa88c489-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b866643a-950f-4742-87f4-e1caaa88c489" (UID: "b866643a-950f-4742-87f4-e1caaa88c489"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:24:19.234649 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.234624    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b866643a-950f-4742-87f4-e1caaa88c489-kube-api-access-ftszw" (OuterVolumeSpecName: "kube-api-access-ftszw") pod "b866643a-950f-4742-87f4-e1caaa88c489" (UID: "b866643a-950f-4742-87f4-e1caaa88c489"). InnerVolumeSpecName "kube-api-access-ftszw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:24:19.234797 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.234702    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-dshm" (OuterVolumeSpecName: "dshm") pod "b866643a-950f-4742-87f4-e1caaa88c489" (UID: "b866643a-950f-4742-87f4-e1caaa88c489"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:24:19.333503 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.333464    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b866643a-950f-4742-87f4-e1caaa88c489-tls-certs\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:24:19.333503 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.333496    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftszw\" (UniqueName: \"kubernetes.io/projected/b866643a-950f-4742-87f4-e1caaa88c489-kube-api-access-ftszw\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:24:19.333503 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.333508    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-home\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:24:19.333774 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.333516    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-tmp-dir\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:24:19.333774 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.333525    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b866643a-950f-4742-87f4-e1caaa88c489-dshm\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:24:19.833122 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.833048    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf" podUID="b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389" containerName="main" containerID="cri-o://41745d4e55d7d0040d4ffe9f5fc8218dc8a4b8e6d1ee8d08b92abff5b429b04d" gracePeriod=45
Jul 08 16:24:19.871941 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.871910    2562 generic.go:356] "Generic (PLEG): container finished" podID="b866643a-950f-4742-87f4-e1caaa88c489" containerID="dbeed6d035a3351aab854bd277dbc705c0fc162647b534984ffae9d5bdba8c3e" exitCode=0
Jul 08 16:24:19.872112 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.871955    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"
Jul 08 16:24:19.872112 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.871991    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v" event={"ID":"b866643a-950f-4742-87f4-e1caaa88c489","Type":"ContainerDied","Data":"dbeed6d035a3351aab854bd277dbc705c0fc162647b534984ffae9d5bdba8c3e"}
Jul 08 16:24:19.872112 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.872036    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v" event={"ID":"b866643a-950f-4742-87f4-e1caaa88c489","Type":"ContainerDied","Data":"99cb2676eb6337bf916cea9fd930425d8d7b8d2b622aa37e841f2b4383367389"}
Jul 08 16:24:19.872112 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.872057    2562 scope.go:117] "RemoveContainer" containerID="dbeed6d035a3351aab854bd277dbc705c0fc162647b534984ffae9d5bdba8c3e"
Jul 08 16:24:19.903798 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.903763    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"]
Jul 08 16:24:19.907435 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.907411    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2139f3/test-model-2139f3-kserve-7bb8859945-hdr9v"]
Jul 08 16:24:19.943797 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.943665    2562 scope.go:117] "RemoveContainer" containerID="dbeed6d035a3351aab854bd277dbc705c0fc162647b534984ffae9d5bdba8c3e"
Jul 08 16:24:19.944078 ip-10-0-131-108 kubenswrapper[2562]: E0708 16:24:19.944047    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbeed6d035a3351aab854bd277dbc705c0fc162647b534984ffae9d5bdba8c3e\": container with ID starting with dbeed6d035a3351aab854bd277dbc705c0fc162647b534984ffae9d5bdba8c3e not found: ID does not exist" containerID="dbeed6d035a3351aab854bd277dbc705c0fc162647b534984ffae9d5bdba8c3e"
Jul 08 16:24:19.944135 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:19.944074    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbeed6d035a3351aab854bd277dbc705c0fc162647b534984ffae9d5bdba8c3e"} err="failed to get container status \"dbeed6d035a3351aab854bd277dbc705c0fc162647b534984ffae9d5bdba8c3e\": rpc error: code = NotFound desc = could not find container \"dbeed6d035a3351aab854bd277dbc705c0fc162647b534984ffae9d5bdba8c3e\": container with ID starting with dbeed6d035a3351aab854bd277dbc705c0fc162647b534984ffae9d5bdba8c3e not found: ID does not exist"
Jul 08 16:24:20.085461 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.085402    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:24:20.141432 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.141394    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-home\") pod \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") "
Jul 08 16:24:20.141651 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.141473    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-tls-certs\") pod \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") "
Jul 08 16:24:20.141651 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.141495    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-tmp-dir\") pod \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") "
Jul 08 16:24:20.141651 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.141519    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-model-cache\") pod \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") "
Jul 08 16:24:20.141651 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.141555    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qb2d\" (UniqueName: \"kubernetes.io/projected/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-kube-api-access-7qb2d\") pod \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") "
Jul 08 16:24:20.141651 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.141629    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-dshm\") pod \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\" (UID: \"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389\") "
Jul 08 16:24:20.141933 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.141656    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-home" (OuterVolumeSpecName: "home") pod "b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389" (UID: "b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:24:20.141933 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.141816    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389" (UID: "b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:24:20.141933 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.141827    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-model-cache" (OuterVolumeSpecName: "model-cache") pod "b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389" (UID: "b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:24:20.142060 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.141969    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-home\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:24:20.142060 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.141988    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-tmp-dir\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:24:20.142060 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.142004    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-model-cache\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:24:20.144066 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.144037    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-dshm" (OuterVolumeSpecName: "dshm") pod "b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389" (UID: "b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:24:20.144195 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.144175    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389" (UID: "b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:24:20.144240 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.144179    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-kube-api-access-7qb2d" (OuterVolumeSpecName: "kube-api-access-7qb2d") pod "b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389" (UID: "b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389"). InnerVolumeSpecName "kube-api-access-7qb2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:24:20.242919 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.242880    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-tls-certs\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:24:20.242919 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.242910    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qb2d\" (UniqueName: \"kubernetes.io/projected/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-kube-api-access-7qb2d\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:24:20.242919 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.242924    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389-dshm\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:24:20.617053 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.617014    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b866643a-950f-4742-87f4-e1caaa88c489" path="/var/lib/kubelet/pods/b866643a-950f-4742-87f4-e1caaa88c489/volumes"
Jul 08 16:24:20.878798 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.878716    2562 generic.go:356] "Generic (PLEG): container finished" podID="b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389" containerID="41745d4e55d7d0040d4ffe9f5fc8218dc8a4b8e6d1ee8d08b92abff5b429b04d" exitCode=0
Jul 08 16:24:20.878798 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.878760    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"
Jul 08 16:24:20.878798 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.878773    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf" event={"ID":"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389","Type":"ContainerDied","Data":"41745d4e55d7d0040d4ffe9f5fc8218dc8a4b8e6d1ee8d08b92abff5b429b04d"}
Jul 08 16:24:20.879058 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.878804    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf" event={"ID":"b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389","Type":"ContainerDied","Data":"ba8b8dedaaf348e329fd232daf5848401dd77f64b7233a9e7de2d4a1663471d1"}
Jul 08 16:24:20.879058 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.878821    2562 scope.go:117] "RemoveContainer" containerID="41745d4e55d7d0040d4ffe9f5fc8218dc8a4b8e6d1ee8d08b92abff5b429b04d"
Jul 08 16:24:20.886874 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.886857    2562 scope.go:117] "RemoveContainer" containerID="41745d4e55d7d0040d4ffe9f5fc8218dc8a4b8e6d1ee8d08b92abff5b429b04d"
Jul 08 16:24:20.887183 ip-10-0-131-108 kubenswrapper[2562]: E0708 16:24:20.887156    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41745d4e55d7d0040d4ffe9f5fc8218dc8a4b8e6d1ee8d08b92abff5b429b04d\": container with ID starting with 41745d4e55d7d0040d4ffe9f5fc8218dc8a4b8e6d1ee8d08b92abff5b429b04d not found: ID does not exist" containerID="41745d4e55d7d0040d4ffe9f5fc8218dc8a4b8e6d1ee8d08b92abff5b429b04d"
Jul 08 16:24:20.887297 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.887192    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41745d4e55d7d0040d4ffe9f5fc8218dc8a4b8e6d1ee8d08b92abff5b429b04d"} err="failed to get container status \"41745d4e55d7d0040d4ffe9f5fc8218dc8a4b8e6d1ee8d08b92abff5b429b04d\": rpc error: code = NotFound desc = could not find container \"41745d4e55d7d0040d4ffe9f5fc8218dc8a4b8e6d1ee8d08b92abff5b429b04d\": container with ID starting with 41745d4e55d7d0040d4ffe9f5fc8218dc8a4b8e6d1ee8d08b92abff5b429b04d not found: ID does not exist"
Jul 08 16:24:20.897018 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.896990    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"]
Jul 08 16:24:20.901304 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:20.901283    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-029815/test-model-029815-kserve-fbf545d7f-2mgzf"]
Jul 08 16:24:22.616795 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:22.616756    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389" path="/var/lib/kubelet/pods/b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389/volumes"
Jul 08 16:24:47.852069 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:47.852024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:48.171255 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:48.171165    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:48.648368 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:48.648334    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:49.145451 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:49.145420    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:49.246518 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:49.246486    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:49.346976 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:49.346939    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:49.494995 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:49.494907    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:52.589446 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:52.589403    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:24:55.199945 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:55.199913    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:55.304526 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:55.304490    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:55.400037 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:55.400007    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:56.006917 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:56.006872    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:56.373405 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:56.373370    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:56.866749 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:56.866711    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:59.253562 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:59.253520    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:24:59.353430 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:24:59.353395    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:01.123677 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:01.123640    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:04.205324 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:04.205287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:04.947881 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:04.947847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:05.058135 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:05.058097    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:05.515465 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:05.515425    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:05.865520 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:05.865438    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:07.716533 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:07.716497    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:25:08.885361 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:08.885324    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:08.979487 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:08.979454    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:09.217621 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:09.217503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:09.462120 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:09.462083    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:09.954765 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:09.954732    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:10.082328 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:10.082298    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:13.386694 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:13.386660    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:13.952399 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:13.952364    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:21.705990 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:21.705954    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:21.822269 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:21.822235    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:21.942557 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:21.942522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:22.067449 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:22.067416    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:22.393607 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:22.393499    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:25.199466 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:25.199385    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:25:28.771988 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:28.771944    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:28.871951 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:28.871914    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:29.062108 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:29.062021    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:29.473562 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:29.473466    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:29.877033 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:29.877000    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:30.038325 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:30.038287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:30.137603 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:30.137492    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:30.245901 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:30.245866    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:36.115883 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:36.115843    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:36.216126 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:36.216093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:36.438994 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:36.438903    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:37.092526 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:37.092494    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:37.448766 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:37.448680    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:37.669187 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:37.669152    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:39.810489 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:39.810445    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:25:40.474940 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:40.474899    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:40.571696 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:40.571663    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:40.718323 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:40.718287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:40.816093 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:40.816063    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:41.348066 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:41.348036    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:41.448194 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:41.448158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:41.548988 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:41.548955    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:41.648281 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:41.648200    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:44.988850 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:44.988816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:45.329563 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:45.329519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:45.645353 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:45.645274    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:45.931557 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:45.931469    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:49.168959 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:49.168919    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:49.266715 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:49.266683    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:49.446319 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:49.446224    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:49.575769 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:49.575737    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:49.945957 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:49.945929    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:50.060796 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:50.060770    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:25:50.996885 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:50.996853    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:25:53.621996 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:25:53.621960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:26:01.312206 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:01.312168    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:26:02.137789 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:02.137749    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:26:02.238813 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:02.238781    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:26:10.784867 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:10.784835    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:26:10.885434 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:10.885402    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:26:14.105552 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.105509    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"]
Jul 08 16:26:14.105949 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.105900    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389" containerName="main"
Jul 08 16:26:14.105949 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.105912    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389" containerName="main"
Jul 08 16:26:14.105949 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.105922    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b866643a-950f-4742-87f4-e1caaa88c489" containerName="main"
Jul 08 16:26:14.105949 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.105927    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b866643a-950f-4742-87f4-e1caaa88c489" containerName="main"
Jul 08 16:26:14.106083 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.105982    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b866643a-950f-4742-87f4-e1caaa88c489" containerName="main"
Jul 08 16:26:14.106083 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.105994    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4af4a3a-1c1a-40dd-9b74-94d5a2fcd389" containerName="main"
Jul 08 16:26:14.108931 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.108911    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.111762 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.111741    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d4af16\"/\"openshift-service-ca.crt\""
Jul 08 16:26:14.111994 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.111972    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d4af16\"/\"auth-test-model-d4af16-kserve-self-signed-certs\""
Jul 08 16:26:14.112914 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.112897    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-d4af16\"/\"kube-root-ca.crt\""
Jul 08 16:26:14.113231 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.113216    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d4af16\"/\"default-dockercfg-s7gjt\""
Jul 08 16:26:14.127932 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.127910    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"]
Jul 08 16:26:14.142836 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.142809    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:26:14.253106 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.253063    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-home\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.253106 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.253108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-tmp-dir\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.253343 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.253133    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-tls-certs\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.253343 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.253223    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-model-cache\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.253343 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.253262    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gqh7\" (UniqueName: \"kubernetes.io/projected/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-kube-api-access-2gqh7\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.253343 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.253308    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-dshm\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.354181 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.354146    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gqh7\" (UniqueName: \"kubernetes.io/projected/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-kube-api-access-2gqh7\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.354181 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.354187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-dshm\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.354432 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.354229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-home\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.354432 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.354246    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-tmp-dir\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.354432 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.354266    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-tls-certs\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.354432 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.354303    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-model-cache\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.354712 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.354677    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-tmp-dir\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.354770 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.354723    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-home\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.354812 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.354767    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-model-cache\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.356661 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.356608    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-dshm\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.356877 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.356860    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-tls-certs\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.363783 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.363759    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gqh7\" (UniqueName: \"kubernetes.io/projected/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-kube-api-access-2gqh7\") pod \"auth-test-model-d4af16-kserve-66875ffbf9-z4swq\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") " pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.420417 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.420377    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:14.553168 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:14.553143    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"]
Jul 08 16:26:14.555195 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:26:14.555167    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod077345c9_3f1e_4a65_8e27_af8fdac0b0b5.slice/crio-87b1383577c7832f834d8783906d46b5d00164f3c7b7d1a404c710dc689dce4e WatchSource:0}: Error finding container 87b1383577c7832f834d8783906d46b5d00164f3c7b7d1a404c710dc689dce4e: Status 404 returned error can't find the container with id 87b1383577c7832f834d8783906d46b5d00164f3c7b7d1a404c710dc689dce4e
Jul 08 16:26:15.402128 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:15.402089    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq" event={"ID":"077345c9-3f1e-4a65-8e27-af8fdac0b0b5","Type":"ContainerStarted","Data":"4a2b550372b50d47682d5f1d7242751a921fee146c59bf6824a5e13466466605"}
Jul 08 16:26:15.402128 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:15.402130    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq" event={"ID":"077345c9-3f1e-4a65-8e27-af8fdac0b0b5","Type":"ContainerStarted","Data":"87b1383577c7832f834d8783906d46b5d00164f3c7b7d1a404c710dc689dce4e"}
Jul 08 16:26:15.421825 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:15.421772    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq" podStartSLOduration=1.421757268 podStartE2EDuration="1.421757268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:26:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:26:15.42063601 +0000 UTC m=+2114.831300666" watchObservedRunningTime="2026-07-08 16:26:15.421757268 +0000 UTC m=+2114.832421922"
Jul 08 16:26:17.802611 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:17.802564    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:26:24.421103 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:24.421063    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:24.421103 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:24.421116    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:24.433723 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:24.433695    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:24.452039 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:24.452008    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:26:36.073414 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.073383    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"]
Jul 08 16:26:36.076639 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.076623    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.079462 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.079438    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f77711\"/\"kube-root-ca.crt\""
Jul 08 16:26:36.079630 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.079441    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f77711\"/\"openshift-service-ca.crt\""
Jul 08 16:26:36.080739 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.080717    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f77711\"/\"default-dockercfg-sj2gh\""
Jul 08 16:26:36.080866 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.080774    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f77711\"/\"auth-test-model-f77711-kserve-self-signed-certs\""
Jul 08 16:26:36.087729 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.087709    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"]
Jul 08 16:26:36.114778 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.114743    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:26:36.145979 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.145941    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpf8h\" (UniqueName: \"kubernetes.io/projected/fb3bc2c6-44ff-444c-82dd-3d11801901ad-kube-api-access-gpf8h\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.146121 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.145986    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-home\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.146121 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.146003    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-tmp-dir\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.146121 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.146059    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-model-cache\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.146230 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.146125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-dshm\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.146230 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.146196    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb3bc2c6-44ff-444c-82dd-3d11801901ad-tls-certs\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.247491 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.247458    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-dshm\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.247491 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.247507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb3bc2c6-44ff-444c-82dd-3d11801901ad-tls-certs\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.247784 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.247539    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpf8h\" (UniqueName: \"kubernetes.io/projected/fb3bc2c6-44ff-444c-82dd-3d11801901ad-kube-api-access-gpf8h\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.247784 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.247563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-home\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.247784 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.247600    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-tmp-dir\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.247784 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.247644    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-model-cache\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.248026 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.248003    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-home\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.248089 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.248047    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-tmp-dir\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.248089 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.248066    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-model-cache\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.249848 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.249820    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-dshm\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.249971 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.249925    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb3bc2c6-44ff-444c-82dd-3d11801901ad-tls-certs\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.260597 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.260558    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpf8h\" (UniqueName: \"kubernetes.io/projected/fb3bc2c6-44ff-444c-82dd-3d11801901ad-kube-api-access-gpf8h\") pod \"auth-test-model-f77711-kserve-5f95d45859-k5mdp\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") " pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.387409 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.387314    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:36.534374 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:26:36.534339    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb3bc2c6_44ff_444c_82dd_3d11801901ad.slice/crio-f2fb680a985011a5dfe73a2e27eda7170dde7dfe55707993e75f8560316c4956 WatchSource:0}: Error finding container f2fb680a985011a5dfe73a2e27eda7170dde7dfe55707993e75f8560316c4956: Status 404 returned error can't find the container with id f2fb680a985011a5dfe73a2e27eda7170dde7dfe55707993e75f8560316c4956
Jul 08 16:26:36.539647 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:36.539623    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"]
Jul 08 16:26:37.509404 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:37.509368    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp" event={"ID":"fb3bc2c6-44ff-444c-82dd-3d11801901ad","Type":"ContainerStarted","Data":"a1d01992c30e1a4e02add0a156808d9475fc4976600db8215a7575c6351df6e9"}
Jul 08 16:26:37.509404 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:37.509411    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp" event={"ID":"fb3bc2c6-44ff-444c-82dd-3d11801901ad","Type":"ContainerStarted","Data":"f2fb680a985011a5dfe73a2e27eda7170dde7dfe55707993e75f8560316c4956"}
Jul 08 16:26:37.527903 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:37.527856    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp" podStartSLOduration=1.5278405369999999 podStartE2EDuration="1.527840537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:26:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:26:37.526798667 +0000 UTC m=+2136.937463358" watchObservedRunningTime="2026-07-08 16:26:37.527840537 +0000 UTC m=+2136.938505192"
Jul 08 16:26:40.095661 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:40.095627    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:26:45.798376 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:45.798339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:26:46.387656 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:46.387618    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:46.387847 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:46.387681    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:46.400021 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:46.399995    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:26:46.563342 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:26:46.563314    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:27:00.990359 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:27:00.990264    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:27:19.716411 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:27:19.716372    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:27:37.604011 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:27:37.603967    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:27:37.671437 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:27:37.671407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:27:37.772690 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:27:37.772656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:27:54.394515 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:27:54.394479    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:28:11.000365 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:11.000323    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:28:12.189260 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:12.189221    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:28:30.635641 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:30.635604    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:28:41.391170 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:41.391137    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"]
Jul 08 16:28:41.417955 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:41.417929    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:28:42.320182 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:42.320145    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"]
Jul 08 16:28:42.356060 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:42.356026    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:28:45.503442 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:45.503403    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:28:52.679015 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:52.678979    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:28:56.411023 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.410987    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq" podUID="077345c9-3f1e-4a65-8e27-af8fdac0b0b5" containerName="main" containerID="cri-o://4a2b550372b50d47682d5f1d7242751a921fee146c59bf6824a5e13466466605" gracePeriod=45
Jul 08 16:28:56.670368 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.670308    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:28:56.760286 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.760249    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-tls-certs\") pod \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") "
Jul 08 16:28:56.760286 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.760290    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gqh7\" (UniqueName: \"kubernetes.io/projected/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-kube-api-access-2gqh7\") pod \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") "
Jul 08 16:28:56.760491 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.760338    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-tmp-dir\") pod \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") "
Jul 08 16:28:56.760491 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.760382    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-home\") pod \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") "
Jul 08 16:28:56.760599 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.760557    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-model-cache\") pod \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") "
Jul 08 16:28:56.760668 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.760622    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "077345c9-3f1e-4a65-8e27-af8fdac0b0b5" (UID: "077345c9-3f1e-4a65-8e27-af8fdac0b0b5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:28:56.760727 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.760660    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-home" (OuterVolumeSpecName: "home") pod "077345c9-3f1e-4a65-8e27-af8fdac0b0b5" (UID: "077345c9-3f1e-4a65-8e27-af8fdac0b0b5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:28:56.760727 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.760681    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-dshm\") pod \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\" (UID: \"077345c9-3f1e-4a65-8e27-af8fdac0b0b5\") "
Jul 08 16:28:56.760848 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.760820    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-model-cache" (OuterVolumeSpecName: "model-cache") pod "077345c9-3f1e-4a65-8e27-af8fdac0b0b5" (UID: "077345c9-3f1e-4a65-8e27-af8fdac0b0b5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:28:56.760997 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.760981    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-tmp-dir\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:28:56.761053 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.761002    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-home\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:28:56.761053 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.761016    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-model-cache\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:28:56.762682 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.762661    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-dshm" (OuterVolumeSpecName: "dshm") pod "077345c9-3f1e-4a65-8e27-af8fdac0b0b5" (UID: "077345c9-3f1e-4a65-8e27-af8fdac0b0b5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:28:56.762758 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.762664    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "077345c9-3f1e-4a65-8e27-af8fdac0b0b5" (UID: "077345c9-3f1e-4a65-8e27-af8fdac0b0b5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:28:56.762758 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.762720    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-kube-api-access-2gqh7" (OuterVolumeSpecName: "kube-api-access-2gqh7") pod "077345c9-3f1e-4a65-8e27-af8fdac0b0b5" (UID: "077345c9-3f1e-4a65-8e27-af8fdac0b0b5"). InnerVolumeSpecName "kube-api-access-2gqh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:28:56.862377 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.862345    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-dshm\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:28:56.862377 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.862370    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-tls-certs\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:28:56.862377 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.862382    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gqh7\" (UniqueName: \"kubernetes.io/projected/077345c9-3f1e-4a65-8e27-af8fdac0b0b5-kube-api-access-2gqh7\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:28:56.896499 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.896466    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"]
Jul 08 16:28:56.896875 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.896861    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="077345c9-3f1e-4a65-8e27-af8fdac0b0b5" containerName="main"
Jul 08 16:28:56.896922 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.896877    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="077345c9-3f1e-4a65-8e27-af8fdac0b0b5" containerName="main"
Jul 08 16:28:56.896961 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.896934    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="077345c9-3f1e-4a65-8e27-af8fdac0b0b5" containerName="main"
Jul 08 16:28:56.900212 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.900197    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:56.902940 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.902919    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d4af16\"/\"sub-test-model-d4af16-kserve-self-signed-certs\""
Jul 08 16:28:56.912192 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.912172    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"]
Jul 08 16:28:56.925376 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.925321    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:28:56.963114 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.963087    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shhdg\" (UniqueName: \"kubernetes.io/projected/389643f2-6cc3-47bd-b31e-9a4a53c1363d-kube-api-access-shhdg\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:56.963214 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.963136    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-tmp-dir\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:56.963214 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.963165    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/389643f2-6cc3-47bd-b31e-9a4a53c1363d-tls-certs\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:56.963214 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.963191    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-model-cache\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:56.963361 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.963223    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-home\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:56.963361 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:56.963311    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-dshm\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:57.064117 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.064081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-tmp-dir\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:57.064117 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.064118    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/389643f2-6cc3-47bd-b31e-9a4a53c1363d-tls-certs\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:57.064350 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.064140    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-model-cache\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:57.064350 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.064172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-home\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:57.064350 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.064237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-dshm\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:57.064350 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.064272    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shhdg\" (UniqueName: \"kubernetes.io/projected/389643f2-6cc3-47bd-b31e-9a4a53c1363d-kube-api-access-shhdg\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:57.064612 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.064567    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-tmp-dir\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:57.064802 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.064778    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-home\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:57.064924 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.064803    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-model-cache\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:57.066516 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.066492    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-dshm\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:57.066703 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.066686    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/389643f2-6cc3-47bd-b31e-9a4a53c1363d-tls-certs\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:57.073975 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.073952    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shhdg\" (UniqueName: \"kubernetes.io/projected/389643f2-6cc3-47bd-b31e-9a4a53c1363d-kube-api-access-shhdg\") pod \"sub-test-model-d4af16-kserve-85475cb575-ftj8v\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") " pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:57.152640 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.152608    2562 generic.go:356] "Generic (PLEG): container finished" podID="077345c9-3f1e-4a65-8e27-af8fdac0b0b5" containerID="4a2b550372b50d47682d5f1d7242751a921fee146c59bf6824a5e13466466605" exitCode=0
Jul 08 16:28:57.152802 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.152646    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"
Jul 08 16:28:57.152802 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.152679    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq" event={"ID":"077345c9-3f1e-4a65-8e27-af8fdac0b0b5","Type":"ContainerDied","Data":"4a2b550372b50d47682d5f1d7242751a921fee146c59bf6824a5e13466466605"}
Jul 08 16:28:57.152802 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.152719    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq" event={"ID":"077345c9-3f1e-4a65-8e27-af8fdac0b0b5","Type":"ContainerDied","Data":"87b1383577c7832f834d8783906d46b5d00164f3c7b7d1a404c710dc689dce4e"}
Jul 08 16:28:57.152802 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.152742    2562 scope.go:117] "RemoveContainer" containerID="4a2b550372b50d47682d5f1d7242751a921fee146c59bf6824a5e13466466605"
Jul 08 16:28:57.162263 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.162246    2562 scope.go:117] "RemoveContainer" containerID="4a2b550372b50d47682d5f1d7242751a921fee146c59bf6824a5e13466466605"
Jul 08 16:28:57.162527 ip-10-0-131-108 kubenswrapper[2562]: E0708 16:28:57.162505    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a2b550372b50d47682d5f1d7242751a921fee146c59bf6824a5e13466466605\": container with ID starting with 4a2b550372b50d47682d5f1d7242751a921fee146c59bf6824a5e13466466605 not found: ID does not exist" containerID="4a2b550372b50d47682d5f1d7242751a921fee146c59bf6824a5e13466466605"
Jul 08 16:28:57.162634 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.162534    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a2b550372b50d47682d5f1d7242751a921fee146c59bf6824a5e13466466605"} err="failed to get container status \"4a2b550372b50d47682d5f1d7242751a921fee146c59bf6824a5e13466466605\": rpc error: code = NotFound desc = could not find container \"4a2b550372b50d47682d5f1d7242751a921fee146c59bf6824a5e13466466605\": container with ID starting with 4a2b550372b50d47682d5f1d7242751a921fee146c59bf6824a5e13466466605 not found: ID does not exist"
Jul 08 16:28:57.174550 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.174510    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"]
Jul 08 16:28:57.176719 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.176669    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/auth-test-model-d4af16-kserve-66875ffbf9-z4swq"]
Jul 08 16:28:57.210464 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.210433    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:28:57.338875 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.338823    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"]
Jul 08 16:28:57.340713 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.340681    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp" podUID="fb3bc2c6-44ff-444c-82dd-3d11801901ad" containerName="main" containerID="cri-o://a1d01992c30e1a4e02add0a156808d9475fc4976600db8215a7575c6351df6e9" gracePeriod=45
Jul 08 16:28:57.341100 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:28:57.341047    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod389643f2_6cc3_47bd_b31e_9a4a53c1363d.slice/crio-839e133bbfa886dadb376c0677ee1d30ab880f2c094b6b83a4e844300e97b292 WatchSource:0}: Error finding container 839e133bbfa886dadb376c0677ee1d30ab880f2c094b6b83a4e844300e97b292: Status 404 returned error can't find the container with id 839e133bbfa886dadb376c0677ee1d30ab880f2c094b6b83a4e844300e97b292
Jul 08 16:28:57.602741 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.602715    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:28:57.669371 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.669347    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-home\") pod \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") "
Jul 08 16:28:57.669540 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.669391    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-model-cache\") pod \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") "
Jul 08 16:28:57.669540 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.669415    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-tmp-dir\") pod \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") "
Jul 08 16:28:57.669540 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.669434    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-dshm\") pod \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") "
Jul 08 16:28:57.669540 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.669467    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb3bc2c6-44ff-444c-82dd-3d11801901ad-tls-certs\") pod \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") "
Jul 08 16:28:57.669540 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.669504    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpf8h\" (UniqueName: \"kubernetes.io/projected/fb3bc2c6-44ff-444c-82dd-3d11801901ad-kube-api-access-gpf8h\") pod \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\" (UID: \"fb3bc2c6-44ff-444c-82dd-3d11801901ad\") "
Jul 08 16:28:57.669847 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.669655    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-model-cache" (OuterVolumeSpecName: "model-cache") pod "fb3bc2c6-44ff-444c-82dd-3d11801901ad" (UID: "fb3bc2c6-44ff-444c-82dd-3d11801901ad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:28:57.669847 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.669682    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fb3bc2c6-44ff-444c-82dd-3d11801901ad" (UID: "fb3bc2c6-44ff-444c-82dd-3d11801901ad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:28:57.669847 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.669694    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-home" (OuterVolumeSpecName: "home") pod "fb3bc2c6-44ff-444c-82dd-3d11801901ad" (UID: "fb3bc2c6-44ff-444c-82dd-3d11801901ad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:28:57.669847 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.669848    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-home\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:28:57.669991 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.669860    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-model-cache\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:28:57.669991 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.669869    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-tmp-dir\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:28:57.671691 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.671660    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb3bc2c6-44ff-444c-82dd-3d11801901ad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fb3bc2c6-44ff-444c-82dd-3d11801901ad" (UID: "fb3bc2c6-44ff-444c-82dd-3d11801901ad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:28:57.671691 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.671673    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-dshm" (OuterVolumeSpecName: "dshm") pod "fb3bc2c6-44ff-444c-82dd-3d11801901ad" (UID: "fb3bc2c6-44ff-444c-82dd-3d11801901ad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:28:57.671691 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.671686    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb3bc2c6-44ff-444c-82dd-3d11801901ad-kube-api-access-gpf8h" (OuterVolumeSpecName: "kube-api-access-gpf8h") pod "fb3bc2c6-44ff-444c-82dd-3d11801901ad" (UID: "fb3bc2c6-44ff-444c-82dd-3d11801901ad"). InnerVolumeSpecName "kube-api-access-gpf8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:28:57.770393 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.770363    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fb3bc2c6-44ff-444c-82dd-3d11801901ad-dshm\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:28:57.770393 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.770389    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fb3bc2c6-44ff-444c-82dd-3d11801901ad-tls-certs\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:28:57.770598 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:57.770400    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpf8h\" (UniqueName: \"kubernetes.io/projected/fb3bc2c6-44ff-444c-82dd-3d11801901ad-kube-api-access-gpf8h\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:28:58.160035 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:58.159936    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v" event={"ID":"389643f2-6cc3-47bd-b31e-9a4a53c1363d","Type":"ContainerStarted","Data":"d73bc9fd6d169e70bfb16ef1f8aebd6a641456f357cfca408b86dd2faf68aab1"}
Jul 08 16:28:58.160035 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:58.159982    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v" event={"ID":"389643f2-6cc3-47bd-b31e-9a4a53c1363d","Type":"ContainerStarted","Data":"839e133bbfa886dadb376c0677ee1d30ab880f2c094b6b83a4e844300e97b292"}
Jul 08 16:28:58.161082 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:58.161056    2562 generic.go:356] "Generic (PLEG): container finished" podID="fb3bc2c6-44ff-444c-82dd-3d11801901ad" containerID="a1d01992c30e1a4e02add0a156808d9475fc4976600db8215a7575c6351df6e9" exitCode=0
Jul 08 16:28:58.161188 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:58.161087    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"
Jul 08 16:28:58.161188 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:58.161138    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp" event={"ID":"fb3bc2c6-44ff-444c-82dd-3d11801901ad","Type":"ContainerDied","Data":"a1d01992c30e1a4e02add0a156808d9475fc4976600db8215a7575c6351df6e9"}
Jul 08 16:28:58.161188 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:58.161173    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp" event={"ID":"fb3bc2c6-44ff-444c-82dd-3d11801901ad","Type":"ContainerDied","Data":"f2fb680a985011a5dfe73a2e27eda7170dde7dfe55707993e75f8560316c4956"}
Jul 08 16:28:58.161373 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:58.161194    2562 scope.go:117] "RemoveContainer" containerID="a1d01992c30e1a4e02add0a156808d9475fc4976600db8215a7575c6351df6e9"
Jul 08 16:28:58.170104 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:58.170083    2562 scope.go:117] "RemoveContainer" containerID="a1d01992c30e1a4e02add0a156808d9475fc4976600db8215a7575c6351df6e9"
Jul 08 16:28:58.170350 ip-10-0-131-108 kubenswrapper[2562]: E0708 16:28:58.170333    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1d01992c30e1a4e02add0a156808d9475fc4976600db8215a7575c6351df6e9\": container with ID starting with a1d01992c30e1a4e02add0a156808d9475fc4976600db8215a7575c6351df6e9 not found: ID does not exist" containerID="a1d01992c30e1a4e02add0a156808d9475fc4976600db8215a7575c6351df6e9"
Jul 08 16:28:58.170395 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:58.170357    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1d01992c30e1a4e02add0a156808d9475fc4976600db8215a7575c6351df6e9"} err="failed to get container status \"a1d01992c30e1a4e02add0a156808d9475fc4976600db8215a7575c6351df6e9\": rpc error: code = NotFound desc = could not find container \"a1d01992c30e1a4e02add0a156808d9475fc4976600db8215a7575c6351df6e9\": container with ID starting with a1d01992c30e1a4e02add0a156808d9475fc4976600db8215a7575c6351df6e9 not found: ID does not exist"
Jul 08 16:28:58.181803 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:58.181762    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v" podStartSLOduration=2.1817502380000002 podStartE2EDuration="2.181750238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:28:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:28:58.179605169 +0000 UTC m=+2277.590269821" watchObservedRunningTime="2026-07-08 16:28:58.181750238 +0000 UTC m=+2277.592414893"
Jul 08 16:28:58.194530 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:58.194509    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"]
Jul 08 16:28:58.199055 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:58.199034    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f77711/auth-test-model-f77711-kserve-5f95d45859-k5mdp"]
Jul 08 16:28:58.618451 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:58.618416    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="077345c9-3f1e-4a65-8e27-af8fdac0b0b5" path="/var/lib/kubelet/pods/077345c9-3f1e-4a65-8e27-af8fdac0b0b5/volumes"
Jul 08 16:28:58.618856 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:28:58.618835    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb3bc2c6-44ff-444c-82dd-3d11801901ad" path="/var/lib/kubelet/pods/fb3bc2c6-44ff-444c-82dd-3d11801901ad/volumes"
Jul 08 16:29:00.894190 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:00.894154    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:29:07.211241 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:07.211192    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:29:07.211656 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:07.211258    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:29:07.223459 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:07.223435    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:29:08.220995 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:08.220957    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:29:19.018928 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.018889    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"]
Jul 08 16:29:19.019395 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.019269    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb3bc2c6-44ff-444c-82dd-3d11801901ad" containerName="main"
Jul 08 16:29:19.019395 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.019280    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb3bc2c6-44ff-444c-82dd-3d11801901ad" containerName="main"
Jul 08 16:29:19.019395 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.019359    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb3bc2c6-44ff-444c-82dd-3d11801901ad" containerName="main"
Jul 08 16:29:19.022377 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.022361    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.028037 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.028010    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f77711\"/\"openshift-service-ca.crt\""
Jul 08 16:29:19.028037 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.028028    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f77711\"/\"sub-test-model-f77711-kserve-self-signed-certs\""
Jul 08 16:29:19.028233 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.028048    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f77711\"/\"default-dockercfg-sj2gh\""
Jul 08 16:29:19.028233 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.028102    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f77711\"/\"kube-root-ca.crt\""
Jul 08 16:29:19.038955 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.038936    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"]
Jul 08 16:29:19.106973 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.106934    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:29:19.168670 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.168627    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-dshm\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.168850 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.168678    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-tmp-dir\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.168850 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.168747    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gcnw\" (UniqueName: \"kubernetes.io/projected/cb901732-e37a-424a-9523-a5b2ce58b1c9-kube-api-access-5gcnw\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.168850 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.168807    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-home\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.168850 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.168834    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-model-cache\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.168984 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.168872    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb901732-e37a-424a-9523-a5b2ce58b1c9-tls-certs\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.269655 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.269540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-dshm\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.269655 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.269611    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-tmp-dir\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.269655 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.269638    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gcnw\" (UniqueName: \"kubernetes.io/projected/cb901732-e37a-424a-9523-a5b2ce58b1c9-kube-api-access-5gcnw\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.269942 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.269670    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-home\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.269942 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.269685    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-model-cache\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.269942 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.269836    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb901732-e37a-424a-9523-a5b2ce58b1c9-tls-certs\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.270089 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.270067    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-tmp-dir\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.270128 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.270096    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-home\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.270175 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.270132    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-model-cache\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.271885 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.271852    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-dshm\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.272234 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.272213    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb901732-e37a-424a-9523-a5b2ce58b1c9-tls-certs\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.278894 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.278865    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gcnw\" (UniqueName: \"kubernetes.io/projected/cb901732-e37a-424a-9523-a5b2ce58b1c9-kube-api-access-5gcnw\") pod \"sub-test-model-f77711-kserve-7df5b75b5c-6t47n\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") " pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.332474 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.332432    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:19.489447 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:19.489404    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"]
Jul 08 16:29:19.492967 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:29:19.492942    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb901732_e37a_424a_9523_a5b2ce58b1c9.slice/crio-0ff1268ed861444d3bfe7e13a385999433ed782d0bc2621b4564aa91487db261 WatchSource:0}: Error finding container 0ff1268ed861444d3bfe7e13a385999433ed782d0bc2621b4564aa91487db261: Status 404 returned error can't find the container with id 0ff1268ed861444d3bfe7e13a385999433ed782d0bc2621b4564aa91487db261
Jul 08 16:29:20.264600 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:20.264540    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n" event={"ID":"cb901732-e37a-424a-9523-a5b2ce58b1c9","Type":"ContainerStarted","Data":"28400964f6309d7fca70457232a8da0bfb7cc119c7baae58bb7b514f613e0b3f"}
Jul 08 16:29:20.264600 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:20.264600    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n" event={"ID":"cb901732-e37a-424a-9523-a5b2ce58b1c9","Type":"ContainerStarted","Data":"0ff1268ed861444d3bfe7e13a385999433ed782d0bc2621b4564aa91487db261"}
Jul 08 16:29:20.288863 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:20.288810    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n" podStartSLOduration=2.288794267 podStartE2EDuration="2.288794267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:29:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:29:20.287796099 +0000 UTC m=+2299.698460753" watchObservedRunningTime="2026-07-08 16:29:20.288794267 +0000 UTC m=+2299.699458921"
Jul 08 16:29:24.089620 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:24.089569    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:29:29.333353 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:29.333317    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:29.333814 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:29.333366    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:29.345838 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:29.345814    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:30.322045 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:30.322017    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:29:42.999366 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:29:42.999328    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:30:00.140366 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.140282    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5"]
Jul 08 16:30:00.144178 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.144154    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5"
Jul 08 16:30:00.145871 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.145841    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg"]
Jul 08 16:30:00.146863 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.146838    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 16:30:00.146968 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.146955    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4gvf8\""
Jul 08 16:30:00.147898 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.147878    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 16:30:00.149436 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.149420    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn"]
Jul 08 16:30:00.149545 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.149527    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg"
Jul 08 16:30:00.153298 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.153264    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5"]
Jul 08 16:30:00.153298 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.153283    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn"
Jul 08 16:30:00.156726 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.156707    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg"]
Jul 08 16:30:00.172340 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.172308    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn"]
Jul 08 16:30:00.247269 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.247238    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbgb7\" (UniqueName: \"kubernetes.io/projected/b1372add-c215-4a2f-b875-d88dc5bc7853-kube-api-access-vbgb7\") pod \"maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5\" (UID: \"b1372add-c215-4a2f-b875-d88dc5bc7853\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5"
Jul 08 16:30:00.247437 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.247344    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbgfn\" (UniqueName: \"kubernetes.io/projected/f834453b-fc49-4c6f-8ab5-d91a80a88430-kube-api-access-zbgfn\") pod \"maas-api-key-cleanup-29725470-5knsn\" (UID: \"f834453b-fc49-4c6f-8ab5-d91a80a88430\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn"
Jul 08 16:30:00.247437 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.247381    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfmsz\" (UniqueName: \"kubernetes.io/projected/9831e7e7-49fc-42d0-9941-bf500daf6b9e-kube-api-access-dfmsz\") pod \"maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg\" (UID: \"9831e7e7-49fc-42d0-9941-bf500daf6b9e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg"
Jul 08 16:30:00.348252 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.348216    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbgfn\" (UniqueName: \"kubernetes.io/projected/f834453b-fc49-4c6f-8ab5-d91a80a88430-kube-api-access-zbgfn\") pod \"maas-api-key-cleanup-29725470-5knsn\" (UID: \"f834453b-fc49-4c6f-8ab5-d91a80a88430\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn"
Jul 08 16:30:00.348426 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.348264    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfmsz\" (UniqueName: \"kubernetes.io/projected/9831e7e7-49fc-42d0-9941-bf500daf6b9e-kube-api-access-dfmsz\") pod \"maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg\" (UID: \"9831e7e7-49fc-42d0-9941-bf500daf6b9e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg"
Jul 08 16:30:00.348426 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.348378    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbgb7\" (UniqueName: \"kubernetes.io/projected/b1372add-c215-4a2f-b875-d88dc5bc7853-kube-api-access-vbgb7\") pod \"maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5\" (UID: \"b1372add-c215-4a2f-b875-d88dc5bc7853\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5"
Jul 08 16:30:00.357166 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.357132    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfmsz\" (UniqueName: \"kubernetes.io/projected/9831e7e7-49fc-42d0-9941-bf500daf6b9e-kube-api-access-dfmsz\") pod \"maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg\" (UID: \"9831e7e7-49fc-42d0-9941-bf500daf6b9e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg"
Jul 08 16:30:00.357293 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.357254    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbgfn\" (UniqueName: \"kubernetes.io/projected/f834453b-fc49-4c6f-8ab5-d91a80a88430-kube-api-access-zbgfn\") pod \"maas-api-key-cleanup-29725470-5knsn\" (UID: \"f834453b-fc49-4c6f-8ab5-d91a80a88430\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn"
Jul 08 16:30:00.357293 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.357254    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbgb7\" (UniqueName: \"kubernetes.io/projected/b1372add-c215-4a2f-b875-d88dc5bc7853-kube-api-access-vbgb7\") pod \"maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5\" (UID: \"b1372add-c215-4a2f-b875-d88dc5bc7853\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5"
Jul 08 16:30:00.458288 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.458197    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5"
Jul 08 16:30:00.469879 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.469849    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg"
Jul 08 16:30:00.479903 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.479875    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn"
Jul 08 16:30:00.619501 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:30:00.619429    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1372add_c215_4a2f_b875_d88dc5bc7853.slice/crio-656251fcb9082cb759c0a998921027e2774283d0cf139dc40cec837b883bfabb WatchSource:0}: Error finding container 656251fcb9082cb759c0a998921027e2774283d0cf139dc40cec837b883bfabb: Status 404 returned error can't find the container with id 656251fcb9082cb759c0a998921027e2774283d0cf139dc40cec837b883bfabb
Jul 08 16:30:00.620821 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.620798    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5"]
Jul 08 16:30:00.862243 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.862218    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn"]
Jul 08 16:30:00.863957 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:30:00.863935    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf834453b_fc49_4c6f_8ab5_d91a80a88430.slice/crio-3597905e07d20ac2d24323f878dddc151d571d2ed9dcd07f3c586a08471fa667 WatchSource:0}: Error finding container 3597905e07d20ac2d24323f878dddc151d571d2ed9dcd07f3c586a08471fa667: Status 404 returned error can't find the container with id 3597905e07d20ac2d24323f878dddc151d571d2ed9dcd07f3c586a08471fa667
Jul 08 16:30:00.883912 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:00.883891    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg"]
Jul 08 16:30:00.897634 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:30:00.897609    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9831e7e7_49fc_42d0_9941_bf500daf6b9e.slice/crio-e2b8a62561c064f675a808adb84e5d9f434dd79bdc7aa9e39c16a3f8dccbff23 WatchSource:0}: Error finding container e2b8a62561c064f675a808adb84e5d9f434dd79bdc7aa9e39c16a3f8dccbff23: Status 404 returned error can't find the container with id e2b8a62561c064f675a808adb84e5d9f434dd79bdc7aa9e39c16a3f8dccbff23
Jul 08 16:30:01.463728 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:01.463628    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn" event={"ID":"f834453b-fc49-4c6f-8ab5-d91a80a88430","Type":"ContainerStarted","Data":"4c3dcc207d3fe081938dc5b9bf0d1035372606962f85fa3e23a5118dc5bbb946"}
Jul 08 16:30:01.463728 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:01.463690    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn" event={"ID":"f834453b-fc49-4c6f-8ab5-d91a80a88430","Type":"ContainerStarted","Data":"3597905e07d20ac2d24323f878dddc151d571d2ed9dcd07f3c586a08471fa667"}
Jul 08 16:30:01.465105 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:01.465081    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg" event={"ID":"9831e7e7-49fc-42d0-9941-bf500daf6b9e","Type":"ContainerStarted","Data":"a355bb3ac3266b9c2f84a95e8211b01527f6569bfe51c0829b2d12e54aa00683"}
Jul 08 16:30:01.465240 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:01.465123    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg" event={"ID":"9831e7e7-49fc-42d0-9941-bf500daf6b9e","Type":"ContainerStarted","Data":"e2b8a62561c064f675a808adb84e5d9f434dd79bdc7aa9e39c16a3f8dccbff23"}
Jul 08 16:30:01.466351 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:01.466333    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5" event={"ID":"b1372add-c215-4a2f-b875-d88dc5bc7853","Type":"ContainerStarted","Data":"fe48c6e6096ac8a869e997d99888864863ab31b830c62582d1df26907cb02a92"}
Jul 08 16:30:01.466422 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:01.466371    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5" event={"ID":"b1372add-c215-4a2f-b875-d88dc5bc7853","Type":"ContainerStarted","Data":"656251fcb9082cb759c0a998921027e2774283d0cf139dc40cec837b883bfabb"}
Jul 08 16:30:01.481948 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:01.481895    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn" podStartSLOduration=1.481876692 podStartE2EDuration="1.481876692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:30:01.47982955 +0000 UTC m=+2340.890494223" watchObservedRunningTime="2026-07-08 16:30:01.481876692 +0000 UTC m=+2340.892541346"
Jul 08 16:30:01.496402 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:01.496346    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5" podStartSLOduration=1.496330588 podStartE2EDuration="1.496330588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:30:01.495157037 +0000 UTC m=+2340.905821695" watchObservedRunningTime="2026-07-08 16:30:01.496330588 +0000 UTC m=+2340.906995242"
Jul 08 16:30:01.513692 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:01.513638    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg" podStartSLOduration=1.513624876 podStartE2EDuration="1.513624876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:30:01.511723463 +0000 UTC m=+2340.922388116" watchObservedRunningTime="2026-07-08 16:30:01.513624876 +0000 UTC m=+2340.924289530"
Jul 08 16:30:02.596899 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:02.596862    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:30:05.921846 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:05.921814    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:30:07.690541 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:07.690505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:30:08.793057 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:08.793019    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"]
Jul 08 16:30:08.811838 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:08.811807    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:30:09.635939 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:09.635910    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"]
Jul 08 16:30:09.801511 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:09.801479    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:30:14.495788 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.495749    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"]
Jul 08 16:30:14.498859 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.498840    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.501274 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.501250    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-d4af16\"/\"rate-test-model-d4af16-kserve-self-signed-certs\""
Jul 08 16:30:14.511722 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.511689    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"]
Jul 08 16:30:14.524000 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.523971    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:30:14.575595 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.575539    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-home\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.575773 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.575601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-model-cache\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.575773 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.575720    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-dshm\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.575773 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.575737    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-tls-certs\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.575773 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.575755    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-tmp-dir\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.575916 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.575772    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6whds\" (UniqueName: \"kubernetes.io/projected/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-kube-api-access-6whds\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.676930 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.676884    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-model-cache\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.677105 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.677007    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-dshm\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.677105 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.677024    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-tls-certs\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.677105 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.677042    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-tmp-dir\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.677105 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.677065    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6whds\" (UniqueName: \"kubernetes.io/projected/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-kube-api-access-6whds\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.677105 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.677087    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-home\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.677440 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.677323    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-model-cache\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.677507 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.677478    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-tmp-dir\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.677565 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.677529    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-home\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.679461 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.679438    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-dshm\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.679654 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.679636    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-tls-certs\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.685893 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.685871    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6whds\" (UniqueName: \"kubernetes.io/projected/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-kube-api-access-6whds\") pod \"rate-test-model-d4af16-kserve-994bd7c8c-gxdsk\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") " pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.808565 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.808523    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:14.945969 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:14.945943    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"]
Jul 08 16:30:14.948120 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:30:14.948092    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1f00093_f2ae_417c_8c5d_80a5fc3d0eec.slice/crio-9d1d70c1c4a173cd43f4b14341cae7121d9529116d4e7eacaf9b046894158698 WatchSource:0}: Error finding container 9d1d70c1c4a173cd43f4b14341cae7121d9529116d4e7eacaf9b046894158698: Status 404 returned error can't find the container with id 9d1d70c1c4a173cd43f4b14341cae7121d9529116d4e7eacaf9b046894158698
Jul 08 16:30:15.537762 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:15.537727    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk" event={"ID":"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec","Type":"ContainerStarted","Data":"9b31a95824c70123a0be7aec176eb29274f1032d6726771ae57ab74fe021e1bf"}
Jul 08 16:30:15.537762 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:15.537769    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk" event={"ID":"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec","Type":"ContainerStarted","Data":"9d1d70c1c4a173cd43f4b14341cae7121d9529116d4e7eacaf9b046894158698"}
Jul 08 16:30:15.556834 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:15.556784    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk" podStartSLOduration=1.5567680739999998 podStartE2EDuration="1.556768074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:30:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:30:15.555758917 +0000 UTC m=+2354.966423585" watchObservedRunningTime="2026-07-08 16:30:15.556768074 +0000 UTC m=+2354.967432728"
Jul 08 16:30:18.996650 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:18.996609    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:30:23.813333 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:23.813270    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v" podUID="389643f2-6cc3-47bd-b31e-9a4a53c1363d" containerName="main" containerID="cri-o://d73bc9fd6d169e70bfb16ef1f8aebd6a641456f357cfca408b86dd2faf68aab1" gracePeriod=45
Jul 08 16:30:23.900650 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:23.900609    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:30:24.061950 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.061927    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:30:24.170130 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.170030    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-tmp-dir\") pod \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") "
Jul 08 16:30:24.170130 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.170087    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-home\") pod \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") "
Jul 08 16:30:24.170130 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.170116    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shhdg\" (UniqueName: \"kubernetes.io/projected/389643f2-6cc3-47bd-b31e-9a4a53c1363d-kube-api-access-shhdg\") pod \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") "
Jul 08 16:30:24.170426 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.170157    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/389643f2-6cc3-47bd-b31e-9a4a53c1363d-tls-certs\") pod \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") "
Jul 08 16:30:24.170426 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.170275    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-dshm\") pod \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") "
Jul 08 16:30:24.170426 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.170331    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-model-cache\") pod \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\" (UID: \"389643f2-6cc3-47bd-b31e-9a4a53c1363d\") "
Jul 08 16:30:24.170426 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.170369    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "389643f2-6cc3-47bd-b31e-9a4a53c1363d" (UID: "389643f2-6cc3-47bd-b31e-9a4a53c1363d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:30:24.170426 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.170374    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-home" (OuterVolumeSpecName: "home") pod "389643f2-6cc3-47bd-b31e-9a4a53c1363d" (UID: "389643f2-6cc3-47bd-b31e-9a4a53c1363d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:30:24.170679 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.170570    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-model-cache" (OuterVolumeSpecName: "model-cache") pod "389643f2-6cc3-47bd-b31e-9a4a53c1363d" (UID: "389643f2-6cc3-47bd-b31e-9a4a53c1363d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:30:24.170953 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.170714    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-model-cache\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:30:24.170953 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.170732    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-tmp-dir\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:30:24.170953 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.170746    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-home\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:30:24.172631 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.172563    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/389643f2-6cc3-47bd-b31e-9a4a53c1363d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "389643f2-6cc3-47bd-b31e-9a4a53c1363d" (UID: "389643f2-6cc3-47bd-b31e-9a4a53c1363d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:30:24.172886 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.172829    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-dshm" (OuterVolumeSpecName: "dshm") pod "389643f2-6cc3-47bd-b31e-9a4a53c1363d" (UID: "389643f2-6cc3-47bd-b31e-9a4a53c1363d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:30:24.172886 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.172858    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/389643f2-6cc3-47bd-b31e-9a4a53c1363d-kube-api-access-shhdg" (OuterVolumeSpecName: "kube-api-access-shhdg") pod "389643f2-6cc3-47bd-b31e-9a4a53c1363d" (UID: "389643f2-6cc3-47bd-b31e-9a4a53c1363d"). InnerVolumeSpecName "kube-api-access-shhdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:30:24.272247 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.272205    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shhdg\" (UniqueName: \"kubernetes.io/projected/389643f2-6cc3-47bd-b31e-9a4a53c1363d-kube-api-access-shhdg\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:30:24.272247 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.272247    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/389643f2-6cc3-47bd-b31e-9a4a53c1363d-tls-certs\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:30:24.272462 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.272263    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/389643f2-6cc3-47bd-b31e-9a4a53c1363d-dshm\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:30:24.585973 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.585941    2562 generic.go:356] "Generic (PLEG): container finished" podID="389643f2-6cc3-47bd-b31e-9a4a53c1363d" containerID="d73bc9fd6d169e70bfb16ef1f8aebd6a641456f357cfca408b86dd2faf68aab1" exitCode=0
Jul 08 16:30:24.586188 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.585988    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"
Jul 08 16:30:24.586188 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.586012    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v" event={"ID":"389643f2-6cc3-47bd-b31e-9a4a53c1363d","Type":"ContainerDied","Data":"d73bc9fd6d169e70bfb16ef1f8aebd6a641456f357cfca408b86dd2faf68aab1"}
Jul 08 16:30:24.586188 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.586044    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v" event={"ID":"389643f2-6cc3-47bd-b31e-9a4a53c1363d","Type":"ContainerDied","Data":"839e133bbfa886dadb376c0677ee1d30ab880f2c094b6b83a4e844300e97b292"}
Jul 08 16:30:24.586188 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.586065    2562 scope.go:117] "RemoveContainer" containerID="d73bc9fd6d169e70bfb16ef1f8aebd6a641456f357cfca408b86dd2faf68aab1"
Jul 08 16:30:24.595450 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.595433    2562 scope.go:117] "RemoveContainer" containerID="d73bc9fd6d169e70bfb16ef1f8aebd6a641456f357cfca408b86dd2faf68aab1"
Jul 08 16:30:24.595777 ip-10-0-131-108 kubenswrapper[2562]: E0708 16:30:24.595755    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d73bc9fd6d169e70bfb16ef1f8aebd6a641456f357cfca408b86dd2faf68aab1\": container with ID starting with d73bc9fd6d169e70bfb16ef1f8aebd6a641456f357cfca408b86dd2faf68aab1 not found: ID does not exist" containerID="d73bc9fd6d169e70bfb16ef1f8aebd6a641456f357cfca408b86dd2faf68aab1"
Jul 08 16:30:24.595854 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.595787    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d73bc9fd6d169e70bfb16ef1f8aebd6a641456f357cfca408b86dd2faf68aab1"} err="failed to get container status \"d73bc9fd6d169e70bfb16ef1f8aebd6a641456f357cfca408b86dd2faf68aab1\": rpc error: code = NotFound desc = could not find container \"d73bc9fd6d169e70bfb16ef1f8aebd6a641456f357cfca408b86dd2faf68aab1\": container with ID starting with d73bc9fd6d169e70bfb16ef1f8aebd6a641456f357cfca408b86dd2faf68aab1 not found: ID does not exist"
Jul 08 16:30:24.610171 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.610108    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"]
Jul 08 16:30:24.617673 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.617649    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/sub-test-model-d4af16-kserve-85475cb575-ftj8v"]
Jul 08 16:30:24.656502 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.656452    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n" podUID="cb901732-e37a-424a-9523-a5b2ce58b1c9" containerName="main" containerID="cri-o://28400964f6309d7fca70457232a8da0bfb7cc119c7baae58bb7b514f613e0b3f" gracePeriod=45
Jul 08 16:30:24.809009 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.808961    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:24.809188 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.809022    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:24.822523 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.822496    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:24.915655 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.915627    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:30:24.978574 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.978538    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb901732-e37a-424a-9523-a5b2ce58b1c9-tls-certs\") pod \"cb901732-e37a-424a-9523-a5b2ce58b1c9\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") "
Jul 08 16:30:24.978778 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.978609    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-tmp-dir\") pod \"cb901732-e37a-424a-9523-a5b2ce58b1c9\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") "
Jul 08 16:30:24.978778 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.978637    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gcnw\" (UniqueName: \"kubernetes.io/projected/cb901732-e37a-424a-9523-a5b2ce58b1c9-kube-api-access-5gcnw\") pod \"cb901732-e37a-424a-9523-a5b2ce58b1c9\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") "
Jul 08 16:30:24.978778 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.978691    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-dshm\") pod \"cb901732-e37a-424a-9523-a5b2ce58b1c9\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") "
Jul 08 16:30:24.978778 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.978717    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-home\") pod \"cb901732-e37a-424a-9523-a5b2ce58b1c9\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") "
Jul 08 16:30:24.978778 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.978762    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-model-cache\") pod \"cb901732-e37a-424a-9523-a5b2ce58b1c9\" (UID: \"cb901732-e37a-424a-9523-a5b2ce58b1c9\") "
Jul 08 16:30:24.979057 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.978916    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cb901732-e37a-424a-9523-a5b2ce58b1c9" (UID: "cb901732-e37a-424a-9523-a5b2ce58b1c9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:30:24.979057 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.978990    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-home" (OuterVolumeSpecName: "home") pod "cb901732-e37a-424a-9523-a5b2ce58b1c9" (UID: "cb901732-e37a-424a-9523-a5b2ce58b1c9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:30:24.979155 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.979062    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-model-cache" (OuterVolumeSpecName: "model-cache") pod "cb901732-e37a-424a-9523-a5b2ce58b1c9" (UID: "cb901732-e37a-424a-9523-a5b2ce58b1c9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:30:24.979155 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.979125    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-tmp-dir\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:30:24.979155 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.979144    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-home\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:30:24.980745 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.980717    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-dshm" (OuterVolumeSpecName: "dshm") pod "cb901732-e37a-424a-9523-a5b2ce58b1c9" (UID: "cb901732-e37a-424a-9523-a5b2ce58b1c9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:30:24.980887 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.980872    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb901732-e37a-424a-9523-a5b2ce58b1c9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cb901732-e37a-424a-9523-a5b2ce58b1c9" (UID: "cb901732-e37a-424a-9523-a5b2ce58b1c9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:30:24.980935 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:24.980911    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb901732-e37a-424a-9523-a5b2ce58b1c9-kube-api-access-5gcnw" (OuterVolumeSpecName: "kube-api-access-5gcnw") pod "cb901732-e37a-424a-9523-a5b2ce58b1c9" (UID: "cb901732-e37a-424a-9523-a5b2ce58b1c9"). InnerVolumeSpecName "kube-api-access-5gcnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:30:25.080593 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:25.080554    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gcnw\" (UniqueName: \"kubernetes.io/projected/cb901732-e37a-424a-9523-a5b2ce58b1c9-kube-api-access-5gcnw\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:30:25.080748 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:25.080613    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-dshm\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:30:25.080748 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:25.080629    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb901732-e37a-424a-9523-a5b2ce58b1c9-model-cache\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:30:25.080748 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:25.080639    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb901732-e37a-424a-9523-a5b2ce58b1c9-tls-certs\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:30:25.591595 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:25.591549    2562 generic.go:356] "Generic (PLEG): container finished" podID="cb901732-e37a-424a-9523-a5b2ce58b1c9" containerID="28400964f6309d7fca70457232a8da0bfb7cc119c7baae58bb7b514f613e0b3f" exitCode=0
Jul 08 16:30:25.591803 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:25.591619    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"
Jul 08 16:30:25.591803 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:25.591630    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n" event={"ID":"cb901732-e37a-424a-9523-a5b2ce58b1c9","Type":"ContainerDied","Data":"28400964f6309d7fca70457232a8da0bfb7cc119c7baae58bb7b514f613e0b3f"}
Jul 08 16:30:25.591803 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:25.591667    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n" event={"ID":"cb901732-e37a-424a-9523-a5b2ce58b1c9","Type":"ContainerDied","Data":"0ff1268ed861444d3bfe7e13a385999433ed782d0bc2621b4564aa91487db261"}
Jul 08 16:30:25.591803 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:25.591685    2562 scope.go:117] "RemoveContainer" containerID="28400964f6309d7fca70457232a8da0bfb7cc119c7baae58bb7b514f613e0b3f"
Jul 08 16:30:25.601643 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:25.601626    2562 scope.go:117] "RemoveContainer" containerID="28400964f6309d7fca70457232a8da0bfb7cc119c7baae58bb7b514f613e0b3f"
Jul 08 16:30:25.601934 ip-10-0-131-108 kubenswrapper[2562]: E0708 16:30:25.601909    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28400964f6309d7fca70457232a8da0bfb7cc119c7baae58bb7b514f613e0b3f\": container with ID starting with 28400964f6309d7fca70457232a8da0bfb7cc119c7baae58bb7b514f613e0b3f not found: ID does not exist" containerID="28400964f6309d7fca70457232a8da0bfb7cc119c7baae58bb7b514f613e0b3f"
Jul 08 16:30:25.602001 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:25.601946    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28400964f6309d7fca70457232a8da0bfb7cc119c7baae58bb7b514f613e0b3f"} err="failed to get container status \"28400964f6309d7fca70457232a8da0bfb7cc119c7baae58bb7b514f613e0b3f\": rpc error: code = NotFound desc = could not find container \"28400964f6309d7fca70457232a8da0bfb7cc119c7baae58bb7b514f613e0b3f\": container with ID starting with 28400964f6309d7fca70457232a8da0bfb7cc119c7baae58bb7b514f613e0b3f not found: ID does not exist"
Jul 08 16:30:25.605826 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:25.605806    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:30:25.613233 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:25.613207    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"]
Jul 08 16:30:25.618852 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:25.618832    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f77711/sub-test-model-f77711-kserve-7df5b75b5c-6t47n"]
Jul 08 16:30:26.617193 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:26.617161    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="389643f2-6cc3-47bd-b31e-9a4a53c1363d" path="/var/lib/kubelet/pods/389643f2-6cc3-47bd-b31e-9a4a53c1363d/volumes"
Jul 08 16:30:26.617568 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:26.617547    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb901732-e37a-424a-9523-a5b2ce58b1c9" path="/var/lib/kubelet/pods/cb901732-e37a-424a-9523-a5b2ce58b1c9/volumes"
Jul 08 16:30:40.695707 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.695677    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"]
Jul 08 16:30:40.696181 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.696046    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="389643f2-6cc3-47bd-b31e-9a4a53c1363d" containerName="main"
Jul 08 16:30:40.696181 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.696058    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="389643f2-6cc3-47bd-b31e-9a4a53c1363d" containerName="main"
Jul 08 16:30:40.696181 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.696085    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb901732-e37a-424a-9523-a5b2ce58b1c9" containerName="main"
Jul 08 16:30:40.696181 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.696090    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb901732-e37a-424a-9523-a5b2ce58b1c9" containerName="main"
Jul 08 16:30:40.696181 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.696147    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="389643f2-6cc3-47bd-b31e-9a4a53c1363d" containerName="main"
Jul 08 16:30:40.696181 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.696153    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb901732-e37a-424a-9523-a5b2ce58b1c9" containerName="main"
Jul 08 16:30:40.699052 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.699035    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.702737 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.702708    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f77711\"/\"rate-test-model-f77711-kserve-self-signed-certs\""
Jul 08 16:30:40.702869 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.702748    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f77711\"/\"openshift-service-ca.crt\""
Jul 08 16:30:40.702869 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.702714    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f77711\"/\"default-dockercfg-sj2gh\""
Jul 08 16:30:40.702869 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.702712    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f77711\"/\"kube-root-ca.crt\""
Jul 08 16:30:40.708996 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.708970    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"]
Jul 08 16:30:40.728481 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.728452    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:30:40.832005 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.831975    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-dshm\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.832005 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.832005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-tmp-dir\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.832204 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.832069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-model-cache\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.832204 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.832095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87752b39-99a3-4513-84c4-b0b273b4e0a0-tls-certs\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.832204 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.832183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9tkd\" (UniqueName: \"kubernetes.io/projected/87752b39-99a3-4513-84c4-b0b273b4e0a0-kube-api-access-l9tkd\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.832323 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.832235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-home\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.932958 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.932926    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-dshm\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.932958 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.932961    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-tmp-dir\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.933217 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.932993    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-model-cache\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.933217 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.933010    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87752b39-99a3-4513-84c4-b0b273b4e0a0-tls-certs\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.933217 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.933036    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9tkd\" (UniqueName: \"kubernetes.io/projected/87752b39-99a3-4513-84c4-b0b273b4e0a0-kube-api-access-l9tkd\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.933217 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.933090    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-home\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.933408 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.933361    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-tmp-dir\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.933479 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.933406    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-model-cache\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.933531 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.933476    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-home\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.935246 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.935221    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-dshm\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.935631 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.935612    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87752b39-99a3-4513-84c4-b0b273b4e0a0-tls-certs\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:40.941785 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:40.941762    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9tkd\" (UniqueName: \"kubernetes.io/projected/87752b39-99a3-4513-84c4-b0b273b4e0a0-kube-api-access-l9tkd\") pod \"rate-test-model-f77711-kserve-6fcf57494c-6s9w5\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") " pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:41.010100 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:41.010024    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:41.142567 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:41.142536    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"]
Jul 08 16:30:41.144458 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:30:41.144421    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87752b39_99a3_4513_84c4_b0b273b4e0a0.slice/crio-64b3433e10e57310a91e136004171f1fa211057dde49de7ac517984d0bc28346 WatchSource:0}: Error finding container 64b3433e10e57310a91e136004171f1fa211057dde49de7ac517984d0bc28346: Status 404 returned error can't find the container with id 64b3433e10e57310a91e136004171f1fa211057dde49de7ac517984d0bc28346
Jul 08 16:30:41.676209 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:41.676166    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5" event={"ID":"87752b39-99a3-4513-84c4-b0b273b4e0a0","Type":"ContainerStarted","Data":"771bb7f7f6e7c2b924b18e2e576dea77b2cbfc99b2f34cd2966c3e8f83c4784c"}
Jul 08 16:30:41.676392 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:41.676216    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5" event={"ID":"87752b39-99a3-4513-84c4-b0b273b4e0a0","Type":"ContainerStarted","Data":"64b3433e10e57310a91e136004171f1fa211057dde49de7ac517984d0bc28346"}
Jul 08 16:30:41.695762 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:41.695711    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5" podStartSLOduration=1.695696952 podStartE2EDuration="1.695696952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:30:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:30:41.694105305 +0000 UTC m=+2381.104769958" watchObservedRunningTime="2026-07-08 16:30:41.695696952 +0000 UTC m=+2381.106361606"
Jul 08 16:30:44.897755 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:44.897717    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:30:51.010928 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:51.010859    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:51.010928 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:51.010935    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:51.023534 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:51.023503    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:30:51.737015 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:30:51.736933    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:31:00.011202 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:00.011169    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5"]
Jul 08 16:31:00.011716 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:00.011432    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5" podUID="b1372add-c215-4a2f-b875-d88dc5bc7853" containerName="cleanup" containerID="cri-o://fe48c6e6096ac8a869e997d99888864863ab31b830c62582d1df26907cb02a92" gracePeriod=30
Jul 08 16:31:00.013135 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:00.013113    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg"]
Jul 08 16:31:00.013346 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:00.013320    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg" podUID="9831e7e7-49fc-42d0-9941-bf500daf6b9e" containerName="cleanup" containerID="cri-o://a355bb3ac3266b9c2f84a95e8211b01527f6569bfe51c0829b2d12e54aa00683" gracePeriod=30
Jul 08 16:31:00.014652 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:00.014625    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn"]
Jul 08 16:31:00.014823 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:00.014800    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn" podUID="f834453b-fc49-4c6f-8ab5-d91a80a88430" containerName="cleanup" containerID="cri-o://4c3dcc207d3fe081938dc5b9bf0d1035372606962f85fa3e23a5118dc5bbb946" gracePeriod=30
Jul 08 16:31:02.856214 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:02.856150    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:31:02.960016 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:02.959980    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:31:03.894833 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:03.894793    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:31:11.461382 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:11.461330    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:31:11.562382 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:11.562350    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:31:23.102670 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:23.102572    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:31:30.224079 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.224050    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5"
Jul 08 16:31:30.254600 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.254556    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn"
Jul 08 16:31:30.256696 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.256678    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg"
Jul 08 16:31:30.304614 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.304511    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbgb7\" (UniqueName: \"kubernetes.io/projected/b1372add-c215-4a2f-b875-d88dc5bc7853-kube-api-access-vbgb7\") pod \"b1372add-c215-4a2f-b875-d88dc5bc7853\" (UID: \"b1372add-c215-4a2f-b875-d88dc5bc7853\") "
Jul 08 16:31:30.304614 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.304602    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbgfn\" (UniqueName: \"kubernetes.io/projected/f834453b-fc49-4c6f-8ab5-d91a80a88430-kube-api-access-zbgfn\") pod \"f834453b-fc49-4c6f-8ab5-d91a80a88430\" (UID: \"f834453b-fc49-4c6f-8ab5-d91a80a88430\") "
Jul 08 16:31:30.304848 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.304667    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfmsz\" (UniqueName: \"kubernetes.io/projected/9831e7e7-49fc-42d0-9941-bf500daf6b9e-kube-api-access-dfmsz\") pod \"9831e7e7-49fc-42d0-9941-bf500daf6b9e\" (UID: \"9831e7e7-49fc-42d0-9941-bf500daf6b9e\") "
Jul 08 16:31:30.306684 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.306651    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1372add-c215-4a2f-b875-d88dc5bc7853-kube-api-access-vbgb7" (OuterVolumeSpecName: "kube-api-access-vbgb7") pod "b1372add-c215-4a2f-b875-d88dc5bc7853" (UID: "b1372add-c215-4a2f-b875-d88dc5bc7853"). InnerVolumeSpecName "kube-api-access-vbgb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:31:30.306684 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.306673    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9831e7e7-49fc-42d0-9941-bf500daf6b9e-kube-api-access-dfmsz" (OuterVolumeSpecName: "kube-api-access-dfmsz") pod "9831e7e7-49fc-42d0-9941-bf500daf6b9e" (UID: "9831e7e7-49fc-42d0-9941-bf500daf6b9e"). InnerVolumeSpecName "kube-api-access-dfmsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:31:30.306833 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.306701    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f834453b-fc49-4c6f-8ab5-d91a80a88430-kube-api-access-zbgfn" (OuterVolumeSpecName: "kube-api-access-zbgfn") pod "f834453b-fc49-4c6f-8ab5-d91a80a88430" (UID: "f834453b-fc49-4c6f-8ab5-d91a80a88430"). InnerVolumeSpecName "kube-api-access-zbgfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:31:30.406165 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.406124    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfmsz\" (UniqueName: \"kubernetes.io/projected/9831e7e7-49fc-42d0-9941-bf500daf6b9e-kube-api-access-dfmsz\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:31:30.406165 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.406157    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbgb7\" (UniqueName: \"kubernetes.io/projected/b1372add-c215-4a2f-b875-d88dc5bc7853-kube-api-access-vbgb7\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:31:30.406165 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.406166    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbgfn\" (UniqueName: \"kubernetes.io/projected/f834453b-fc49-4c6f-8ab5-d91a80a88430-kube-api-access-zbgfn\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:31:30.669455 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.669416    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"]
Jul 08 16:31:30.705320 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.705286    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:31:30.914079 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.913982    2562 generic.go:356] "Generic (PLEG): container finished" podID="9831e7e7-49fc-42d0-9941-bf500daf6b9e" containerID="a355bb3ac3266b9c2f84a95e8211b01527f6569bfe51c0829b2d12e54aa00683" exitCode=137
Jul 08 16:31:30.914079 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.914032    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg"
Jul 08 16:31:30.914079 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.914065    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg" event={"ID":"9831e7e7-49fc-42d0-9941-bf500daf6b9e","Type":"ContainerDied","Data":"a355bb3ac3266b9c2f84a95e8211b01527f6569bfe51c0829b2d12e54aa00683"}
Jul 08 16:31:30.914363 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.914128    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg" event={"ID":"9831e7e7-49fc-42d0-9941-bf500daf6b9e","Type":"ContainerDied","Data":"e2b8a62561c064f675a808adb84e5d9f434dd79bdc7aa9e39c16a3f8dccbff23"}
Jul 08 16:31:30.914363 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.914156    2562 scope.go:117] "RemoveContainer" containerID="a355bb3ac3266b9c2f84a95e8211b01527f6569bfe51c0829b2d12e54aa00683"
Jul 08 16:31:30.915324 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.915302    2562 generic.go:356] "Generic (PLEG): container finished" podID="b1372add-c215-4a2f-b875-d88dc5bc7853" containerID="fe48c6e6096ac8a869e997d99888864863ab31b830c62582d1df26907cb02a92" exitCode=137
Jul 08 16:31:30.915442 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.915378    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5"
Jul 08 16:31:30.915442 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.915385    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5" event={"ID":"b1372add-c215-4a2f-b875-d88dc5bc7853","Type":"ContainerDied","Data":"fe48c6e6096ac8a869e997d99888864863ab31b830c62582d1df26907cb02a92"}
Jul 08 16:31:30.915620 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.915443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5" event={"ID":"b1372add-c215-4a2f-b875-d88dc5bc7853","Type":"ContainerDied","Data":"656251fcb9082cb759c0a998921027e2774283d0cf139dc40cec837b883bfabb"}
Jul 08 16:31:30.916835 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.916814    2562 generic.go:356] "Generic (PLEG): container finished" podID="f834453b-fc49-4c6f-8ab5-d91a80a88430" containerID="4c3dcc207d3fe081938dc5b9bf0d1035372606962f85fa3e23a5118dc5bbb946" exitCode=137
Jul 08 16:31:30.916948 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.916855    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn" event={"ID":"f834453b-fc49-4c6f-8ab5-d91a80a88430","Type":"ContainerDied","Data":"4c3dcc207d3fe081938dc5b9bf0d1035372606962f85fa3e23a5118dc5bbb946"}
Jul 08 16:31:30.916948 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.916864    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn"
Jul 08 16:31:30.916948 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.916894    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn" event={"ID":"f834453b-fc49-4c6f-8ab5-d91a80a88430","Type":"ContainerDied","Data":"3597905e07d20ac2d24323f878dddc151d571d2ed9dcd07f3c586a08471fa667"}
Jul 08 16:31:30.923915 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.923895    2562 scope.go:117] "RemoveContainer" containerID="a355bb3ac3266b9c2f84a95e8211b01527f6569bfe51c0829b2d12e54aa00683"
Jul 08 16:31:30.924169 ip-10-0-131-108 kubenswrapper[2562]: E0708 16:31:30.924150    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a355bb3ac3266b9c2f84a95e8211b01527f6569bfe51c0829b2d12e54aa00683\": container with ID starting with a355bb3ac3266b9c2f84a95e8211b01527f6569bfe51c0829b2d12e54aa00683 not found: ID does not exist" containerID="a355bb3ac3266b9c2f84a95e8211b01527f6569bfe51c0829b2d12e54aa00683"
Jul 08 16:31:30.924221 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.924177    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a355bb3ac3266b9c2f84a95e8211b01527f6569bfe51c0829b2d12e54aa00683"} err="failed to get container status \"a355bb3ac3266b9c2f84a95e8211b01527f6569bfe51c0829b2d12e54aa00683\": rpc error: code = NotFound desc = could not find container \"a355bb3ac3266b9c2f84a95e8211b01527f6569bfe51c0829b2d12e54aa00683\": container with ID starting with a355bb3ac3266b9c2f84a95e8211b01527f6569bfe51c0829b2d12e54aa00683 not found: ID does not exist"
Jul 08 16:31:30.924221 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.924193    2562 scope.go:117] "RemoveContainer" containerID="fe48c6e6096ac8a869e997d99888864863ab31b830c62582d1df26907cb02a92"
Jul 08 16:31:30.932022 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.932002    2562 scope.go:117] "RemoveContainer" containerID="fe48c6e6096ac8a869e997d99888864863ab31b830c62582d1df26907cb02a92"
Jul 08 16:31:30.932326 ip-10-0-131-108 kubenswrapper[2562]: E0708 16:31:30.932309    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe48c6e6096ac8a869e997d99888864863ab31b830c62582d1df26907cb02a92\": container with ID starting with fe48c6e6096ac8a869e997d99888864863ab31b830c62582d1df26907cb02a92 not found: ID does not exist" containerID="fe48c6e6096ac8a869e997d99888864863ab31b830c62582d1df26907cb02a92"
Jul 08 16:31:30.932370 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.932335    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe48c6e6096ac8a869e997d99888864863ab31b830c62582d1df26907cb02a92"} err="failed to get container status \"fe48c6e6096ac8a869e997d99888864863ab31b830c62582d1df26907cb02a92\": rpc error: code = NotFound desc = could not find container \"fe48c6e6096ac8a869e997d99888864863ab31b830c62582d1df26907cb02a92\": container with ID starting with fe48c6e6096ac8a869e997d99888864863ab31b830c62582d1df26907cb02a92 not found: ID does not exist"
Jul 08 16:31:30.932370 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.932353    2562 scope.go:117] "RemoveContainer" containerID="4c3dcc207d3fe081938dc5b9bf0d1035372606962f85fa3e23a5118dc5bbb946"
Jul 08 16:31:30.940444 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.940418    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg"]
Jul 08 16:31:30.940968 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.940951    2562 scope.go:117] "RemoveContainer" containerID="4c3dcc207d3fe081938dc5b9bf0d1035372606962f85fa3e23a5118dc5bbb946"
Jul 08 16:31:30.941232 ip-10-0-131-108 kubenswrapper[2562]: E0708 16:31:30.941211    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c3dcc207d3fe081938dc5b9bf0d1035372606962f85fa3e23a5118dc5bbb946\": container with ID starting with 4c3dcc207d3fe081938dc5b9bf0d1035372606962f85fa3e23a5118dc5bbb946 not found: ID does not exist" containerID="4c3dcc207d3fe081938dc5b9bf0d1035372606962f85fa3e23a5118dc5bbb946"
Jul 08 16:31:30.941309 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.941243    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c3dcc207d3fe081938dc5b9bf0d1035372606962f85fa3e23a5118dc5bbb946"} err="failed to get container status \"4c3dcc207d3fe081938dc5b9bf0d1035372606962f85fa3e23a5118dc5bbb946\": rpc error: code = NotFound desc = could not find container \"4c3dcc207d3fe081938dc5b9bf0d1035372606962f85fa3e23a5118dc5bbb946\": container with ID starting with 4c3dcc207d3fe081938dc5b9bf0d1035372606962f85fa3e23a5118dc5bbb946 not found: ID does not exist"
Jul 08 16:31:30.943573 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.943553    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-d4af16-29725470-n5hzg"]
Jul 08 16:31:30.954905 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.954883    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5"]
Jul 08 16:31:30.957478 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.957460    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f77711-29725470-8bvp5"]
Jul 08 16:31:30.967227 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.967202    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn"]
Jul 08 16:31:30.971124 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:30.971104    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725470-5knsn"]
Jul 08 16:31:31.505254 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:31.505216    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"]
Jul 08 16:31:31.525157 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:31.525122    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:31:32.481167 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.481135    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/test-curl-7569-140099277388848"]
Jul 08 16:31:32.481486 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.481475    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1372add-c215-4a2f-b875-d88dc5bc7853" containerName="cleanup"
Jul 08 16:31:32.481543 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.481487    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1372add-c215-4a2f-b875-d88dc5bc7853" containerName="cleanup"
Jul 08 16:31:32.481543 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.481497    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9831e7e7-49fc-42d0-9941-bf500daf6b9e" containerName="cleanup"
Jul 08 16:31:32.481543 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.481510    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9831e7e7-49fc-42d0-9941-bf500daf6b9e" containerName="cleanup"
Jul 08 16:31:32.481543 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.481524    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f834453b-fc49-4c6f-8ab5-d91a80a88430" containerName="cleanup"
Jul 08 16:31:32.481543 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.481530    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f834453b-fc49-4c6f-8ab5-d91a80a88430" containerName="cleanup"
Jul 08 16:31:32.481737 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.481624    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f834453b-fc49-4c6f-8ab5-d91a80a88430" containerName="cleanup"
Jul 08 16:31:32.481737 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.481634    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1372add-c215-4a2f-b875-d88dc5bc7853" containerName="cleanup"
Jul 08 16:31:32.481737 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.481640    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9831e7e7-49fc-42d0-9941-bf500daf6b9e" containerName="cleanup"
Jul 08 16:31:32.484678 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.484660    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7569-140099277388848"
Jul 08 16:31:32.487051 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.487028    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 16:31:32.488025 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.488007    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-cnshp\""
Jul 08 16:31:32.488127 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.488021    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 16:31:32.493631 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.493608    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/test-curl-7569-140099277388848"]
Jul 08 16:31:32.523013 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.522982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c4jq\" (UniqueName: \"kubernetes.io/projected/1e5ae5ab-cd63-4965-9637-c84aa8140419-kube-api-access-8c4jq\") pod \"test-curl-7569-140099277388848\" (UID: \"1e5ae5ab-cd63-4965-9637-c84aa8140419\") " pod="odh-ai-gateway-infra/test-curl-7569-140099277388848"
Jul 08 16:31:32.617643 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.617606    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9831e7e7-49fc-42d0-9941-bf500daf6b9e" path="/var/lib/kubelet/pods/9831e7e7-49fc-42d0-9941-bf500daf6b9e/volumes"
Jul 08 16:31:32.618029 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.618011    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1372add-c215-4a2f-b875-d88dc5bc7853" path="/var/lib/kubelet/pods/b1372add-c215-4a2f-b875-d88dc5bc7853/volumes"
Jul 08 16:31:32.618357 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.618340    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f834453b-fc49-4c6f-8ab5-d91a80a88430" path="/var/lib/kubelet/pods/f834453b-fc49-4c6f-8ab5-d91a80a88430/volumes"
Jul 08 16:31:32.623908 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.623885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c4jq\" (UniqueName: \"kubernetes.io/projected/1e5ae5ab-cd63-4965-9637-c84aa8140419-kube-api-access-8c4jq\") pod \"test-curl-7569-140099277388848\" (UID: \"1e5ae5ab-cd63-4965-9637-c84aa8140419\") " pod="odh-ai-gateway-infra/test-curl-7569-140099277388848"
Jul 08 16:31:32.632689 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.632662    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c4jq\" (UniqueName: \"kubernetes.io/projected/1e5ae5ab-cd63-4965-9637-c84aa8140419-kube-api-access-8c4jq\") pod \"test-curl-7569-140099277388848\" (UID: \"1e5ae5ab-cd63-4965-9637-c84aa8140419\") " pod="odh-ai-gateway-infra/test-curl-7569-140099277388848"
Jul 08 16:31:32.794539 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.794508    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7569-140099277388848"
Jul 08 16:31:32.924487 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.924449    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/test-curl-7569-140099277388848"]
Jul 08 16:31:32.928522 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:31:32.928494    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e5ae5ab_cd63_4965_9637_c84aa8140419.slice/crio-038b4de21a3be5bc5a1d5207b7e3b845c1842e408f964f6ecde2f993c44b8cdb WatchSource:0}: Error finding container 038b4de21a3be5bc5a1d5207b7e3b845c1842e408f964f6ecde2f993c44b8cdb: Status 404 returned error can't find the container with id 038b4de21a3be5bc5a1d5207b7e3b845c1842e408f964f6ecde2f993c44b8cdb
Jul 08 16:31:32.929999 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:32.929983    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 08 16:31:33.942379 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:33.942337    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7569-140099277388848" event={"ID":"1e5ae5ab-cd63-4965-9637-c84aa8140419","Type":"ContainerStarted","Data":"9fa13da1fb454dd00f2815a8212f678aa281389afd78f72fb258f64f2a39884a"}
Jul 08 16:31:33.942809 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:33.942390    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7569-140099277388848" event={"ID":"1e5ae5ab-cd63-4965-9637-c84aa8140419","Type":"ContainerStarted","Data":"038b4de21a3be5bc5a1d5207b7e3b845c1842e408f964f6ecde2f993c44b8cdb"}
Jul 08 16:31:33.958931 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:33.958880    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/test-curl-7569-140099277388848" podStartSLOduration=1.13141936 podStartE2EDuration="1.958862634s" totalImagesPullingTime="827.443274ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:31:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:31:33.957496539 +0000 UTC m=+2433.368161194" watchObservedRunningTime="2026-07-08 16:31:33.958862634 +0000 UTC m=+2433.369527287"
Jul 08 16:31:37.405499 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:37.405441    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:31:38.208787 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:38.208751    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:31:43.991335 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:43.991304    2562 generic.go:356] "Generic (PLEG): container finished" podID="1e5ae5ab-cd63-4965-9637-c84aa8140419" containerID="9fa13da1fb454dd00f2815a8212f678aa281389afd78f72fb258f64f2a39884a" exitCode=28
Jul 08 16:31:43.991765 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:43.991379    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7569-140099277388848" event={"ID":"1e5ae5ab-cd63-4965-9637-c84aa8140419","Type":"ContainerDied","Data":"9fa13da1fb454dd00f2815a8212f678aa281389afd78f72fb258f64f2a39884a"}
Jul 08 16:31:45.144354 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:45.144330    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7569-140099277388848"
Jul 08 16:31:45.178169 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:45.178125    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/test-curl-7569-140099277388848"]
Jul 08 16:31:45.181118 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:45.181083    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/test-curl-7569-140099277388848"]
Jul 08 16:31:45.240857 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:45.240820    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c4jq\" (UniqueName: \"kubernetes.io/projected/1e5ae5ab-cd63-4965-9637-c84aa8140419-kube-api-access-8c4jq\") pod \"1e5ae5ab-cd63-4965-9637-c84aa8140419\" (UID: \"1e5ae5ab-cd63-4965-9637-c84aa8140419\") "
Jul 08 16:31:45.242814 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:45.242784    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e5ae5ab-cd63-4965-9637-c84aa8140419-kube-api-access-8c4jq" (OuterVolumeSpecName: "kube-api-access-8c4jq") pod "1e5ae5ab-cd63-4965-9637-c84aa8140419" (UID: "1e5ae5ab-cd63-4965-9637-c84aa8140419"). InnerVolumeSpecName "kube-api-access-8c4jq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:31:45.341554 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:45.341515    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c4jq\" (UniqueName: \"kubernetes.io/projected/1e5ae5ab-cd63-4965-9637-c84aa8140419-kube-api-access-8c4jq\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:31:45.690810 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:45.690775    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk" podUID="b1f00093-f2ae-417c-8c5d-80a5fc3d0eec" containerName="main" containerID="cri-o://9b31a95824c70123a0be7aec176eb29274f1032d6726771ae57ab74fe021e1bf" gracePeriod=45
Jul 08 16:31:45.944752 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:45.944696    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:31:46.002236 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.002200    2562 generic.go:356] "Generic (PLEG): container finished" podID="b1f00093-f2ae-417c-8c5d-80a5fc3d0eec" containerID="9b31a95824c70123a0be7aec176eb29274f1032d6726771ae57ab74fe021e1bf" exitCode=0
Jul 08 16:31:46.002236 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.002236    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"
Jul 08 16:31:46.002426 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.002284    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk" event={"ID":"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec","Type":"ContainerDied","Data":"9b31a95824c70123a0be7aec176eb29274f1032d6726771ae57ab74fe021e1bf"}
Jul 08 16:31:46.002426 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.002323    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk" event={"ID":"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec","Type":"ContainerDied","Data":"9d1d70c1c4a173cd43f4b14341cae7121d9529116d4e7eacaf9b046894158698"}
Jul 08 16:31:46.002426 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.002345    2562 scope.go:117] "RemoveContainer" containerID="9b31a95824c70123a0be7aec176eb29274f1032d6726771ae57ab74fe021e1bf"
Jul 08 16:31:46.003699 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.003566    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="038b4de21a3be5bc5a1d5207b7e3b845c1842e408f964f6ecde2f993c44b8cdb"
Jul 08 16:31:46.003699 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.003628    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7569-140099277388848"
Jul 08 16:31:46.011462 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.011302    2562 scope.go:117] "RemoveContainer" containerID="9b31a95824c70123a0be7aec176eb29274f1032d6726771ae57ab74fe021e1bf"
Jul 08 16:31:46.011655 ip-10-0-131-108 kubenswrapper[2562]: E0708 16:31:46.011616    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b31a95824c70123a0be7aec176eb29274f1032d6726771ae57ab74fe021e1bf\": container with ID starting with 9b31a95824c70123a0be7aec176eb29274f1032d6726771ae57ab74fe021e1bf not found: ID does not exist" containerID="9b31a95824c70123a0be7aec176eb29274f1032d6726771ae57ab74fe021e1bf"
Jul 08 16:31:46.011799 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.011655    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b31a95824c70123a0be7aec176eb29274f1032d6726771ae57ab74fe021e1bf"} err="failed to get container status \"9b31a95824c70123a0be7aec176eb29274f1032d6726771ae57ab74fe021e1bf\": rpc error: code = NotFound desc = could not find container \"9b31a95824c70123a0be7aec176eb29274f1032d6726771ae57ab74fe021e1bf\": container with ID starting with 9b31a95824c70123a0be7aec176eb29274f1032d6726771ae57ab74fe021e1bf not found: ID does not exist"
Jul 08 16:31:46.014685 ip-10-0-131-108 kubenswrapper[2562]: E0708 16:31:46.014660    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7569-140099277388848\" is forbidden: User \"system:node:ip-10-0-131-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-131-108.ec2.internal' and this object" podUID="1e5ae5ab-cd63-4965-9637-c84aa8140419" pod="odh-ai-gateway-infra/test-curl-7569-140099277388848"
Jul 08 16:31:46.049030 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.049010    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-dshm\") pod \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") "
Jul 08 16:31:46.049130 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.049057    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-home\") pod \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") "
Jul 08 16:31:46.049130 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.049075    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-model-cache\") pod \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") "
Jul 08 16:31:46.049130 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.049098    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-tmp-dir\") pod \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") "
Jul 08 16:31:46.049296 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.049157    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-tls-certs\") pod \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") "
Jul 08 16:31:46.049296 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.049179    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6whds\" (UniqueName: \"kubernetes.io/projected/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-kube-api-access-6whds\") pod \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\" (UID: \"b1f00093-f2ae-417c-8c5d-80a5fc3d0eec\") "
Jul 08 16:31:46.049296 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.049262    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-home" (OuterVolumeSpecName: "home") pod "b1f00093-f2ae-417c-8c5d-80a5fc3d0eec" (UID: "b1f00093-f2ae-417c-8c5d-80a5fc3d0eec"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:31:46.049452 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.049374    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-model-cache" (OuterVolumeSpecName: "model-cache") pod "b1f00093-f2ae-417c-8c5d-80a5fc3d0eec" (UID: "b1f00093-f2ae-417c-8c5d-80a5fc3d0eec"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:31:46.049452 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.049389    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b1f00093-f2ae-417c-8c5d-80a5fc3d0eec" (UID: "b1f00093-f2ae-417c-8c5d-80a5fc3d0eec"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:31:46.049562 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.049514    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-home\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:31:46.049562 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.049532    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-model-cache\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:31:46.049665 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.049573    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-tmp-dir\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:31:46.051028 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.051009    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-dshm" (OuterVolumeSpecName: "dshm") pod "b1f00093-f2ae-417c-8c5d-80a5fc3d0eec" (UID: "b1f00093-f2ae-417c-8c5d-80a5fc3d0eec"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:31:46.051164 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.051145    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b1f00093-f2ae-417c-8c5d-80a5fc3d0eec" (UID: "b1f00093-f2ae-417c-8c5d-80a5fc3d0eec"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:31:46.051207 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.051157    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-kube-api-access-6whds" (OuterVolumeSpecName: "kube-api-access-6whds") pod "b1f00093-f2ae-417c-8c5d-80a5fc3d0eec" (UID: "b1f00093-f2ae-417c-8c5d-80a5fc3d0eec"). InnerVolumeSpecName "kube-api-access-6whds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:31:46.150377 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.150346    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-tls-certs\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:31:46.150377 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.150375    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6whds\" (UniqueName: \"kubernetes.io/projected/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-kube-api-access-6whds\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:31:46.150747 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.150387    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec-dshm\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:31:46.312698 ip-10-0-131-108 kubenswrapper[2562]: E0708 16:31:46.312663    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7569-140099277388848\" is forbidden: User \"system:node:ip-10-0-131-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-131-108.ec2.internal' and this object" podUID="1e5ae5ab-cd63-4965-9637-c84aa8140419" pod="odh-ai-gateway-infra/test-curl-7569-140099277388848"
Jul 08 16:31:46.325183 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.325156    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"]
Jul 08 16:31:46.329148 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.329120    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-d4af16/rate-test-model-d4af16-kserve-994bd7c8c-gxdsk"]
Jul 08 16:31:46.525070 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.525024    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5" podUID="87752b39-99a3-4513-84c4-b0b273b4e0a0" containerName="main" containerID="cri-o://771bb7f7f6e7c2b924b18e2e576dea77b2cbfc99b2f34cd2966c3e8f83c4784c" gracePeriod=45
Jul 08 16:31:46.617968 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.617893    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e5ae5ab-cd63-4965-9637-c84aa8140419" path="/var/lib/kubelet/pods/1e5ae5ab-cd63-4965-9637-c84aa8140419/volumes"
Jul 08 16:31:46.618284 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.618272    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1f00093-f2ae-417c-8c5d-80a5fc3d0eec" path="/var/lib/kubelet/pods/b1f00093-f2ae-417c-8c5d-80a5fc3d0eec/volumes"
Jul 08 16:31:46.783355 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.783326    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:31:46.857117 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.857083    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9tkd\" (UniqueName: \"kubernetes.io/projected/87752b39-99a3-4513-84c4-b0b273b4e0a0-kube-api-access-l9tkd\") pod \"87752b39-99a3-4513-84c4-b0b273b4e0a0\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") "
Jul 08 16:31:46.857280 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.857129    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-home\") pod \"87752b39-99a3-4513-84c4-b0b273b4e0a0\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") "
Jul 08 16:31:46.857280 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.857170    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-dshm\") pod \"87752b39-99a3-4513-84c4-b0b273b4e0a0\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") "
Jul 08 16:31:46.857280 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.857220    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-tmp-dir\") pod \"87752b39-99a3-4513-84c4-b0b273b4e0a0\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") "
Jul 08 16:31:46.857280 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.857255    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-model-cache\") pod \"87752b39-99a3-4513-84c4-b0b273b4e0a0\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") "
Jul 08 16:31:46.857508 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.857322    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87752b39-99a3-4513-84c4-b0b273b4e0a0-tls-certs\") pod \"87752b39-99a3-4513-84c4-b0b273b4e0a0\" (UID: \"87752b39-99a3-4513-84c4-b0b273b4e0a0\") "
Jul 08 16:31:46.857508 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.857415    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-home" (OuterVolumeSpecName: "home") pod "87752b39-99a3-4513-84c4-b0b273b4e0a0" (UID: "87752b39-99a3-4513-84c4-b0b273b4e0a0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:31:46.857649 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.857607    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "87752b39-99a3-4513-84c4-b0b273b4e0a0" (UID: "87752b39-99a3-4513-84c4-b0b273b4e0a0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:31:46.857649 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.857615    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-model-cache" (OuterVolumeSpecName: "model-cache") pod "87752b39-99a3-4513-84c4-b0b273b4e0a0" (UID: "87752b39-99a3-4513-84c4-b0b273b4e0a0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:31:46.857737 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.857709    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-tmp-dir\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:31:46.857737 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.857729    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-model-cache\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:31:46.857802 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.857742    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-home\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:31:46.859295 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.859265    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-dshm" (OuterVolumeSpecName: "dshm") pod "87752b39-99a3-4513-84c4-b0b273b4e0a0" (UID: "87752b39-99a3-4513-84c4-b0b273b4e0a0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 08 16:31:46.859409 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.859326    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87752b39-99a3-4513-84c4-b0b273b4e0a0-kube-api-access-l9tkd" (OuterVolumeSpecName: "kube-api-access-l9tkd") pod "87752b39-99a3-4513-84c4-b0b273b4e0a0" (UID: "87752b39-99a3-4513-84c4-b0b273b4e0a0"). InnerVolumeSpecName "kube-api-access-l9tkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:31:46.859409 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.859324    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87752b39-99a3-4513-84c4-b0b273b4e0a0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "87752b39-99a3-4513-84c4-b0b273b4e0a0" (UID: "87752b39-99a3-4513-84c4-b0b273b4e0a0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 08 16:31:46.958768 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.958676    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87752b39-99a3-4513-84c4-b0b273b4e0a0-tls-certs\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:31:46.958768 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.958716    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9tkd\" (UniqueName: \"kubernetes.io/projected/87752b39-99a3-4513-84c4-b0b273b4e0a0-kube-api-access-l9tkd\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:31:46.958768 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:46.958725    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87752b39-99a3-4513-84c4-b0b273b4e0a0-dshm\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:31:47.009811 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:47.009781    2562 generic.go:356] "Generic (PLEG): container finished" podID="87752b39-99a3-4513-84c4-b0b273b4e0a0" containerID="771bb7f7f6e7c2b924b18e2e576dea77b2cbfc99b2f34cd2966c3e8f83c4784c" exitCode=0
Jul 08 16:31:47.009985 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:47.009820    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"
Jul 08 16:31:47.009985 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:47.009859    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5" event={"ID":"87752b39-99a3-4513-84c4-b0b273b4e0a0","Type":"ContainerDied","Data":"771bb7f7f6e7c2b924b18e2e576dea77b2cbfc99b2f34cd2966c3e8f83c4784c"}
Jul 08 16:31:47.009985 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:47.009894    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5" event={"ID":"87752b39-99a3-4513-84c4-b0b273b4e0a0","Type":"ContainerDied","Data":"64b3433e10e57310a91e136004171f1fa211057dde49de7ac517984d0bc28346"}
Jul 08 16:31:47.009985 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:47.009910    2562 scope.go:117] "RemoveContainer" containerID="771bb7f7f6e7c2b924b18e2e576dea77b2cbfc99b2f34cd2966c3e8f83c4784c"
Jul 08 16:31:47.018629 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:47.018610    2562 scope.go:117] "RemoveContainer" containerID="771bb7f7f6e7c2b924b18e2e576dea77b2cbfc99b2f34cd2966c3e8f83c4784c"
Jul 08 16:31:47.018883 ip-10-0-131-108 kubenswrapper[2562]: E0708 16:31:47.018865    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"771bb7f7f6e7c2b924b18e2e576dea77b2cbfc99b2f34cd2966c3e8f83c4784c\": container with ID starting with 771bb7f7f6e7c2b924b18e2e576dea77b2cbfc99b2f34cd2966c3e8f83c4784c not found: ID does not exist" containerID="771bb7f7f6e7c2b924b18e2e576dea77b2cbfc99b2f34cd2966c3e8f83c4784c"
Jul 08 16:31:47.018947 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:47.018893    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"771bb7f7f6e7c2b924b18e2e576dea77b2cbfc99b2f34cd2966c3e8f83c4784c"} err="failed to get container status \"771bb7f7f6e7c2b924b18e2e576dea77b2cbfc99b2f34cd2966c3e8f83c4784c\": rpc error: code = NotFound desc = could not find container \"771bb7f7f6e7c2b924b18e2e576dea77b2cbfc99b2f34cd2966c3e8f83c4784c\": container with ID starting with 771bb7f7f6e7c2b924b18e2e576dea77b2cbfc99b2f34cd2966c3e8f83c4784c not found: ID does not exist"
Jul 08 16:31:47.031945 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:47.031920    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"]
Jul 08 16:31:47.037085 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:47.037065    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f77711/rate-test-model-f77711-kserve-6fcf57494c-6s9w5"]
Jul 08 16:31:48.617183 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:48.617152    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87752b39-99a3-4513-84c4-b0b273b4e0a0" path="/var/lib/kubelet/pods/87752b39-99a3-4513-84c4-b0b273b4e0a0/volumes"
Jul 08 16:31:58.248490 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.248453    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/test-curl-7569-140099281408336"]
Jul 08 16:31:58.248905 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.248830    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e5ae5ab-cd63-4965-9637-c84aa8140419" containerName="test-curl-7569-140099277388848"
Jul 08 16:31:58.248905 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.248842    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e5ae5ab-cd63-4965-9637-c84aa8140419" containerName="test-curl-7569-140099277388848"
Jul 08 16:31:58.248905 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.248852    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87752b39-99a3-4513-84c4-b0b273b4e0a0" containerName="main"
Jul 08 16:31:58.248905 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.248857    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="87752b39-99a3-4513-84c4-b0b273b4e0a0" containerName="main"
Jul 08 16:31:58.248905 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.248869    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f00093-f2ae-417c-8c5d-80a5fc3d0eec" containerName="main"
Jul 08 16:31:58.248905 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.248874    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f00093-f2ae-417c-8c5d-80a5fc3d0eec" containerName="main"
Jul 08 16:31:58.249099 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.248924    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f00093-f2ae-417c-8c5d-80a5fc3d0eec" containerName="main"
Jul 08 16:31:58.249099 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.248934    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e5ae5ab-cd63-4965-9637-c84aa8140419" containerName="test-curl-7569-140099277388848"
Jul 08 16:31:58.249099 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.248942    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="87752b39-99a3-4513-84c4-b0b273b4e0a0" containerName="main"
Jul 08 16:31:58.253378 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.253356    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7569-140099281408336"
Jul 08 16:31:58.256196 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.256171    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 08 16:31:58.257178 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.257151    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-cnshp\""
Jul 08 16:31:58.257178 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.257151    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 08 16:31:58.262890 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.262869    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/test-curl-7569-140099281408336"]
Jul 08 16:31:58.356945 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.356910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bns72\" (UniqueName: \"kubernetes.io/projected/93d20b58-c38a-4e0d-ad62-98a686bf89c5-kube-api-access-bns72\") pod \"test-curl-7569-140099281408336\" (UID: \"93d20b58-c38a-4e0d-ad62-98a686bf89c5\") " pod="odh-ai-gateway-infra/test-curl-7569-140099281408336"
Jul 08 16:31:58.458090 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.458051    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bns72\" (UniqueName: \"kubernetes.io/projected/93d20b58-c38a-4e0d-ad62-98a686bf89c5-kube-api-access-bns72\") pod \"test-curl-7569-140099281408336\" (UID: \"93d20b58-c38a-4e0d-ad62-98a686bf89c5\") " pod="odh-ai-gateway-infra/test-curl-7569-140099281408336"
Jul 08 16:31:58.467057 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.467023    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bns72\" (UniqueName: \"kubernetes.io/projected/93d20b58-c38a-4e0d-ad62-98a686bf89c5-kube-api-access-bns72\") pod \"test-curl-7569-140099281408336\" (UID: \"93d20b58-c38a-4e0d-ad62-98a686bf89c5\") " pod="odh-ai-gateway-infra/test-curl-7569-140099281408336"
Jul 08 16:31:58.562661 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.562628    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7569-140099281408336"
Jul 08 16:31:58.694117 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:58.694093    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/test-curl-7569-140099281408336"]
Jul 08 16:31:58.696320 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:31:58.696294    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93d20b58_c38a_4e0d_ad62_98a686bf89c5.slice/crio-6268728d812190fe35aca16eb3d1eef9cedcd546c16f0263a39d1c88102db112 WatchSource:0}: Error finding container 6268728d812190fe35aca16eb3d1eef9cedcd546c16f0263a39d1c88102db112: Status 404 returned error can't find the container with id 6268728d812190fe35aca16eb3d1eef9cedcd546c16f0263a39d1c88102db112
Jul 08 16:31:59.067623 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:31:59.067594    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7569-140099281408336" event={"ID":"93d20b58-c38a-4e0d-ad62-98a686bf89c5","Type":"ContainerStarted","Data":"6268728d812190fe35aca16eb3d1eef9cedcd546c16f0263a39d1c88102db112"}
Jul 08 16:32:00.073452 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:00.073410    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7569-140099281408336" event={"ID":"93d20b58-c38a-4e0d-ad62-98a686bf89c5","Type":"ContainerStarted","Data":"a067090c9445e21cdb13401648dedbd201721b2612a9c8fdfa5d3a0dfe1b758d"}
Jul 08 16:32:00.090442 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:00.090388    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/test-curl-7569-140099281408336" podStartSLOduration=1.77937617 podStartE2EDuration="2.090371981s" totalImagesPullingTime="310.995811ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:31:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:32:00.088928189 +0000 UTC m=+2459.499592844" watchObservedRunningTime="2026-07-08 16:32:00.090371981 +0000 UTC m=+2459.501036635"
Jul 08 16:32:09.115942 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:09.115905    2562 generic.go:356] "Generic (PLEG): container finished" podID="93d20b58-c38a-4e0d-ad62-98a686bf89c5" containerID="a067090c9445e21cdb13401648dedbd201721b2612a9c8fdfa5d3a0dfe1b758d" exitCode=28
Jul 08 16:32:09.116422 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:09.115982    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/test-curl-7569-140099281408336" event={"ID":"93d20b58-c38a-4e0d-ad62-98a686bf89c5","Type":"ContainerDied","Data":"a067090c9445e21cdb13401648dedbd201721b2612a9c8fdfa5d3a0dfe1b758d"}
Jul 08 16:32:10.264665 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:10.264641    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7569-140099281408336"
Jul 08 16:32:10.304178 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:10.304146    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/test-curl-7569-140099281408336"]
Jul 08 16:32:10.307502 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:10.307471    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/test-curl-7569-140099281408336"]
Jul 08 16:32:10.368098 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:10.368058    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bns72\" (UniqueName: \"kubernetes.io/projected/93d20b58-c38a-4e0d-ad62-98a686bf89c5-kube-api-access-bns72\") pod \"93d20b58-c38a-4e0d-ad62-98a686bf89c5\" (UID: \"93d20b58-c38a-4e0d-ad62-98a686bf89c5\") "
Jul 08 16:32:10.370132 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:10.370106    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93d20b58-c38a-4e0d-ad62-98a686bf89c5-kube-api-access-bns72" (OuterVolumeSpecName: "kube-api-access-bns72") pod "93d20b58-c38a-4e0d-ad62-98a686bf89c5" (UID: "93d20b58-c38a-4e0d-ad62-98a686bf89c5"). InnerVolumeSpecName "kube-api-access-bns72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 08 16:32:10.469514 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:10.469470    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bns72\" (UniqueName: \"kubernetes.io/projected/93d20b58-c38a-4e0d-ad62-98a686bf89c5-kube-api-access-bns72\") on node \"ip-10-0-131-108.ec2.internal\" DevicePath \"\""
Jul 08 16:32:10.553778 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:10.553744    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:32:10.616933 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:10.616892    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93d20b58-c38a-4e0d-ad62-98a686bf89c5" path="/var/lib/kubelet/pods/93d20b58-c38a-4e0d-ad62-98a686bf89c5/volumes"
Jul 08 16:32:10.971049 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:10.971018    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:32:11.077450 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:11.077421    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:32:11.126882 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:11.126851    2562 scope.go:117] "RemoveContainer" containerID="a067090c9445e21cdb13401648dedbd201721b2612a9c8fdfa5d3a0dfe1b758d"
Jul 08 16:32:11.127036 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:11.126850    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/test-curl-7569-140099281408336"
Jul 08 16:32:11.172970 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:11.172938    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:32:11.338427 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:11.338388    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:32:14.693027 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:14.692992    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:32:17.281854 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:17.281816    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:32:17.380438 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:17.380408    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:32:17.558107 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:17.557993    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:32:17.968880 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:17.968786    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:32:18.396103 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:18.396068    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:32:18.497970 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:18.497939    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:32:18.731671 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:18.731561    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:32:24.656186 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:24.656151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:32:24.757076 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:24.757042    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:32:24.944170 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:24.944079    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:32:25.555048 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:25.555001    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55c4b955b5-gfpbb_c0487e3e-0c35-4ed2-a121-25e12b954e4c/authorino/0.log"
Jul 08 16:32:27.390034 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:27.390001    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mq9nd"]
Jul 08 16:32:30.734546 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:30.734517    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86c94cb7c4-cd6md_0c02467b-0358-45ec-841c-ab92725a7d3d/copy-manifests/0.log"
Jul 08 16:32:30.746532 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:30.746505    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86c94cb7c4-cd6md_0c02467b-0358-45ec-841c-ab92725a7d3d/manager/0.log"
Jul 08 16:32:32.173310 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:32.173277    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55c4b955b5-gfpbb_c0487e3e-0c35-4ed2-a121-25e12b954e4c/authorino/0.log"
Jul 08 16:32:32.525137 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:32.525114    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-qntmj_2580f8e1-5769-4a15-97b6-de1049d36747/kuadrant-console-plugin/0.log"
Jul 08 16:32:32.883017 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:32.882940    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mq9nd_9e4f23c8-5c8b-4ea6-8245-c4d9de609f6d/limitador/0.log"
Jul 08 16:32:33.691546 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:33.691515    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-777c755669-tth2b_242b23c4-5723-47f8-be11-a3a20ceec4e6/kube-auth-proxy/0.log"
Jul 08 16:32:34.858572 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:34.858533    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbbr25t_3c0e80f6-4c3b-48eb-a2a1-3bc1bbbd59f9/main/0.log"
Jul 08 16:32:38.929573 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:38.929537    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7sqg6/must-gather-btcpc"]
Jul 08 16:32:38.929976 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:38.929914    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93d20b58-c38a-4e0d-ad62-98a686bf89c5" containerName="test-curl-7569-140099281408336"
Jul 08 16:32:38.929976 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:38.929926    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="93d20b58-c38a-4e0d-ad62-98a686bf89c5" containerName="test-curl-7569-140099281408336"
Jul 08 16:32:38.930064 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:38.929989    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="93d20b58-c38a-4e0d-ad62-98a686bf89c5" containerName="test-curl-7569-140099281408336"
Jul 08 16:32:38.932995 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:38.932978    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7sqg6/must-gather-btcpc"
Jul 08 16:32:38.935815 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:38.935789    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7sqg6\"/\"default-dockercfg-89vfp\""
Jul 08 16:32:38.935966 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:38.935832    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7sqg6\"/\"openshift-service-ca.crt\""
Jul 08 16:32:38.936033 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:38.936016    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7sqg6\"/\"kube-root-ca.crt\""
Jul 08 16:32:38.947014 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:38.946989    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7sqg6/must-gather-btcpc"]
Jul 08 16:32:38.952941 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:38.952904    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:32:39.034110 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:39.034076    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/31d2d867-7446-4b81-838f-7324d55b37d7-must-gather-output\") pod \"must-gather-btcpc\" (UID: \"31d2d867-7446-4b81-838f-7324d55b37d7\") " pod="openshift-must-gather-7sqg6/must-gather-btcpc"
Jul 08 16:32:39.034282 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:39.034127    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m47m9\" (UniqueName: \"kubernetes.io/projected/31d2d867-7446-4b81-838f-7324d55b37d7-kube-api-access-m47m9\") pod \"must-gather-btcpc\" (UID: \"31d2d867-7446-4b81-838f-7324d55b37d7\") " pod="openshift-must-gather-7sqg6/must-gather-btcpc"
Jul 08 16:32:39.051776 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:39.051721    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log" limit=1024
Jul 08 16:32:39.134753 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:39.134718    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m47m9\" (UniqueName: \"kubernetes.io/projected/31d2d867-7446-4b81-838f-7324d55b37d7-kube-api-access-m47m9\") pod \"must-gather-btcpc\" (UID: \"31d2d867-7446-4b81-838f-7324d55b37d7\") " pod="openshift-must-gather-7sqg6/must-gather-btcpc"
Jul 08 16:32:39.134932 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:39.134824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/31d2d867-7446-4b81-838f-7324d55b37d7-must-gather-output\") pod \"must-gather-btcpc\" (UID: \"31d2d867-7446-4b81-838f-7324d55b37d7\") " pod="openshift-must-gather-7sqg6/must-gather-btcpc"
Jul 08 16:32:39.135195 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:39.135177    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/31d2d867-7446-4b81-838f-7324d55b37d7-must-gather-output\") pod \"must-gather-btcpc\" (UID: \"31d2d867-7446-4b81-838f-7324d55b37d7\") " pod="openshift-must-gather-7sqg6/must-gather-btcpc"
Jul 08 16:32:39.143419 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:39.143393    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m47m9\" (UniqueName: \"kubernetes.io/projected/31d2d867-7446-4b81-838f-7324d55b37d7-kube-api-access-m47m9\") pod \"must-gather-btcpc\" (UID: \"31d2d867-7446-4b81-838f-7324d55b37d7\") " pod="openshift-must-gather-7sqg6/must-gather-btcpc"
Jul 08 16:32:39.242733 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:39.242634    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7sqg6/must-gather-btcpc"
Jul 08 16:32:39.374242 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:39.374132    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7sqg6/must-gather-btcpc"]
Jul 08 16:32:39.377009 ip-10-0-131-108 kubenswrapper[2562]: W0708 16:32:39.376979    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31d2d867_7446_4b81_838f_7324d55b37d7.slice/crio-6c433aba1054165cd8fb6822d66aaa0ec76835da192eff6f96d6b9e7f1becc42 WatchSource:0}: Error finding container 6c433aba1054165cd8fb6822d66aaa0ec76835da192eff6f96d6b9e7f1becc42: Status 404 returned error can't find the container with id 6c433aba1054165cd8fb6822d66aaa0ec76835da192eff6f96d6b9e7f1becc42
Jul 08 16:32:40.264970 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:40.264931    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7sqg6/must-gather-btcpc" event={"ID":"31d2d867-7446-4b81-838f-7324d55b37d7","Type":"ContainerStarted","Data":"6c433aba1054165cd8fb6822d66aaa0ec76835da192eff6f96d6b9e7f1becc42"}
Jul 08 16:32:41.275403 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:41.274535    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7sqg6/must-gather-btcpc" event={"ID":"31d2d867-7446-4b81-838f-7324d55b37d7","Type":"ContainerStarted","Data":"e64c8598278254b43251864bf4a26c53f6ca753391ec30f8ed37c64b6f5ebaf9"}
Jul 08 16:32:41.275403 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:41.274609    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7sqg6/must-gather-btcpc" event={"ID":"31d2d867-7446-4b81-838f-7324d55b37d7","Type":"ContainerStarted","Data":"cfe794b18fa5d17dd75dfaf6891ddef66cf36e993b9d915f03c41d790563ac2b"}
Jul 08 16:32:41.294996 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:41.294933    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7sqg6/must-gather-btcpc" podStartSLOduration=2.03639516 podStartE2EDuration="3.294910543s" totalImagesPullingTime="1.258515383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:32:41.292695922 +0000 UTC m=+2500.703360619" watchObservedRunningTime="2026-07-08 16:32:41.294910543 +0000 UTC m=+2500.705575200"
Jul 08 16:32:42.185468 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:42.185432    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fwvjs_80295698-bf83-4342-a954-7491ebe64be9/global-pull-secret-syncer/0.log"
Jul 08 16:32:42.325086 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:42.325048    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5thr2_39598e1b-be56-4383-816d-e36a823de7a7/konnectivity-agent/0.log"
Jul 08 16:32:42.414523 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:42.414496    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-108.ec2.internal_f22ba0b68e3ed2da157c9fd0e9361669/haproxy/0.log"
Jul 08 16:32:47.511452 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:47.511414    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55c4b955b5-gfpbb_c0487e3e-0c35-4ed2-a121-25e12b954e4c/authorino/0.log"
Jul 08 16:32:47.623613 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:47.623570    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-qntmj_2580f8e1-5769-4a15-97b6-de1049d36747/kuadrant-console-plugin/0.log"
Jul 08 16:32:47.871547 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:47.871437    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mq9nd_9e4f23c8-5c8b-4ea6-8245-c4d9de609f6d/limitador/0.log"
Jul 08 16:32:49.508880 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:49.508851    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b/alertmanager/0.log"
Jul 08 16:32:49.559418 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:49.559389    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b/config-reloader/0.log"
Jul 08 16:32:49.596140 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:49.596111    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b/kube-rbac-proxy-web/0.log"
Jul 08 16:32:49.620064 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:49.620032    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b/kube-rbac-proxy/0.log"
Jul 08 16:32:49.643327 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:49.643245    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b/kube-rbac-proxy-metric/0.log"
Jul 08 16:32:49.664935 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:49.664909    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b/prom-label-proxy/0.log"
Jul 08 16:32:49.686402 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:49.686357    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85fb267c-a0ed-40e3-a912-ebdf8f3e4b1b/init-config-reloader/0.log"
Jul 08 16:32:49.764090 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:49.764036    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-d7cpv_fbf121f5-e8be-4e15-9a1e-6f68a834b89a/kube-state-metrics/0.log"
Jul 08 16:32:49.783005 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:49.782973    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-d7cpv_fbf121f5-e8be-4e15-9a1e-6f68a834b89a/kube-rbac-proxy-main/0.log"
Jul 08 16:32:49.808675 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:49.808647    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-d7cpv_fbf121f5-e8be-4e15-9a1e-6f68a834b89a/kube-rbac-proxy-self/0.log"
Jul 08 16:32:49.921493 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:49.921227    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g82ql_52bdeb88-c265-4960-8411-4ac5fde63982/node-exporter/0.log"
Jul 08 16:32:49.944947 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:49.944825    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g82ql_52bdeb88-c265-4960-8411-4ac5fde63982/kube-rbac-proxy/0.log"
Jul 08 16:32:49.969471 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:49.969445    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g82ql_52bdeb88-c265-4960-8411-4ac5fde63982/init-textfile/0.log"
Jul 08 16:32:50.184992 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:50.184919    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-dsvgk_9a6c8c07-988c-4eb2-a6ca-0c63d6490652/kube-rbac-proxy-main/0.log"
Jul 08 16:32:50.209639 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:50.209565    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-dsvgk_9a6c8c07-988c-4eb2-a6ca-0c63d6490652/kube-rbac-proxy-self/0.log"
Jul 08 16:32:50.235113 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:50.235057    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-dsvgk_9a6c8c07-988c-4eb2-a6ca-0c63d6490652/openshift-state-metrics/0.log"
Jul 08 16:32:50.275145 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:50.275088    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b91f70ea-1dab-4963-a9c6-55eb5645755f/prometheus/0.log"
Jul 08 16:32:50.296869 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:50.296807    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b91f70ea-1dab-4963-a9c6-55eb5645755f/config-reloader/0.log"
Jul 08 16:32:50.324905 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:50.324855    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b91f70ea-1dab-4963-a9c6-55eb5645755f/thanos-sidecar/0.log"
Jul 08 16:32:50.350652 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:50.350543    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b91f70ea-1dab-4963-a9c6-55eb5645755f/kube-rbac-proxy-web/0.log"
Jul 08 16:32:50.373898 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:50.373862    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b91f70ea-1dab-4963-a9c6-55eb5645755f/kube-rbac-proxy/0.log"
Jul 08 16:32:50.395165 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:50.395078    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b91f70ea-1dab-4963-a9c6-55eb5645755f/kube-rbac-proxy-thanos/0.log"
Jul 08 16:32:50.420032 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:50.419973    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b91f70ea-1dab-4963-a9c6-55eb5645755f/init-config-reloader/0.log"
Jul 08 16:32:50.493213 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:50.493125    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-6l7vp_1b3ff321-1ffa-4703-b9b6-8a0c04cfccfd/prometheus-operator-admission-webhook/0.log"
Jul 08 16:32:50.601419 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:50.601391    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865d8fc895-7dxhx_73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703/thanos-query/0.log"
Jul 08 16:32:50.626677 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:50.626642    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865d8fc895-7dxhx_73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703/kube-rbac-proxy-web/0.log"
Jul 08 16:32:50.651430 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:50.651369    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865d8fc895-7dxhx_73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703/kube-rbac-proxy/0.log"
Jul 08 16:32:50.672960 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:50.672933    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865d8fc895-7dxhx_73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703/prom-label-proxy/0.log"
Jul 08 16:32:50.696548 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:50.696523    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865d8fc895-7dxhx_73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703/kube-rbac-proxy-rules/0.log"
Jul 08 16:32:50.719316 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:50.719286    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-865d8fc895-7dxhx_73e1fbfa-e4b7-41c9-b63f-6f8bb24ca703/kube-rbac-proxy-metrics/0.log"
Jul 08 16:32:52.820339 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:52.820253    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"]
Jul 08 16:32:52.829357 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:52.829326    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:52.834712 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:52.834675    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"]
Jul 08 16:32:52.984997 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:52.984965    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc8tx\" (UniqueName: \"kubernetes.io/projected/97bc2dd9-6785-45e2-9fc3-2c66f8082599-kube-api-access-tc8tx\") pod \"perf-node-gather-daemonset-nlprm\" (UID: \"97bc2dd9-6785-45e2-9fc3-2c66f8082599\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:52.985162 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:52.985034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97bc2dd9-6785-45e2-9fc3-2c66f8082599-lib-modules\") pod \"perf-node-gather-daemonset-nlprm\" (UID: \"97bc2dd9-6785-45e2-9fc3-2c66f8082599\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:52.985208 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:52.985174    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97bc2dd9-6785-45e2-9fc3-2c66f8082599-sys\") pod \"perf-node-gather-daemonset-nlprm\" (UID: \"97bc2dd9-6785-45e2-9fc3-2c66f8082599\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:52.985252 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:52.985241    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97bc2dd9-6785-45e2-9fc3-2c66f8082599-proc\") pod \"perf-node-gather-daemonset-nlprm\" (UID: \"97bc2dd9-6785-45e2-9fc3-2c66f8082599\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:52.985298 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:52.985274    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97bc2dd9-6785-45e2-9fc3-2c66f8082599-podres\") pod \"perf-node-gather-daemonset-nlprm\" (UID: \"97bc2dd9-6785-45e2-9fc3-2c66f8082599\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:53.086014 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:53.085918    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97bc2dd9-6785-45e2-9fc3-2c66f8082599-sys\") pod \"perf-node-gather-daemonset-nlprm\" (UID: \"97bc2dd9-6785-45e2-9fc3-2c66f8082599\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:53.086014 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:53.085988    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97bc2dd9-6785-45e2-9fc3-2c66f8082599-proc\") pod \"perf-node-gather-daemonset-nlprm\" (UID: \"97bc2dd9-6785-45e2-9fc3-2c66f8082599\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:53.086237 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:53.086019    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97bc2dd9-6785-45e2-9fc3-2c66f8082599-podres\") pod \"perf-node-gather-daemonset-nlprm\" (UID: \"97bc2dd9-6785-45e2-9fc3-2c66f8082599\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:53.086237 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:53.086063    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc8tx\" (UniqueName: \"kubernetes.io/projected/97bc2dd9-6785-45e2-9fc3-2c66f8082599-kube-api-access-tc8tx\") pod \"perf-node-gather-daemonset-nlprm\" (UID: \"97bc2dd9-6785-45e2-9fc3-2c66f8082599\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:53.086237 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:53.086059    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97bc2dd9-6785-45e2-9fc3-2c66f8082599-proc\") pod \"perf-node-gather-daemonset-nlprm\" (UID: \"97bc2dd9-6785-45e2-9fc3-2c66f8082599\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:53.086237 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:53.086019    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97bc2dd9-6785-45e2-9fc3-2c66f8082599-sys\") pod \"perf-node-gather-daemonset-nlprm\" (UID: \"97bc2dd9-6785-45e2-9fc3-2c66f8082599\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:53.086237 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:53.086136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97bc2dd9-6785-45e2-9fc3-2c66f8082599-lib-modules\") pod \"perf-node-gather-daemonset-nlprm\" (UID: \"97bc2dd9-6785-45e2-9fc3-2c66f8082599\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:53.086237 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:53.086190    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97bc2dd9-6785-45e2-9fc3-2c66f8082599-podres\") pod \"perf-node-gather-daemonset-nlprm\" (UID: \"97bc2dd9-6785-45e2-9fc3-2c66f8082599\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:53.086458 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:53.086309    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97bc2dd9-6785-45e2-9fc3-2c66f8082599-lib-modules\") pod \"perf-node-gather-daemonset-nlprm\" (UID: \"97bc2dd9-6785-45e2-9fc3-2c66f8082599\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:53.095711 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:53.095685    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc8tx\" (UniqueName: \"kubernetes.io/projected/97bc2dd9-6785-45e2-9fc3-2c66f8082599-kube-api-access-tc8tx\") pod \"perf-node-gather-daemonset-nlprm\" (UID: \"97bc2dd9-6785-45e2-9fc3-2c66f8082599\") " pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:53.144460 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:53.144423    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:53.185286 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:53.185257    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-xbt6w_dbf4d6fb-0a5f-43b8-b66a-95071d5c0882/download-server/0.log"
Jul 08 16:32:53.316468 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:53.316384    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"]
Jul 08 16:32:53.371607 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:53.371550    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm" event={"ID":"97bc2dd9-6785-45e2-9fc3-2c66f8082599","Type":"ContainerStarted","Data":"adb2a33c0a51179c6720b25e1fd62f5721029b44995a486e1f81dcc7ae50a466"}
Jul 08 16:32:54.379727 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:54.379688    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm" event={"ID":"97bc2dd9-6785-45e2-9fc3-2c66f8082599","Type":"ContainerStarted","Data":"b15fad23f2d11444b7fbc5c2de2acde9becd6f6ec0645f37a6103f3dd8896354"}
Jul 08 16:32:54.381138 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:54.381112    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:32:54.398433 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:54.398373    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm" podStartSLOduration=2.398354124 podStartE2EDuration="2.398354124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:32:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:32:54.397343547 +0000 UTC m=+2513.808008198" watchObservedRunningTime="2026-07-08 16:32:54.398354124 +0000 UTC m=+2513.809018782"
Jul 08 16:32:54.931221 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:54.931190    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n85j9_2e25c91b-8570-40e1-b46f-02c99f5d4f47/dns/0.log"
Jul 08 16:32:54.953076 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:54.953053    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n85j9_2e25c91b-8570-40e1-b46f-02c99f5d4f47/kube-rbac-proxy/0.log"
Jul 08 16:32:54.976068 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:54.976042    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5m9q9_35d153c0-3c55-4eea-af1d-6f0dfc498243/dns-node-resolver/0.log"
Jul 08 16:32:55.576034 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:55.576005    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6dc99fdc68-9gqbh_ea9650a3-fcff-457b-8529-d0a45323514b/registry/0.log"
Jul 08 16:32:55.597172 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:55.597149    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-287gc_f09d8cdf-3fb9-4661-ab2a-d56dac22f1f7/node-ca/0.log"
Jul 08 16:32:56.853919 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:56.853885    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-777c755669-tth2b_242b23c4-5723-47f8-be11-a3a20ceec4e6/kube-auth-proxy/0.log"
Jul 08 16:32:57.751475 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:57.751447    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kn9t5_eb8acfc6-62bf-4756-afcc-156d78e816d7/serve-healthcheck-canary/0.log"
Jul 08 16:32:58.372024 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:58.371996    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cxdfq_de1a42ce-0b39-419a-a113-6cdc13b00ea9/kube-rbac-proxy/0.log"
Jul 08 16:32:58.394644 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:58.394617    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cxdfq_de1a42ce-0b39-419a-a113-6cdc13b00ea9/exporter/0.log"
Jul 08 16:32:58.416315 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:32:58.416290    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-cxdfq_de1a42ce-0b39-419a-a113-6cdc13b00ea9/extractor/0.log"
Jul 08 16:33:01.155285 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:01.155251    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86c94cb7c4-cd6md_0c02467b-0358-45ec-841c-ab92725a7d3d/manager/0.log"
Jul 08 16:33:01.171312 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:01.171289    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86c94cb7c4-cd6md_0c02467b-0358-45ec-841c-ab92725a7d3d/copy-manifests/0.log"
Jul 08 16:33:01.401995 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:01.401968    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7sqg6/perf-node-gather-daemonset-nlprm"
Jul 08 16:33:02.387475 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:02.387444    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-57b64f8b44-j72ds_c938985f-3962-4cbd-b18c-08246c3aa072/manager/0.log"
Jul 08 16:33:03.036161 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:03.036121    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-777c755669-tth2b_242b23c4-5723-47f8-be11-a3a20ceec4e6/kube-auth-proxy/0.log"
Jul 08 16:33:04.734128 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:04.734100    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-777c755669-tth2b_242b23c4-5723-47f8-be11-a3a20ceec4e6/kube-auth-proxy/0.log"
Jul 08 16:33:07.857257 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:07.857233    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-dkbqw_028573ac-1ac9-4b53-8534-d3ca16b6143f/migrator/0.log"
Jul 08 16:33:07.876933 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:07.876900    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-dkbqw_028573ac-1ac9-4b53-8534-d3ca16b6143f/graceful-termination/0.log"
Jul 08 16:33:09.347561 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:09.347531    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xkqh_33628d14-fa4a-4bba-8f64-8e7e4b93bbb9/kube-multus-additional-cni-plugins/0.log"
Jul 08 16:33:09.366991 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:09.366955    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xkqh_33628d14-fa4a-4bba-8f64-8e7e4b93bbb9/egress-router-binary-copy/0.log"
Jul 08 16:33:09.387295 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:09.387267    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xkqh_33628d14-fa4a-4bba-8f64-8e7e4b93bbb9/cni-plugins/0.log"
Jul 08 16:33:09.407084 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:09.407058    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xkqh_33628d14-fa4a-4bba-8f64-8e7e4b93bbb9/bond-cni-plugin/0.log"
Jul 08 16:33:09.427501 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:09.427469    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xkqh_33628d14-fa4a-4bba-8f64-8e7e4b93bbb9/routeoverride-cni/0.log"
Jul 08 16:33:09.449400 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:09.449370    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xkqh_33628d14-fa4a-4bba-8f64-8e7e4b93bbb9/whereabouts-cni-bincopy/0.log"
Jul 08 16:33:09.470460 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:09.470435    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8xkqh_33628d14-fa4a-4bba-8f64-8e7e4b93bbb9/whereabouts-cni/0.log"
Jul 08 16:33:09.901143 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:09.901100    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rmjrs_ca7334d7-2933-491d-a1e2-5a9b5dbd323c/kube-multus/0.log"
Jul 08 16:33:10.014340 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:10.014303    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-txtpm_4d3d9829-234c-45ed-8d74-75cdadc4f135/network-metrics-daemon/0.log"
Jul 08 16:33:10.038682 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:10.038656    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-txtpm_4d3d9829-234c-45ed-8d74-75cdadc4f135/kube-rbac-proxy/0.log"
Jul 08 16:33:10.874515 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:10.874481    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7kt66_87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d/ovn-controller/0.log"
Jul 08 16:33:10.890870 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:10.890846    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7kt66_87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d/ovn-acl-logging/0.log"
Jul 08 16:33:10.914269 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:10.914181    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7kt66_87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d/kube-rbac-proxy-node/0.log"
Jul 08 16:33:10.936469 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:10.936441    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7kt66_87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d/kube-rbac-proxy-ovn-metrics/0.log"
Jul 08 16:33:10.957450 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:10.957427    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7kt66_87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d/northd/0.log"
Jul 08 16:33:10.977139 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:10.977114    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7kt66_87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d/nbdb/0.log"
Jul 08 16:33:10.999814 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:10.999792    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7kt66_87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d/sbdb/0.log"
Jul 08 16:33:11.052650 ip-10-0-131-108 kubenswrapper[2562]: I0708 16:33:11.052609    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7kt66_87c8a54f-d1b2-4ddd-a47b-8d62c110bf5d/ovnkube-controller/0.log"